-- Logs begin at Tue 2022-07-26 13:51:32 UTC, end at Tue 2022-07-26 15:20:45 UTC. -- Jul 26 14:39:00.916990 dv-cinder-850668-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 26 14:39:00.925684 dv-cinder-850668-2-smb devstack@keystone.service[92021]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 26 14:39:00.927687 dv-cinder-850668-2-smb devstack@keystone.service[92021]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 14:39:00 2022] *** Jul 26 14:39:00.927687 dv-cinder-850668-2-smb devstack@keystone.service[92021]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 14:39:00.927687 dv-cinder-850668-2-smb devstack@keystone.service[92021]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 14:39:00.927687 dv-cinder-850668-2-smb devstack@keystone.service[92021]: nodename: dv-cinder-850668-2-smb Jul 26 14:39:00.927687 dv-cinder-850668-2-smb devstack@keystone.service[92021]: machine: x86_64 Jul 26 14:39:00.927687 dv-cinder-850668-2-smb devstack@keystone.service[92021]: clock source: unix Jul 26 14:39:00.927687 dv-cinder-850668-2-smb devstack@keystone.service[92021]: pcre jit disabled Jul 26 14:39:00.927687 dv-cinder-850668-2-smb devstack@keystone.service[92021]: detected number of CPU cores: 4 Jul 26 14:39:00.927687 dv-cinder-850668-2-smb devstack@keystone.service[92021]: current working directory: / Jul 26 14:39:00.927687 dv-cinder-850668-2-smb devstack@keystone.service[92021]: detected binary path: /usr/bin/uwsgi-core Jul 26 14:39:00.928217 dv-cinder-850668-2-smb devstack@keystone.service[92021]: your processes number limit is 47680 Jul 26 14:39:00.928217 dv-cinder-850668-2-smb devstack@keystone.service[92021]: your memory page size is 4096 bytes Jul 26 14:39:00.928217 dv-cinder-850668-2-smb devstack@keystone.service[92021]: detected max file descriptor number: 2048 Jul 26 14:39:00.928217 dv-cinder-850668-2-smb devstack@keystone.service[92021]: lock engine: pthread robust mutexes Jul 26 14:39:00.928217 dv-cinder-850668-2-smb devstack@keystone.service[92021]: thunder lock: enabled Jul 26 14:39:00.928217 dv-cinder-850668-2-smb devstack@keystone.service[92021]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 26 14:39:00.928217 dv-cinder-850668-2-smb devstack@keystone.service[92021]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 14:39:00.967844 dv-cinder-850668-2-smb devstack@keystone.service[92021]: Python main interpreter initialized at 0x55fb6ca5e9c0 Jul 26 14:39:00.967844 dv-cinder-850668-2-smb devstack@keystone.service[92021]: python threads support enabled Jul 26 14:39:00.967844 dv-cinder-850668-2-smb devstack@keystone.service[92021]: your server socket listen backlog is limited to 100 connections Jul 26 14:39:00.967844 dv-cinder-850668-2-smb devstack@keystone.service[92021]: your mercy for graceful operations on workers is 90 seconds Jul 26 14:39:00.968177 dv-cinder-850668-2-smb devstack@keystone.service[92021]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 14:39:00.968252 dv-cinder-850668-2-smb devstack@keystone.service[92021]: *** Operational MODE: preforking *** Jul 26 14:39:00.968524 dv-cinder-850668-2-smb devstack@keystone.service[92021]: *** uWSGI is running in multiple interpreter mode *** Jul 26 14:39:00.968524 dv-cinder-850668-2-smb devstack@keystone.service[92021]: spawned uWSGI master process (pid: 92021) Jul 26 14:39:00.968721 dv-cinder-850668-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 26 14:39:00.970367 dv-cinder-850668-2-smb devstack@keystone.service[92021]: spawned uWSGI worker 1 (pid: 92029, cores: 1) Jul 26 14:39:00.970367 dv-cinder-850668-2-smb devstack@keystone.service[92021]: spawned uWSGI worker 2 (pid: 92030, cores: 1) Jul 26 14:39:00.970367 dv-cinder-850668-2-smb devstack@keystone.service[92021]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 14:39:06.558172 dv-cinder-850668-2-smb devstack@keystone.service[92029]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:39:06.558172 dv-cinder-850668-2-smb devstack@keystone.service[92029]: from cryptography.utils import int_from_bytes Jul 26 14:39:06.559002 dv-cinder-850668-2-smb devstack@keystone.service[92029]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:39:06.559002 dv-cinder-850668-2-smb devstack@keystone.service[92029]: from cryptography.utils import int_from_bytes Jul 26 14:39:06.612780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 14:39:06.612963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 14:39:06.613153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] command line args: [] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 14:39:06.613428 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 14:39:06.613611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ================================================================================ {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 14:39:06.613873 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] admin_token = **** {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.614127 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] config_dir = [] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.614318 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.614536 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] config_source = [] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.614724 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] debug = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.614928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.616092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.616092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.616092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.616092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.616325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] list_limit = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.616394 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] log_config_append = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.616532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.616714 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] log_dir = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.616896 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] log_file = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.617139 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.617391 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.617644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.617897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.618092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.618260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.618551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.618792 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.619034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.619273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.619514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.620373 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.620536 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.620795 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.621076 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.621590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.86/identity {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.621777 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] publish_errors = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.622020 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.622259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.622469 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.622728 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.622973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.623215 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] standard_threads = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.623707 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.623958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.624139 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.624320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] use_journal = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.624500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] use_json = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.624680 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] use_stderr = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.624860 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] use_syslog = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.625098 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.625360 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.625607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.625875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.626123 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.626381 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.626650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.626907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.627151 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.627408 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.627663 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.627922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.628165 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.628421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.628665 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.628922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.629179 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.629424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.629687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.629949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.630201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.630469 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.630740 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.631012 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.631272 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.631528 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.631769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.632008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.632246 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.632494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.632749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.633007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.633240 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.633479 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.633733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.633989 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.634233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.634514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.634757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.635001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.635243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.636029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.637966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:39:06.637966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: from cryptography.utils import int_from_bytes Jul 26 14:39:06.638494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.638573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:39:06.638573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: from cryptography.utils import int_from_bytes Jul 26 14:39:06.638698 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.638698 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.638912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.639618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.639875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.640134 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.640523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.641716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.642004 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.642287 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.642576 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.642843 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.643105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.643365 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.643622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.643884 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.644136 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.644455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.644710 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.644964 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.645212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.645486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.645738 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.645982 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.646233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.646508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.646792 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.647042 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.647305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.647565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.647859 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.648061 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.648307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.648566 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.648813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.649058 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.649310 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.649556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.649802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.650046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.650290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.650557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.650832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.651113 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.651410 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.651672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.652006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.652300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.652552 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.652797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.653040 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.653282 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.653521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.653767 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.654012 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.654262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.654533 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.654795 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.655042 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.655310 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.655581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.655834 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.656076 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] auth.external = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.656316 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.656624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.656866 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.657106 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] auth.password = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.657346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] auth.token = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.657593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.657838 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.658095 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.658335 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.658629 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.658887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.659142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.659384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] credential.caching = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.659644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.659902 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.660159 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.660403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.660657 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.660899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.661181 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.661443 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.661688 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.661953 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.662249 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.662528 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.662803 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.663316 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.663316 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.663546 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] federation.caching = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.663797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.664168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.664731 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.664985 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.665248 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.665499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.665765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.666012 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.666279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.666583 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.666958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.667150 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] identity.caching = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.667387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.667590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.667837 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.668084 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.668345 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.668586 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.668832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.669091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.669416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.669579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.669818 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.670058 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.670311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.670594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.670852 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.671539 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.671539 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.671801 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.671922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.672084 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.672325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.672571 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.672809 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.673053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.673304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.673552 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.673808 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.674046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.674307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.674589 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.674835 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.675089 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.675344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.675584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.675829 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.676065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.676310 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.676554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.676806 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.677050 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.677292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.677802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.677802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.678061 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.678241 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.678522 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.678781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.679027 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.679270 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.679512 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.679751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.680005 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.680273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.680514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.680767 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.681023 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.681276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.681521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.681758 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.682036 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.682826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.683080 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.683319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.683575 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.683831 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.684086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.684484 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.684747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.684989 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.685245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.685491 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.685737 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.685982 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.686227 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.686505 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.686765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.686860 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 14:39:06.686992 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 14:39:06.687110 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.687193 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] command line args: [] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 14:39:06.687275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.687441 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 14:39:06.687532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.687606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ================================================================================ {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 14:39:06.687720 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.687858 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] admin_token = **** {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.687964 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.688106 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] config_dir = [] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.688192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.688293 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.688439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.688517 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] config_source = [] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.688641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] debug = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.688727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.688854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.688961 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.689089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.689174 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.689267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.689383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.689518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.689633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] resource.caching = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.689768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.689894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.690002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] list_limit = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.690152 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.690239 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] log_config_append = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.690343 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.690444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.690548 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] log_dir = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.690667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.690761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] log_file = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.690927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.691005 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.691170 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.691248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.691412 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.691500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.691656 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.691745 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.691820 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.691894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.691991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.692132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] role.caching = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.692218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.692390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] role.driver = sql {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.692469 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.692628 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.692712 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.692884 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.692976 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.693119 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.693196 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.693349 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.693434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.693595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.693691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.693838 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.693923 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.694094 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.694173 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.694347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.694627 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.86/identity {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.694711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.694810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] publish_errors = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.694889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.695044 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.695124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.695277 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.695355 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.695455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.695586 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.695701 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.695841 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.695928 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.696155 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] standard_threads = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.696298 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.696389 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.696548 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.696664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.696780 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.696859 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.696956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] use_journal = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.697047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.697122 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] use_json = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.697291 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] use_stderr = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.697369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.697467 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] use_syslog = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.697547 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.697695 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:39:06.697772 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.697997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.698737 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.698815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.698936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.699027 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.699102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.699252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.699332 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.699501 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.699580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.699739 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.699820 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.699987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.700073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.700229 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.700308 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.700476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.700562 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.700722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.700801 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.700970 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.701055 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.701205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.701285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.701447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] token.caching = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.701532 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.701681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.701760 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.701930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.702011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.702171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.702248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.702419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.702505 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.702678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.702760 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.702931 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.703011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.703177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.703257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.703414 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.703495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.703671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.703748 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.703917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.704005 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.704163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.704243 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.704406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.704484 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.704637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.704720 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.704868 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.704947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.705100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.705180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.705335 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.705414 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.705583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.705668 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.705833 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.705911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.connection = **** {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.706064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.706151 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.706297 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.706397 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.706568 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.706647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.706816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.706894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.707052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.707145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.707302 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.707381 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.707533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.707612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.707771 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.707857 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.708008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.708087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.708240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.708318 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.708474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.708563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.708707 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.708786 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.708939 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.709022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.709176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.709263 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.709425 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.709519 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.709655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.709733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.709901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.710020 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.710132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.710215 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.710288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 14:39:06.710360 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.710619 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.710870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.711101 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.711339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.711577 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.711813 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.712050 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.712285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.712520 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.712770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.713008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.713247 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.713504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.713765 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.714004 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.714238 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.714498 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.714738 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.715009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.715252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.715504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.715753 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.715991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.716229 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.716466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.716715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.716953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.717191 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.717437 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.717676 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.717914 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.718149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.718398 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.718640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.718902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.719144 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.719388 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.719634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.719880 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.720118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.720356 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.720594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.720828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.721060 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.721294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.721532 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.721764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.722006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.722241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.722512 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.722750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.723009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.723269 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.723513 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.723747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] auth.external = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.723980 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.724277 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.724511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.724741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] auth.password = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.724972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] auth.token = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.725213 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.725449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.725697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.725929 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.726194 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.726462 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.726701 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.726938 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] credential.caching = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.727188 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.727439 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.727689 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.727928 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.728173 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.728408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.728672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.728928 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.729190 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.729453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.729738 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.729987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.730252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.730521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.730783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.731021 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] federation.caching = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.731261 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.731510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.731759 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.731992 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.732239 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.732477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.732735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.732971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.733227 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.733466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.733715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.733954 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] identity.caching = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.734205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.734474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.734716 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.734954 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.735204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.735438 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.735679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.735928 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.736179 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.736413 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.736645 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.736878 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.737123 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.737373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.737623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.737879 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.738137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.738424 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.738668 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.738907 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.739146 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.739383 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.739470 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.739617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.739707 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.739856 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.739944 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.740100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.740341 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.740590 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.740822 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.741070 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.741318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.741555 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.741803 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.742052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.742284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.742555 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.742789 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.743025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.743263 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.743506 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.743744 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.743982 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.744241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.744476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.745221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.745466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.745717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.745966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.746205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.746465 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.746707 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.746943 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.747184 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.747445 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.747679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.747928 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.748178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.748679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.748926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.749052 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.749160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.749396 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.749632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.749872 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.750104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.750352 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.750621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.750869 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.751117 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.751364 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.751596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.751843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.752081 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.752318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.752555 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.752792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.753036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.753286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.753524 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.753782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.754014 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.754260 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.754586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.754829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.755194 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.755447 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.755694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.755929 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.756170 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.756414 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] resource.caching = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.756669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.756920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.757160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.757417 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.757665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.757901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.758150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.758415 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.758658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.758896 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] role.caching = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.759147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] role.driver = sql {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.759380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.759631 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.759882 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.760132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.760925 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.761185 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.761434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.761683 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.761935 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.762172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.762441 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.762692 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.762942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.763190 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.763621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.763859 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.764111 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.764361 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.764610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.764863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.765101 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.765359 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.765612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.765852 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.766085 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.766318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.766572 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.766825 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.767080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.767329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.767568 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.767805 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.768038 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.768282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] token.caching = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.768521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.768770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.769009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.769266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.769515 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.769757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.770004 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.770249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.770526 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.770765 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.771006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.771242 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.771490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.771740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.771972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.772216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.772517 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.772778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.connection = **** {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.773029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.773275 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.773512 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.773755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.773991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.774229 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.774491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.774730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.774974 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.775210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.775455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.775689 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.775969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.776212 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.776460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.776692 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.776933 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.777169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:39:06.777338 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 14:39:06.778702 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.778942 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.801625 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.801852 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.802076 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.810949 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.830769 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.830999 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.831806 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.870464 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.889079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.889312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.916187 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.916419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.953907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.954141 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.954368 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.954618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.954842 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.955063 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.970623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.970855 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.971078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.971297 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.971514 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.971730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.978487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.978729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.978963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.979720 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.979949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.980171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.980391 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.985085 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.985319 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.985544 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.985764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.985982 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.986195 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.986431 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.991376 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:06.994012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:07.004903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:07.005148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:07.005379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:07.005604 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:07.005828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:07.005911 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:07.006048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:07.006132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:07.006268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:07.006351 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:07.006512 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:07.006730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:07.006942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:07.007154 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:39:07.023184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.023306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.023386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 14:39:07.023506 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 14:39:07.023718 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.023840 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.023923 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 14:39:07.024044 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 14:39:07.024179 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.024312 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.024442 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.024570 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.024702 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.024826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.024961 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.025080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.034716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.034809 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.034994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.035079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.035262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.035346 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.035542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.035634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.042970 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.043409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.047931 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.048107 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.048205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.048387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.048471 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.048666 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.048748 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.048945 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.049030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.049225 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.049307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.049486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.049568 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.049753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.049836 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.050015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.050096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.050279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.050366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.050564 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.050645 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.050834 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.073907 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.074453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.075371 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.075651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.075946 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.076227 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.080238 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.080516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.080796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.080878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.081097 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.081378 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.087311 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.087592 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.087972 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.088256 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.091856 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.092143 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.092424 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.092506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.092704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.092787 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.092983 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.093073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.093252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.093334 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.093525 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.093605 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.093787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.093874 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.094060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.094337 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.110087 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.110364 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.110795 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.111087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.114254 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.115016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.117389 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.117677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.118253 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.118572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.122612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.123839 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.125988 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.127028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.129181 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.129482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.129767 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.130050 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.130160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.130326 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.130484 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.130643 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.130776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.131072 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.131374 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.131664 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.146461 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.146741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.147007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.147265 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.147640 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.148004 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.148276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.148539 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.154135 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.155455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.155704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.155978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.157007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.157284 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.158789 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.159067 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.159343 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.159650 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.159926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.160121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.160403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.160694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.160985 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.161279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.171730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.172008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.172285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.172564 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.172842 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.173115 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.173253 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.173400 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.173535 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.173817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.174097 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.174377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.174677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.174965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.188878 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.190598 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.191844 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.193544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.194771 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.196566 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.197171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.199206 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.199495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.199591 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.199773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.201052 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.201342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.201622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.206237 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.207857 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.208085 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.209671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.210787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.211070 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.211349 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.211629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.212679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.212969 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.213272 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.213597 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.219661 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.219946 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.220222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.221621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.221909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.222189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.226993 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.227270 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.227548 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.227824 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.228106 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.228370 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.228638 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.228909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.229631 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:39:07.229830 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.229918 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.230099 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.230183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.230414 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.230515 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.230681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.230764 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.230943 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.231026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.231200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.231283 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.231517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.231901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.232189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.232470 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.232733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.233005 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.233265 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:39:07.267992 dv-cinder-850668-2-smb devstack@keystone.service[92029]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55fb6ca5e9c0 pid: 92029 (default app) Jul 26 14:39:07.274028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f26063-a777-4b76-9ecf-2597c42b0729 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:07.274564 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f26063-a777-4b76-9ecf-2597c42b0729 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:07.275055 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f26063-a777-4b76-9ecf-2597c42b0729 None None] PATH_INFO: `/v3` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:07.281261 dv-cinder-850668-2-smb devstack@keystone.service[92030]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55fb6ca5e9c0 pid: 92030 (default app) Jul 26 14:39:07.281755 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1/1] 10.222.0.86 () {50 vars in 791 bytes} [Tue Jul 26 14:39:07 2022] GET /identity/v3/ => generated 255 bytes in 13 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:15.882524 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bd6f1-838b-435e-9c1e-503224e607fb None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:15.884162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bd6f1-838b-435e-9c1e-503224e607fb None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:15.884162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bd6f1-838b-435e-9c1e-503224e607fb None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:15.888738 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1/2] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:15.894118 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07d406-b765-4a8f-8dcc-8042918cf613 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:15.894546 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07d406-b765-4a8f-8dcc-8042918cf613 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:15.894777 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07d406-b765-4a8f-8dcc-8042918cf613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:15.965539 dv-cinder-850668-2-smb devstack@keystone.service[92029]: INFO dbcounter [None req-3d07d406-b765-4a8f-8dcc-8042918cf613 None None] Registered counter for database keystone Jul 26 14:39:15.987064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG oslo_db.sqlalchemy.engines [None req-3d07d406-b765-4a8f-8dcc-8042918cf613 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:39:15.993169 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writer thread running {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:39:16.172471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG passlib.handlers.bcrypt [None req-3d07d406-b765-4a8f-8dcc-8042918cf613 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92029) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 14:39:16.172883 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG passlib.handlers.bcrypt [None req-3d07d406-b765-4a8f-8dcc-8042918cf613 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92029) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 14:39:16.227412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-3d07d406-b765-4a8f-8dcc-8042918cf613 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:16.228991 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3d07d406-b765-4a8f-8dcc-8042918cf613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:16.351799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 2/3] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 26 14:39:16.466593 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bd6f1-838b-435e-9c1e-503224e607fb None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:16.535185 dv-cinder-850668-2-smb devstack@keystone.service[92030]: INFO dbcounter [None req-296bd6f1-838b-435e-9c1e-503224e607fb None None] Registered counter for database keystone Jul 26 14:39:16.554315 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG oslo_db.sqlalchemy.engines [None req-296bd6f1-838b-435e-9c1e-503224e607fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:39:16.560567 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writer thread running {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:39:16.679763 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bd6f1-838b-435e-9c1e-503224e607fb None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:16.684532 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5242e-7440-4fb4-b552-67c4a310b526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:16.685167 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5242e-7440-4fb4-b552-67c4a310b526 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:16.685446 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5242e-7440-4fb4-b552-67c4a310b526 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:16.685715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5242e-7440-4fb4-b552-67c4a310b526 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:16.693807 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5242e-7440-4fb4-b552-67c4a310b526 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:16.748718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1cd5242e-7440-4fb4-b552-67c4a310b526 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 14:39:16.749065 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5242e-7440-4fb4-b552-67c4a310b526 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:16.759411 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 2/4] 10.222.0.86 () {58 vars in 1324 bytes} [Tue Jul 26 14:39:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 14:39:16.765856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07d406-b765-4a8f-8dcc-8042918cf613 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:16.780857 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07d406-b765-4a8f-8dcc-8042918cf613 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:16.785268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba96cc5-cf44-4001-b872-1ae5d3e2dc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:16.786331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba96cc5-cf44-4001-b872-1ae5d3e2dc31 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:16.786645 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba96cc5-cf44-4001-b872-1ae5d3e2dc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:16.786917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba96cc5-cf44-4001-b872-1ae5d3e2dc31 admin admin] PATH_INFO: `/v3/projects/6185d6162c124385aebcf03e8b422158` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:16.788392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba96cc5-cf44-4001-b872-1ae5d3e2dc31 admin admin] RBAC: Authorizing `identity:get_project(project_id=6185d6162c124385aebcf03e8b422158)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:16.840638 dv-cinder-850668-2-smb devstack@keystone.service[92029]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bba96cc5-cf44-4001-b872-1ae5d3e2dc31 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 14:39:16.840976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba96cc5-cf44-4001-b872-1ae5d3e2dc31 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:16.845540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 3/5] 10.222.0.86 () {56 vars in 1207 bytes} [Tue Jul 26 14:39:16 2022] GET /identity/v3/projects/6185d6162c124385aebcf03e8b422158 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:18.825199 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34fa8-9608-4314-95fe-0a8f59869765 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:18.825733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34fa8-9608-4314-95fe-0a8f59869765 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:18.825733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34fa8-9608-4314-95fe-0a8f59869765 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:18.829879 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 3/6] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:39:18.835382 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f579ab8-9eb5-4e8b-9589-30f25a2e5c11 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:18.835786 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f579ab8-9eb5-4e8b-9589-30f25a2e5c11 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:18.835960 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f579ab8-9eb5-4e8b-9589-30f25a2e5c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:18.856922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-3f579ab8-9eb5-4e8b-9589-30f25a2e5c11 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:18.858495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3f579ab8-9eb5-4e8b-9589-30f25a2e5c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:18.866329 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 4/7] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 26 14:39:18.888032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c34fa8-9608-4314-95fe-0a8f59869765 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:18.901073 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c34fa8-9608-4314-95fe-0a8f59869765 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:18.905248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd701c-92f9-422e-aad9-40064c573b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:18.905863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd701c-92f9-422e-aad9-40064c573b60 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:18.906151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd701c-92f9-422e-aad9-40064c573b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:18.906511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd701c-92f9-422e-aad9-40064c573b60 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:18.914264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd701c-92f9-422e-aad9-40064c573b60 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:18.916082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd701c-92f9-422e-aad9-40064c573b60 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:18.925620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 4/8] 10.222.0.86 () {58 vars in 1324 bytes} [Tue Jul 26 14:39:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 14:39:18.931159 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f579ab8-9eb5-4e8b-9589-30f25a2e5c11 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:18.940242 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f579ab8-9eb5-4e8b-9589-30f25a2e5c11 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:18.944981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1897849-f4cb-4a34-87c4-d7e6474265f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:18.945614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1897849-f4cb-4a34-87c4-d7e6474265f2 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:18.945905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1897849-f4cb-4a34-87c4-d7e6474265f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:18.946190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1897849-f4cb-4a34-87c4-d7e6474265f2 admin admin] PATH_INFO: `/v3/users/2e478bb3d9ce498d853319db6606450c` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:18.947634 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1897849-f4cb-4a34-87c4-d7e6474265f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=2e478bb3d9ce498d853319db6606450c)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:18.949481 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1897849-f4cb-4a34-87c4-d7e6474265f2 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:18.951092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 5/9] 10.222.0.86 () {56 vars in 1198 bytes} [Tue Jul 26 14:39:18 2022] GET /identity/v3/users/2e478bb3d9ce498d853319db6606450c => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:21.015724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56738113-bea6-4788-ad36-3bcead7ae88b None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:21.016256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56738113-bea6-4788-ad36-3bcead7ae88b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:21.016342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56738113-bea6-4788-ad36-3bcead7ae88b None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:21.017612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 5/10] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:21.022904 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349190f-1c92-4a08-9bfd-9d391ed2131b None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:21.023321 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349190f-1c92-4a08-9bfd-9d391ed2131b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:21.023594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349190f-1c92-4a08-9bfd-9d391ed2131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:21.043843 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-0349190f-1c92-4a08-9bfd-9d391ed2131b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:21.045137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0349190f-1c92-4a08-9bfd-9d391ed2131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:21.124110 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 6/11] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:21.124869 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c35e-a650-4f04-8e45-548ac31d1691 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:21.125159 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c35e-a650-4f04-8e45-548ac31d1691 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:21.125434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c35e-a650-4f04-8e45-548ac31d1691 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:21.126785 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 6/12] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:21.131648 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e901f-3e95-41e0-9679-d519e904968f None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:21.131952 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e901f-3e95-41e0-9679-d519e904968f None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:21.132237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e901f-3e95-41e0-9679-d519e904968f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:21.146537 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876c35e-a650-4f04-8e45-548ac31d1691 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:21.149746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-727e901f-3e95-41e0-9679-d519e904968f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:21.151489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-727e901f-3e95-41e0-9679-d519e904968f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:21.168631 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:21.220750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 7/13] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:39:21.242539 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e901f-3e95-41e0-9679-d519e904968f None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:21.294143 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876c35e-a650-4f04-8e45-548ac31d1691 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:21.327633 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467a93a-a200-4b71-8f12-3f8af0f01a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:21.328492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467a93a-a200-4b71-8f12-3f8af0f01a1e None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:21.328777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467a93a-a200-4b71-8f12-3f8af0f01a1e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:21.329052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467a93a-a200-4b71-8f12-3f8af0f01a1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:21.341362 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467a93a-a200-4b71-8f12-3f8af0f01a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:21.343513 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e901f-3e95-41e0-9679-d519e904968f None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:21.350102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-2467a93a-a200-4b71-8f12-3f8af0f01a1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:21.350102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:21.350102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:21.350102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:21.350102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:21.350102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:21.350102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:21.350102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:21.350102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:21.350102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:21.350102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:21.350102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:21.350102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:21.350102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:21.350102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:21.350102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:21.351149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:21.351149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:21.351149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:21.351149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:21.351149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:21.351149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:21.351149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:21.351149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:21.351149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:21.351149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:21.351149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:21.351149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:21.351149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:21.351149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:21.351149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:21.351149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:21.351997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:21.351997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:21.351997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:21.351997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:21.351997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:21.351997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:21.351997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:21.351997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:21.351997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:21.351997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:21.351997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:21.351997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:39:21.351997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 7/14] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:21.357624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467a93a-a200-4b71-8f12-3f8af0f01a1e None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:21.379281 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9031d4-18f5-466c-8409-2fc9873da6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:21.379912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9031d4-18f5-466c-8409-2fc9873da6c7 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:21.380201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9031d4-18f5-466c-8409-2fc9873da6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:21.380478 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9031d4-18f5-466c-8409-2fc9873da6c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:21.391944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:21.401264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:21.450951 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9031d4-18f5-466c-8409-2fc9873da6c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:21.452492 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9031d4-18f5-466c-8409-2fc9873da6c7 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:21.461068 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467a93a-a200-4b71-8f12-3f8af0f01a1e None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:21.493968 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4841b-05d5-4093-8ec0-b42bd1cfe812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:21.494661 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4841b-05d5-4093-8ec0-b42bd1cfe812 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:21.494941 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4841b-05d5-4093-8ec0-b42bd1cfe812 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:21.495217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4841b-05d5-4093-8ec0-b42bd1cfe812 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:21.495944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4841b-05d5-4093-8ec0-b42bd1cfe812 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:21.496251 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4841b-05d5-4093-8ec0-b42bd1cfe812 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:21.497639 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4841b-05d5-4093-8ec0-b42bd1cfe812 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:21.510414 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 8/15] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:21.518363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4841b-05d5-4093-8ec0-b42bd1cfe812 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:21.552821 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 8/16] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:39:21.558190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9031d4-18f5-466c-8409-2fc9873da6c7 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:21.609155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:21.612002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:21.618687 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4841b-05d5-4093-8ec0-b42bd1cfe812 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:21.654042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c442f10-387f-4df8-b3bf-6ff45f934d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:21.654730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c442f10-387f-4df8-b3bf-6ff45f934d3d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:21.655014 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c442f10-387f-4df8-b3bf-6ff45f934d3d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:21.655304 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c442f10-387f-4df8-b3bf-6ff45f934d3d None admin] PATH_INFO: `/v3/users/2e478bb3d9ce498d853319db6606450c` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:21.656897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c442f10-387f-4df8-b3bf-6ff45f934d3d None admin] RBAC: Authorizing `identity:get_user(user_id=2e478bb3d9ce498d853319db6606450c)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:21.657904 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9031d4-18f5-466c-8409-2fc9873da6c7 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:21.658364 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c442f10-387f-4df8-b3bf-6ff45f934d3d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:21.660023 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 9/17] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:21 2022] GET /identity/v3/users/2e478bb3d9ce498d853319db6606450c => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:21.665592 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c442f10-387f-4df8-b3bf-6ff45f934d3d None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:21.694511 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ad3e3-5bb1-4df3-b2d1-2ad66b0f7b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:21.695164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ad3e3-5bb1-4df3-b2d1-2ad66b0f7b8b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:21.695458 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ad3e3-5bb1-4df3-b2d1-2ad66b0f7b8b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:21.695738 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ad3e3-5bb1-4df3-b2d1-2ad66b0f7b8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:21.774200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c442f10-387f-4df8-b3bf-6ff45f934d3d None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:21.809433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd848e97-5c8f-444f-86af-6a269b3b58bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:21.810011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd848e97-5c8f-444f-86af-6a269b3b58bf None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:21.810293 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd848e97-5c8f-444f-86af-6a269b3b58bf None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:21.810604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd848e97-5c8f-444f-86af-6a269b3b58bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:21.811260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ad3e3-5bb1-4df3-b2d1-2ad66b0f7b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:21.811874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd848e97-5c8f-444f-86af-6a269b3b58bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:21.812721 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ad3e3-5bb1-4df3-b2d1-2ad66b0f7b8b None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:21.813311 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd848e97-5c8f-444f-86af-6a269b3b58bf None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:21.814935 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 10/18] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:21.820535 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd848e97-5c8f-444f-86af-6a269b3b58bf None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:21.831190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-0d5ad3e3-5bb1-4df3-b2d1-2ad66b0f7b8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:21.831190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:21.831190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:21.831190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:21.831190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:21.831190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:21.831190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:21.831190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:21.831190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:21.831190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:21.831190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:21.831190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:21.831190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:21.831190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:21.831190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:21.832195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:21.832195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:21.832195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:21.832195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:21.832195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:21.832195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:21.832195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:21.832195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:21.832195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:21.832195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:21.832195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:21.832195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:21.832195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:21.832195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:21.832195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:21.832195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:21.832195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:21.833119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:21.833119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:21.833119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:21.833119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:39:21.833119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 9/19] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:21.839043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ad3e3-5bb1-4df3-b2d1-2ad66b0f7b8b None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:21.852561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:21.921334 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd848e97-5c8f-444f-86af-6a269b3b58bf None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:21.939652 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ad3e3-5bb1-4df3-b2d1-2ad66b0f7b8b None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:21.942069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:21.955589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbded4-5cd0-46ba-8c85-31486fe75ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:21.956213 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbded4-5cd0-46ba-8c85-31486fe75ab1 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:21.956504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbded4-5cd0-46ba-8c85-31486fe75ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:21.956781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbded4-5cd0-46ba-8c85-31486fe75ab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:21.957571 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbded4-5cd0-46ba-8c85-31486fe75ab1 None admin] RBAC: Adding query filter params (role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.domain.id=default, user.id=2e478bb3d9ce498d853319db6606450c) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:21.957882 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbded4-5cd0-46ba-8c85-31486fe75ab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:21.959346 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbded4-5cd0-46ba-8c85-31486fe75ab1 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:21.967454 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 11/20] 10.222.0.86 () {56 vars in 1322 bytes} [Tue Jul 26 14:39:21 2022] GET /identity/v3/role_assignments?user.id=2e478bb3d9ce498d853319db6606450c&scope.domain.id=default&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:21.974685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e7e7c-d6e9-4ef5-a57d-8d5022484b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:21.975330 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e7e7c-d6e9-4ef5-a57d-8d5022484b68 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:21.975617 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e7e7c-d6e9-4ef5-a57d-8d5022484b68 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:21.975900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e7e7c-d6e9-4ef5-a57d-8d5022484b68 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:21.976619 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e7e7c-d6e9-4ef5-a57d-8d5022484b68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:21.976930 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e7e7c-d6e9-4ef5-a57d-8d5022484b68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:21.978378 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e7e7c-d6e9-4ef5-a57d-8d5022484b68 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:21.999688 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 10/21] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:24.420946 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed350db4-3b3a-42c0-87bb-36fb2010d984 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:24.421958 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed350db4-3b3a-42c0-87bb-36fb2010d984 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:24.422511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed350db4-3b3a-42c0-87bb-36fb2010d984 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:24.424152 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 12/22] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:24.429712 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c4b9f-01ca-45a6-90bd-ecf90cac3587 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:24.430579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c4b9f-01ca-45a6-90bd-ecf90cac3587 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:24.431079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c4b9f-01ca-45a6-90bd-ecf90cac3587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:24.455691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-391c4b9f-01ca-45a6-90bd-ecf90cac3587 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:24.457243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-391c4b9f-01ca-45a6-90bd-ecf90cac3587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:24.505422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f853-83c4-4db5-be4e-3f1249f894b5 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:24.506030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f853-83c4-4db5-be4e-3f1249f894b5 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:24.506559 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f853-83c4-4db5-be4e-3f1249f894b5 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:24.508106 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 13/23] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:24.513743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce85731-4709-4fcd-ba4b-23ca7712cf6d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:24.514034 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce85731-4709-4fcd-ba4b-23ca7712cf6d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:24.514318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce85731-4709-4fcd-ba4b-23ca7712cf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:24.546694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG passlib.handlers.bcrypt [None req-8ce85731-4709-4fcd-ba4b-23ca7712cf6d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92030) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 14:39:24.547119 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG passlib.handlers.bcrypt [None req-8ce85731-4709-4fcd-ba4b-23ca7712cf6d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92030) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 14:39:24.592687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 11/24] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:24.630666 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-8ce85731-4709-4fcd-ba4b-23ca7712cf6d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:24.631483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c4b9f-01ca-45a6-90bd-ecf90cac3587 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:24.632875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8ce85731-4709-4fcd-ba4b-23ca7712cf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:24.754883 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 14/25] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:39:24.790857 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce85731-4709-4fcd-ba4b-23ca7712cf6d None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:24.851463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:24.865854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:24.876162 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c4b9f-01ca-45a6-90bd-ecf90cac3587 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:24.922444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72c27a-a852-4124-92c3-08d8ee3f433f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:24.923326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72c27a-a852-4124-92c3-08d8ee3f433f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:24.923950 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72c27a-a852-4124-92c3-08d8ee3f433f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:24.924323 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72c27a-a852-4124-92c3-08d8ee3f433f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:24.930789 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce85731-4709-4fcd-ba4b-23ca7712cf6d None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:24.938380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72c27a-a852-4124-92c3-08d8ee3f433f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:24.940530 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72c27a-a852-4124-92c3-08d8ee3f433f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:24.962899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-df72c27a-a852-4124-92c3-08d8ee3f433f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:24.962899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:24.962899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:24.962899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:24.962899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:24.962899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:24.962899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:24.962899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:24.962899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:24.962899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:24.962899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:24.962899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:24.962899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:24.962899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:24.962899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:24.963811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:24.963811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:24.963811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:24.963811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:24.963811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:24.963811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:24.963811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:24.963811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:24.963811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:24.963811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:24.963811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:24.963811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:24.963811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:24.963811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:24.963811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:24.963811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:24.963811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:24.964571 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:24.964571 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:24.964571 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:24.964571 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:39:24.966038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 12/26] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:24.967739 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa42f3c-7816-4f6d-8b26-89c944a5dc0b None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:24.968021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa42f3c-7816-4f6d-8b26-89c944a5dc0b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:24.968297 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa42f3c-7816-4f6d-8b26-89c944a5dc0b None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:24.969038 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a404687-2d3d-4dcf-8d94-06af0c0e4aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:24.969937 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 13/27] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:24.971074 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693839e-d00a-4795-a0fa-c42b6fd0af0a None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:24.971433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693839e-d00a-4795-a0fa-c42b6fd0af0a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:24.971763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693839e-d00a-4795-a0fa-c42b6fd0af0a None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:24.973163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 14/28] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:24.973928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693839e-d00a-4795-a0fa-c42b6fd0af0a None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:24.974504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a404687-2d3d-4dcf-8d94-06af0c0e4aa8 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:24.974912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a404687-2d3d-4dcf-8d94-06af0c0e4aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:24.975299 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a404687-2d3d-4dcf-8d94-06af0c0e4aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:24.976423 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a404687-2d3d-4dcf-8d94-06af0c0e4aa8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:24.978307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a404687-2d3d-4dcf-8d94-06af0c0e4aa8 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:25.102967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693839e-d00a-4795-a0fa-c42b6fd0af0a None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:25.144824 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e2f4d-8181-4792-b37a-e69011c0aad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:25.145497 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e2f4d-8181-4792-b37a-e69011c0aad3 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:25.145824 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e2f4d-8181-4792-b37a-e69011c0aad3 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:25.146107 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e2f4d-8181-4792-b37a-e69011c0aad3 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:25.146868 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e2f4d-8181-4792-b37a-e69011c0aad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:25.147352 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e2f4d-8181-4792-b37a-e69011c0aad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:25.148848 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e2f4d-8181-4792-b37a-e69011c0aad3 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:25.164665 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 15/29] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:25.166744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743e569-9ddb-4f8c-92d7-a10d9d3675d2 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:25.167037 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743e569-9ddb-4f8c-92d7-a10d9d3675d2 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:25.167314 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743e569-9ddb-4f8c-92d7-a10d9d3675d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:25.181826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:25.188685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-1743e569-9ddb-4f8c-92d7-a10d9d3675d2 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:25.190120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-1743e569-9ddb-4f8c-92d7-a10d9d3675d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:25.265970 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 16/30] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:25.267317 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ba4b7-beab-4252-b549-95224ca919cc None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:25.267607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ba4b7-beab-4252-b549-95224ca919cc None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:25.267886 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ba4b7-beab-4252-b549-95224ca919cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:25.286554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-aa5ba4b7-beab-4252-b549-95224ca919cc None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:25.288066 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-aa5ba4b7-beab-4252-b549-95224ca919cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:25.332809 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 15/31] 10.222.0.86 () {60 vars in 1131 bytes} [Tue Jul 26 14:39:24 2022] POST /identity/v3/roles => generated 219 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:39:25.333792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a404687-2d3d-4dcf-8d94-06af0c0e4aa8 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:25.364195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 17/32] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:25.365142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ba4b7-beab-4252-b549-95224ca919cc None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:25.433963 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:25.450816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a404687-2d3d-4dcf-8d94-06af0c0e4aa8 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:25.467229 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:25.496229 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbedac-8613-44ef-a6cc-5e7c9cf6c12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:25.497024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbedac-8613-44ef-a6cc-5e7c9cf6c12f None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:25.497393 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbedac-8613-44ef-a6cc-5e7c9cf6c12f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:25.497750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbedac-8613-44ef-a6cc-5e7c9cf6c12f None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:25.499123 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbedac-8613-44ef-a6cc-5e7c9cf6c12f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:25.500738 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbedac-8613-44ef-a6cc-5e7c9cf6c12f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:25.507727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ba4b7-beab-4252-b549-95224ca919cc None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:25.546149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eec766-9a6a-43b2-85ea-ad8e66906869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:25.547148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eec766-9a6a-43b2-85ea-ad8e66906869 None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:25.547453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eec766-9a6a-43b2-85ea-ad8e66906869 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:25.547698 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eec766-9a6a-43b2-85ea-ad8e66906869 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:25.548413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eec766-9a6a-43b2-85ea-ad8e66906869 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:25.549780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eec766-9a6a-43b2-85ea-ad8e66906869 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:25.643332 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 16/33] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jul 26 14:39:25 2022] POST /identity/v3/projects => generated 301 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:25.644637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbedac-8613-44ef-a6cc-5e7c9cf6c12f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:25.823769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 18/34] 10.222.0.86 () {60 vars in 1131 bytes} [Tue Jul 26 14:39:25 2022] POST /identity/v3/roles => generated 225 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:25.823966 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fd4b5-44f9-4127-9760-8dcd3c00ef4f None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:25.824234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fd4b5-44f9-4127-9760-8dcd3c00ef4f None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:25.824525 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fd4b5-44f9-4127-9760-8dcd3c00ef4f None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:25.825905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 19/35] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:25.832716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586b96f-b493-46ec-ba96-3feab7a3626d None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:25.833072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbedac-8613-44ef-a6cc-5e7c9cf6c12f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:25.833233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586b96f-b493-46ec-ba96-3feab7a3626d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:25.833620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586b96f-b493-46ec-ba96-3feab7a3626d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:25.860404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-4586b96f-b493-46ec-ba96-3feab7a3626d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:25.863055 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4586b96f-b493-46ec-ba96-3feab7a3626d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:25.874666 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7712c8b-8bc2-4866-b9ca-e538fadc2332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:25.887058 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7712c8b-8bc2-4866-b9ca-e538fadc2332 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:25.887058 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7712c8b-8bc2-4866-b9ca-e538fadc2332 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:25.887058 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7712c8b-8bc2-4866-b9ca-e538fadc2332 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:25.887389 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:25.892563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7712c8b-8bc2-4866-b9ca-e538fadc2332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:25.899440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-c7712c8b-8bc2-4866-b9ca-e538fadc2332 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:25.899440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:25.899440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:25.899440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:25.899440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:25.899440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:25.899440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:25.899440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:25.899440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:25.899440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:25.899440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:25.899440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:25.899440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:25.899440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:25.899440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:25.899440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:25.900358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:25.900358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:25.900358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:25.900358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:25.900358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:25.900358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:25.900358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:25.900358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:25.900358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:25.900358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:25.900358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:25.900358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:25.900358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:25.900358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:25.900358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:25.900358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:25.901166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:25.901166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:25.901166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:25.901166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:25.901166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:25.901166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:25.901166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:25.901166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:25.901166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:25.901166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:25.901166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:25.901166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:39:25.903338 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 17/36] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:25.911630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7712c8b-8bc2-4866-b9ca-e538fadc2332 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:25.978951 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 20/37] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:26.001145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586b96f-b493-46ec-ba96-3feab7a3626d None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:26.063216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7712c8b-8bc2-4866-b9ca-e538fadc2332 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:26.074977 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:26.102510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11f69b-2927-416d-b21f-7a515fb41e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:26.103145 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11f69b-2927-416d-b21f-7a515fb41e81 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:26.103448 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11f69b-2927-416d-b21f-7a515fb41e81 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:26.103738 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11f69b-2927-416d-b21f-7a515fb41e81 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:26.104477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11f69b-2927-416d-b21f-7a515fb41e81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:26.104787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11f69b-2927-416d-b21f-7a515fb41e81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:26.106196 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11f69b-2927-416d-b21f-7a515fb41e81 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:26.114680 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 18/38] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:26.116109 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d33397-1caa-4bc5-91ef-237c85d19cdf None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:26.116410 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d33397-1caa-4bc5-91ef-237c85d19cdf None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:26.116691 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d33397-1caa-4bc5-91ef-237c85d19cdf None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:26.117930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 19/39] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:26.120855 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d33397-1caa-4bc5-91ef-237c85d19cdf None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:26.127449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586b96f-b493-46ec-ba96-3feab7a3626d None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:26.162368 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e50296-2102-42a8-a40a-69a3f4b24eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:26.163043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e50296-2102-42a8-a40a-69a3f4b24eff None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:26.163333 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e50296-2102-42a8-a40a-69a3f4b24eff None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:26.163618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e50296-2102-42a8-a40a-69a3f4b24eff None admin] PATH_INFO: `/v3/domains/default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:26.164778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e50296-2102-42a8-a40a-69a3f4b24eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:26.167092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e50296-2102-42a8-a40a-69a3f4b24eff None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:26.168855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 21/40] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:26.169781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288c9d8-502c-4cfc-bcbb-62a85bdcea12 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:26.170068 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288c9d8-502c-4cfc-bcbb-62a85bdcea12 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:26.170352 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288c9d8-502c-4cfc-bcbb-62a85bdcea12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:26.181716 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:26.187542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-f288c9d8-502c-4cfc-bcbb-62a85bdcea12 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:26.188736 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-f288c9d8-502c-4cfc-bcbb-62a85bdcea12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:26.224769 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d33397-1caa-4bc5-91ef-237c85d19cdf None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:26.254326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 22/41] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:26.255169 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288c9d8-502c-4cfc-bcbb-62a85bdcea12 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:26.269934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44b1bf-6e4b-41b1-8b86-a4c907f5dc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:26.270636 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44b1bf-6e4b-41b1-8b86-a4c907f5dc97 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:26.270926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44b1bf-6e4b-41b1-8b86-a4c907f5dc97 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:26.271206 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44b1bf-6e4b-41b1-8b86-a4c907f5dc97 None admin] PATH_INFO: `/v3/users/2e478bb3d9ce498d853319db6606450c` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:26.273279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44b1bf-6e4b-41b1-8b86-a4c907f5dc97 None admin] RBAC: Authorizing `identity:get_user(user_id=2e478bb3d9ce498d853319db6606450c)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:26.274931 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44b1bf-6e4b-41b1-8b86-a4c907f5dc97 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:26.276831 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 20/42] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:26 2022] GET /identity/v3/users/2e478bb3d9ce498d853319db6606450c => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:26.277585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44b1bf-6e4b-41b1-8b86-a4c907f5dc97 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:26.315560 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:26.359749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288c9d8-502c-4cfc-bcbb-62a85bdcea12 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:26.375528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44b1bf-6e4b-41b1-8b86-a4c907f5dc97 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:26.396574 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef86fb6-0a9b-4c90-b402-addbe5e6d23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:26.397205 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef86fb6-0a9b-4c90-b402-addbe5e6d23c None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:26.397483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef86fb6-0a9b-4c90-b402-addbe5e6d23c None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:26.397766 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef86fb6-0a9b-4c90-b402-addbe5e6d23c None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:26.398473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef86fb6-0a9b-4c90-b402-addbe5e6d23c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:26.400013 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef86fb6-0a9b-4c90-b402-addbe5e6d23c None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:26.403521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:26.411284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0595b-74cf-410e-96cc-60a7500f2328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:26.411920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0595b-74cf-410e-96cc-60a7500f2328 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:26.412213 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0595b-74cf-410e-96cc-60a7500f2328 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:26.412490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0595b-74cf-410e-96cc-60a7500f2328 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:26.414190 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0595b-74cf-410e-96cc-60a7500f2328 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:26.414971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0595b-74cf-410e-96cc-60a7500f2328 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:26.491449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 23/43] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jul 26 14:39:26 2022] POST /identity/v3/projects => generated 312 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:26.492283 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef86fb6-0a9b-4c90-b402-addbe5e6d23c None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:26.508463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 21/44] 10.222.0.86 () {60 vars in 1131 bytes} [Tue Jul 26 14:39:26 2022] POST /identity/v3/roles => generated 223 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:26.615517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef86fb6-0a9b-4c90-b402-addbe5e6d23c None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:26.624599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:26.658452 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b904a-7b99-4ac6-9934-21744b1db806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:26.659365 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b904a-7b99-4ac6-9934-21744b1db806 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:26.659787 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b904a-7b99-4ac6-9934-21744b1db806 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:26.660248 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b904a-7b99-4ac6-9934-21744b1db806 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:26.661591 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b904a-7b99-4ac6-9934-21744b1db806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:26.663173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b904a-7b99-4ac6-9934-21744b1db806 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:26.665188 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 24/45] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:26.672877 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0595b-74cf-410e-96cc-60a7500f2328 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:26.780066 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0595b-74cf-410e-96cc-60a7500f2328 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:26.812746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b91a8d-071b-4c99-9954-bd35fb70d55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:26.813417 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b91a8d-071b-4c99-9954-bd35fb70d55d None admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:26.813703 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b91a8d-071b-4c99-9954-bd35fb70d55d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:26.813985 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b91a8d-071b-4c99-9954-bd35fb70d55d None admin] PATH_INFO: `/v3/domains/default/users/2e478bb3d9ce498d853319db6606450c/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:26.815985 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b91a8d-071b-4c99-9954-bd35fb70d55d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2e478bb3d9ce498d853319db6606450c, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:26.817427 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b91a8d-071b-4c99-9954-bd35fb70d55d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:26.899073 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 22/46] 10.222.0.86 () {58 vars in 1361 bytes} [Tue Jul 26 14:39:26 2022] PUT /identity/v3/domains/default/users/2e478bb3d9ce498d853319db6606450c/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:39:28.535602 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c542c-7e58-4898-a289-3c58c3f50a91 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:28.536153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c542c-7e58-4898-a289-3c58c3f50a91 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:28.536153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c542c-7e58-4898-a289-3c58c3f50a91 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:28.537509 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 25/47] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:28.542805 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066b1fa-5871-485d-bffc-2e52d6c530fa None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:28.543187 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066b1fa-5871-485d-bffc-2e52d6c530fa None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:28.543367 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066b1fa-5871-485d-bffc-2e52d6c530fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:28.561912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-2066b1fa-5871-485d-bffc-2e52d6c530fa None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:28.563445 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2066b1fa-5871-485d-bffc-2e52d6c530fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:28.606973 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:28.630032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 23/48] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:28.652785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c542c-7e58-4898-a289-3c58c3f50a91 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:28.758052 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c542c-7e58-4898-a289-3c58c3f50a91 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:28.792222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca14704-1e78-4b3a-8ed2-fd7780cdf90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:28.792795 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca14704-1e78-4b3a-8ed2-fd7780cdf90e None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:28.793080 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca14704-1e78-4b3a-8ed2-fd7780cdf90e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:28.793362 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca14704-1e78-4b3a-8ed2-fd7780cdf90e None admin] PATH_INFO: `/v3/domains/default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:28.794547 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca14704-1e78-4b3a-8ed2-fd7780cdf90e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:28.795991 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca14704-1e78-4b3a-8ed2-fd7780cdf90e None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:28.797593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 26/49] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:28.803190 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066b1fa-5871-485d-bffc-2e52d6c530fa None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:28.898780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c707edb-1510-4f4c-97c8-a6e7e482f3c0 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:28.899184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c707edb-1510-4f4c-97c8-a6e7e482f3c0 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:28.899537 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c707edb-1510-4f4c-97c8-a6e7e482f3c0 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:28.900496 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066b1fa-5871-485d-bffc-2e52d6c530fa None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:28.901096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 27/50] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:39:28.906190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162f276-4d24-4bff-9e70-3fc790a8fc3c None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:28.906510 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162f276-4d24-4bff-9e70-3fc790a8fc3c None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:28.906787 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162f276-4d24-4bff-9e70-3fc790a8fc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:28.925242 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-4162f276-4d24-4bff-9e70-3fc790a8fc3c None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:28.926496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4162f276-4d24-4bff-9e70-3fc790a8fc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:28.935212 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ac6a5-0774-43df-a2c4-40369d69e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:28.935836 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ac6a5-0774-43df-a2c4-40369d69e349 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:28.936117 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ac6a5-0774-43df-a2c4-40369d69e349 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:28.936391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ac6a5-0774-43df-a2c4-40369d69e349 None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:28.937082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ac6a5-0774-43df-a2c4-40369d69e349 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:28.938556 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ac6a5-0774-43df-a2c4-40369d69e349 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:28.966163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:28.997142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 28/51] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:39:29.019715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162f276-4d24-4bff-9e70-3fc790a8fc3c None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:29.042888 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 24/52] 10.222.0.86 () {60 vars in 1140 bytes} [Tue Jul 26 14:39:28 2022] POST /identity/v3/projects => generated 298 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:29.124075 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162f276-4d24-4bff-9e70-3fc790a8fc3c None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:29.159820 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650daa6-a18c-4bb1-92c2-ef4599ce41a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:29.160488 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650daa6-a18c-4bb1-92c2-ef4599ce41a6 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:29.160788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650daa6-a18c-4bb1-92c2-ef4599ce41a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:29.161060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650daa6-a18c-4bb1-92c2-ef4599ce41a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:29.173683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650daa6-a18c-4bb1-92c2-ef4599ce41a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:29.180495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-f650daa6-a18c-4bb1-92c2-ef4599ce41a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:29.180495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:29.180495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:29.180495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:29.180495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:29.180495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:29.180495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:29.180495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:29.180495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:29.180495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:29.180495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:29.180495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:29.180495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:29.180495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:29.180495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:29.180495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:29.181936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:29.181936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:29.181936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:29.181936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:29.181936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:29.181936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:29.181936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:29.181936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:29.181936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:29.181936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:29.181936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:29.181936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:29.181936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:29.181936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:29.181936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:29.181936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:29.182754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:29.182754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:29.182754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:29.182754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:29.182754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:29.182754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:29.182754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:29.182754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:29.182754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:29.182754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:29.182754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:29.182754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:39:29.182754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 29/53] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:29.188887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ac6a5-0774-43df-a2c4-40369d69e349 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:29.220333 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:29.293426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ac6a5-0774-43df-a2c4-40369d69e349 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:29.327376 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640e757-fee1-4f8e-a73b-cf02ff641565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:29.328000 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640e757-fee1-4f8e-a73b-cf02ff641565 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:29.328282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640e757-fee1-4f8e-a73b-cf02ff641565 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:29.328554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640e757-fee1-4f8e-a73b-cf02ff641565 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:29.329270 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640e757-fee1-4f8e-a73b-cf02ff641565 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:29.329578 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640e757-fee1-4f8e-a73b-cf02ff641565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:29.330992 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640e757-fee1-4f8e-a73b-cf02ff641565 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:29.339478 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 25/54] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:29.345124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650daa6-a18c-4bb1-92c2-ef4599ce41a6 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:29.377321 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:29.465582 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650daa6-a18c-4bb1-92c2-ef4599ce41a6 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:29.502056 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914b7c7-a6d0-4b24-b5f0-7be34e732414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:29.502752 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914b7c7-a6d0-4b24-b5f0-7be34e732414 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:29.503046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914b7c7-a6d0-4b24-b5f0-7be34e732414 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:29.503336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914b7c7-a6d0-4b24-b5f0-7be34e732414 None admin] PATH_INFO: `/v3/users/2e478bb3d9ce498d853319db6606450c` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:29.504538 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914b7c7-a6d0-4b24-b5f0-7be34e732414 None admin] RBAC: Authorizing `identity:get_user(user_id=2e478bb3d9ce498d853319db6606450c)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:29.506030 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914b7c7-a6d0-4b24-b5f0-7be34e732414 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:29.507925 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 30/55] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:29 2022] GET /identity/v3/users/2e478bb3d9ce498d853319db6606450c => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:29.513959 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640e757-fee1-4f8e-a73b-cf02ff641565 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:29.609169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:29.618207 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640e757-fee1-4f8e-a73b-cf02ff641565 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:29.653929 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c798d37-0115-48a7-8ef9-5d16838a4ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:29.654620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c798d37-0115-48a7-8ef9-5d16838a4ba6 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:29.654914 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c798d37-0115-48a7-8ef9-5d16838a4ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:29.655199 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c798d37-0115-48a7-8ef9-5d16838a4ba6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:29.656371 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c798d37-0115-48a7-8ef9-5d16838a4ba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:29.658123 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c798d37-0115-48a7-8ef9-5d16838a4ba6 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:29.659981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 26/56] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:29.665742 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914b7c7-a6d0-4b24-b5f0-7be34e732414 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:29.766565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:29.769699 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914b7c7-a6d0-4b24-b5f0-7be34e732414 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:29.805182 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf76119-cc3e-42cd-851b-96a127fc8820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:29.805817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf76119-cc3e-42cd-851b-96a127fc8820 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:29.806102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf76119-cc3e-42cd-851b-96a127fc8820 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:29.806379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf76119-cc3e-42cd-851b-96a127fc8820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:29.808406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf76119-cc3e-42cd-851b-96a127fc8820 None admin] RBAC: Adding query filter params (role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.domain.id=default, user.id=2e478bb3d9ce498d853319db6606450c) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:29.809655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf76119-cc3e-42cd-851b-96a127fc8820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:29.810134 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf76119-cc3e-42cd-851b-96a127fc8820 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:29.817731 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 31/57] 10.222.0.86 () {56 vars in 1322 bytes} [Tue Jul 26 14:39:29 2022] GET /identity/v3/role_assignments?user.id=2e478bb3d9ce498d853319db6606450c&scope.domain.id=default&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:31.073193 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654426c7-041c-47b4-aabf-48ad2ad463fe None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:31.073702 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654426c7-041c-47b4-aabf-48ad2ad463fe None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:31.073788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654426c7-041c-47b4-aabf-48ad2ad463fe None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:31.075172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 27/58] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:31.080319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfd34c-ef78-4ebb-8c66-1d2c9541f62e None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:31.080726 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfd34c-ef78-4ebb-8c66-1d2c9541f62e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:31.080895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfd34c-ef78-4ebb-8c66-1d2c9541f62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:31.099234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-3ecfd34c-ef78-4ebb-8c66-1d2c9541f62e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:31.100435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3ecfd34c-ef78-4ebb-8c66-1d2c9541f62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:31.167138 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 32/59] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:31.190340 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654426c7-041c-47b4-aabf-48ad2ad463fe None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:31.289648 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654426c7-041c-47b4-aabf-48ad2ad463fe None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:31.321879 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8413d80-594a-4331-9323-f4fc9fc53ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:31.323054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8413d80-594a-4331-9323-f4fc9fc53ffa None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:31.323383 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8413d80-594a-4331-9323-f4fc9fc53ffa None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:31.323615 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8413d80-594a-4331-9323-f4fc9fc53ffa None admin] PATH_INFO: `/v3/domains/default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:31.324774 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8413d80-594a-4331-9323-f4fc9fc53ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:31.326228 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8413d80-594a-4331-9323-f4fc9fc53ffa None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:31.327845 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 28/60] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:31.333275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfd34c-ef78-4ebb-8c66-1d2c9541f62e None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:31.422539 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:31.428922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfd34c-ef78-4ebb-8c66-1d2c9541f62e None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:31.462101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e8b93-d8d6-4a07-8e5d-5d46347281e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:31.462773 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e8b93-d8d6-4a07-8e5d-5d46347281e9 None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:31.463061 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e8b93-d8d6-4a07-8e5d-5d46347281e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:31.463342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e8b93-d8d6-4a07-8e5d-5d46347281e9 None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:31.464018 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e8b93-d8d6-4a07-8e5d-5d46347281e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:31.465475 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e8b93-d8d6-4a07-8e5d-5d46347281e9 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:31.559008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 33/61] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jul 26 14:39:31 2022] POST /identity/v3/users => generated 275 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:34.516881 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ccb78-867d-4bd1-8613-39c4779f313b None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:34.517429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ccb78-867d-4bd1-8613-39c4779f313b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:34.517429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ccb78-867d-4bd1-8613-39c4779f313b None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:34.518846 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 29/62] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:34.524592 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56835d-75bd-4f1e-8b8d-73dbadb26370 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:34.525426 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56835d-75bd-4f1e-8b8d-73dbadb26370 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:34.526000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56835d-75bd-4f1e-8b8d-73dbadb26370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:34.559581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-0a56835d-75bd-4f1e-8b8d-73dbadb26370 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:34.561047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0a56835d-75bd-4f1e-8b8d-73dbadb26370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:34.658474 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 34/63] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:34.692796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ccb78-867d-4bd1-8613-39c4779f313b None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:34.737034 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:34.828160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9df73a-17ee-452e-881c-23d062b79123 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:34.828476 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9df73a-17ee-452e-881c-23d062b79123 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:34.828686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9df73a-17ee-452e-881c-23d062b79123 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:34.831788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 35/64] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:34.835410 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb67ba-1332-4231-9c39-1b2f30c59f72 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:34.835931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb67ba-1332-4231-9c39-1b2f30c59f72 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:34.836276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb67ba-1332-4231-9c39-1b2f30c59f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:34.845234 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ccb78-867d-4bd1-8613-39c4779f313b None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:34.879399 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-4dcb67ba-1332-4231-9c39-1b2f30c59f72 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:34.880945 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4dcb67ba-1332-4231-9c39-1b2f30c59f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:34.883142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a35474-df91-451b-8a32-d7af6e405dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:34.884145 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a35474-df91-451b-8a32-d7af6e405dc6 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:34.885108 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a35474-df91-451b-8a32-d7af6e405dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:34.885516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a35474-df91-451b-8a32-d7af6e405dc6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:34.898336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a35474-df91-451b-8a32-d7af6e405dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:34.905080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-c1a35474-df91-451b-8a32-d7af6e405dc6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:39:34.905080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:34.905080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:34.905080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:34.905080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:34.905080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:34.905080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:34.905080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:34.905080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:34.905080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:34.905080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:34.905080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:34.905080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:34.905080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:34.905080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:34.905080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:34.905904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:34.905904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:34.905904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:34.905904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:34.905904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:34.905904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:34.905904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:34.905904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:34.905904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:34.905904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:34.905904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:34.905904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:34.905904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:34.905904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:34.905904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:34.905904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:34.906677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:34.906677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:34.906677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:34.906677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:34.906677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:34.906677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:34.906677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:34.906677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:34.906677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:34.906677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:34.906677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:39:34.906677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:39:34.909318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 30/65] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:34.916685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a35474-df91-451b-8a32-d7af6e405dc6 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:35.018945 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 36/66] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:39:35.044138 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb67ba-1332-4231-9c39-1b2f30c59f72 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:35.056759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:35.101044 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:35.114129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a35474-df91-451b-8a32-d7af6e405dc6 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:35.154598 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b7eea-ce0c-4291-95be-ab3bade092d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:35.155739 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b7eea-ce0c-4291-95be-ab3bade092d4 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.156175 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b7eea-ce0c-4291-95be-ab3bade092d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.157200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b7eea-ce0c-4291-95be-ab3bade092d4 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.158341 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b7eea-ce0c-4291-95be-ab3bade092d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:35.158841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b7eea-ce0c-4291-95be-ab3bade092d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:35.159749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb67ba-1332-4231-9c39-1b2f30c59f72 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:35.160553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b7eea-ce0c-4291-95be-ab3bade092d4 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:35.175885 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 31/67] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:39:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:35.177772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebf758-636d-40bb-a52d-8887ac08a2ae None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.178230 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebf758-636d-40bb-a52d-8887ac08a2ae None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.178675 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebf758-636d-40bb-a52d-8887ac08a2ae None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.180052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 32/68] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:35.184638 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebf758-636d-40bb-a52d-8887ac08a2ae None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:35.205492 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda2084-713f-456b-b6f0-fcdeac5b68a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:35.206152 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda2084-713f-456b-b6f0-fcdeac5b68a1 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.206473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda2084-713f-456b-b6f0-fcdeac5b68a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.206762 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda2084-713f-456b-b6f0-fcdeac5b68a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.218148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda2084-713f-456b-b6f0-fcdeac5b68a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:35.224757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-2bda2084-713f-456b-b6f0-fcdeac5b68a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:35.224757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:35.224757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:35.224757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:35.224757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:35.224757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:35.224757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:35.224757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:35.224757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:35.224757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:35.224757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:35.224757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:35.224757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:35.224757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:35.224757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:35.224757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:35.225585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:35.225585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:35.225585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:35.225585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:35.225585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:35.225585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:35.225585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:35.225585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:35.225585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:35.225585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:35.225585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:35.225585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:35.225585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:35.225585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:35.225585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:35.225585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:35.226415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:35.226415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:35.226415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:35.226415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:35.226415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:35.226415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:35.226415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:35.226415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:35.226415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:35.226415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:35.226415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:35.226415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:39:35.226992 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 37/69] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:35.228737 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f1bd2-748d-485c-afac-017489d7ae9d None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.229094 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f1bd2-748d-485c-afac-017489d7ae9d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.229454 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f1bd2-748d-485c-afac-017489d7ae9d None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.231248 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 38/70] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:35.232764 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d0a75-7aa8-4cfa-a09b-d214fca6127e None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.233414 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d0a75-7aa8-4cfa-a09b-d214fca6127e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.234046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d0a75-7aa8-4cfa-a09b-d214fca6127e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.255295 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-306d0a75-7aa8-4cfa-a09b-d214fca6127e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:35.256671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-306d0a75-7aa8-4cfa-a09b-d214fca6127e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:35.315063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebf758-636d-40bb-a52d-8887ac08a2ae None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:35.328896 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:35.333944 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 39/71] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:35.335486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877e520-e146-426f-9cde-e77bac38eaf0 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.335778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877e520-e146-426f-9cde-e77bac38eaf0 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.342555 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877e520-e146-426f-9cde-e77bac38eaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.358525 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-d877e520-e146-426f-9cde-e77bac38eaf0 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:35.360064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d877e520-e146-426f-9cde-e77bac38eaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:35.370935 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1947554-efb1-4f7c-aa1d-2c57a4af5d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:35.371601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1947554-efb1-4f7c-aa1d-2c57a4af5d31 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.371891 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1947554-efb1-4f7c-aa1d-2c57a4af5d31 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.372171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1947554-efb1-4f7c-aa1d-2c57a4af5d31 None admin] PATH_INFO: `/v3/users/f8bac1b49f25469994adf34dd214fd0c` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.393843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1947554-efb1-4f7c-aa1d-2c57a4af5d31 None admin] RBAC: Authorizing `identity:get_user(user_id=f8bac1b49f25469994adf34dd214fd0c)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:35.395377 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1947554-efb1-4f7c-aa1d-2c57a4af5d31 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:35.397300 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 33/72] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:35 2022] GET /identity/v3/users/f8bac1b49f25469994adf34dd214fd0c => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:35.398892 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1947554-efb1-4f7c-aa1d-2c57a4af5d31 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:35.418310 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:35.445958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 40/73] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:35.448528 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877e520-e146-426f-9cde-e77bac38eaf0 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:35.532460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1947554-efb1-4f7c-aa1d-2c57a4af5d31 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:35.568010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1ba26-3d30-48f8-b183-d0574781f17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:35.568538 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877e520-e146-426f-9cde-e77bac38eaf0 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:35.568969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1ba26-3d30-48f8-b183-d0574781f17f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.569141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1ba26-3d30-48f8-b183-d0574781f17f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.569345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1ba26-3d30-48f8-b183-d0574781f17f None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.570072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1ba26-3d30-48f8-b183-d0574781f17f None admin] RBAC: Adding query filter params (name=admin) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:35.570412 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1ba26-3d30-48f8-b183-d0574781f17f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:35.571793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1ba26-3d30-48f8-b183-d0574781f17f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:35.580112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 34/74] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:35.581099 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1ba26-3d30-48f8-b183-d0574781f17f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:35.606619 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:35.612682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b42ce3-fa02-4164-a873-17eed1b4304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:35.613281 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b42ce3-fa02-4164-a873-17eed1b4304b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.613571 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b42ce3-fa02-4164-a873-17eed1b4304b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.613847 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b42ce3-fa02-4164-a873-17eed1b4304b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.625085 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b42ce3-fa02-4164-a873-17eed1b4304b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:35.630034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-a5b42ce3-fa02-4164-a873-17eed1b4304b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:39:35.630034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:35.630034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:35.630034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:35.630034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:35.630034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:35.630034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:35.630034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:35.630034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:35.630034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:35.630034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:35.630034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:35.630034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:35.630034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:35.630034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:35.630034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:35.630931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:35.630931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:35.630931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:35.630931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:35.630931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:35.630931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:35.630931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:35.630931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:35.630931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:35.630931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:35.630931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:35.630931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:35.630931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:35.630931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:35.630931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:35.630931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:35.631733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:35.631733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:35.631733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:35.631733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:35.631733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:35.631733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:35.631733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:35.631733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:35.631733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:35.631733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:35.631733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:39:35.631733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:39:35.631733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 41/75] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:39:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:35.632707 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b42ce3-fa02-4164-a873-17eed1b4304b None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:35.663171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:35.695565 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1ba26-3d30-48f8-b183-d0574781f17f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:35.731075 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5d017-c2c8-4627-8bb8-d32bbb486764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:35.731712 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5d017-c2c8-4627-8bb8-d32bbb486764 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.731999 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5d017-c2c8-4627-8bb8-d32bbb486764 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.732278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5d017-c2c8-4627-8bb8-d32bbb486764 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.734355 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b42ce3-fa02-4164-a873-17eed1b4304b None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:35.777844 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da9ba6-eae2-4fe6-9954-a86468ef5202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:35.778534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da9ba6-eae2-4fe6-9954-a86468ef5202 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.778831 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da9ba6-eae2-4fe6-9954-a86468ef5202 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.779114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da9ba6-eae2-4fe6-9954-a86468ef5202 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.791062 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da9ba6-eae2-4fe6-9954-a86468ef5202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:35.796086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-80da9ba6-eae2-4fe6-9954-a86468ef5202 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:39:35.796086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:35.796086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:35.796086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:35.796086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:35.796086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:35.796086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:35.796086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:35.796086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:35.796086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:35.796086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:35.796086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:35.796086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:35.796086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:35.796086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:35.796086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:35.797137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:35.797137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:35.797137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:35.797137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:35.797137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:35.797137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:35.797137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:35.797137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:35.797137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:35.797137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:35.797137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:35.797137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:35.797137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:35.797137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:35.797137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:35.797137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:35.797895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:35.797895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:35.797895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:35.797895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:35.797895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:35.797895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:35.797895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:35.797895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:35.797895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:35.797895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:35.797895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:39:35.797895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:39:35.798512 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 42/76] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:35.799532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da9ba6-eae2-4fe6-9954-a86468ef5202 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:35.810293 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5d017-c2c8-4627-8bb8-d32bbb486764 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:35.811838 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5d017-c2c8-4627-8bb8-d32bbb486764 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:35.851751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:35.884139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:35.902961 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da9ba6-eae2-4fe6-9954-a86468ef5202 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:35.918370 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 35/77] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:35.919721 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8b81a-afbd-498a-9dec-0a0d7565443f None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.920013 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8b81a-afbd-498a-9dec-0a0d7565443f None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.920293 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8b81a-afbd-498a-9dec-0a0d7565443f None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.921559 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 36/78] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:35.923180 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8b81a-afbd-498a-9dec-0a0d7565443f None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:35.941760 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7386f-b128-408e-beb0-117ba511b05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:35.942439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7386f-b128-408e-beb0-117ba511b05d None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.942730 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7386f-b128-408e-beb0-117ba511b05d None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.943015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7386f-b128-408e-beb0-117ba511b05d None admin] PATH_INFO: `/v3/users/2e478bb3d9ce498d853319db6606450c` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.944280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7386f-b128-408e-beb0-117ba511b05d None admin] RBAC: Authorizing `identity:get_user(user_id=2e478bb3d9ce498d853319db6606450c)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:35.945749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7386f-b128-408e-beb0-117ba511b05d None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:35.947974 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 43/79] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:35 2022] GET /identity/v3/users/2e478bb3d9ce498d853319db6606450c => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:35.947974 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7386f-b128-408e-beb0-117ba511b05d None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:36.024249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8b81a-afbd-498a-9dec-0a0d7565443f None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:36.051711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7386f-b128-408e-beb0-117ba511b05d None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:36.059766 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78ee00-0f55-4411-a97a-a130258d200e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:36.060396 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78ee00-0f55-4411-a97a-a130258d200e None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:36.060674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78ee00-0f55-4411-a97a-a130258d200e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:36.060950 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78ee00-0f55-4411-a97a-a130258d200e None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:36.061657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78ee00-0f55-4411-a97a-a130258d200e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:36.061963 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78ee00-0f55-4411-a97a-a130258d200e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:36.063657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78ee00-0f55-4411-a97a-a130258d200e None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:36.070194 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:36.073946 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 37/80] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:36.075023 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78ee00-0f55-4411-a97a-a130258d200e None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:36.087790 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dfc4a-c9ca-4522-b9a8-57a03711f2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:36.088473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dfc4a-c9ca-4522-b9a8-57a03711f2f3 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:36.097590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dfc4a-c9ca-4522-b9a8-57a03711f2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:36.097590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dfc4a-c9ca-4522-b9a8-57a03711f2f3 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:36.097590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dfc4a-c9ca-4522-b9a8-57a03711f2f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:36.097590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dfc4a-c9ca-4522-b9a8-57a03711f2f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:36.097590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dfc4a-c9ca-4522-b9a8-57a03711f2f3 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:36.103736 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 44/81] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:39:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:36.104842 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f077d-dfb8-4b43-9f11-534c9ab2aa8c None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:36.105140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f077d-dfb8-4b43-9f11-534c9ab2aa8c None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:36.105424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f077d-dfb8-4b43-9f11-534c9ab2aa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:36.108686 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:36.126594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-0a5f077d-dfb8-4b43-9f11-534c9ab2aa8c None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:36.135749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0a5f077d-dfb8-4b43-9f11-534c9ab2aa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:36.198407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78ee00-0f55-4411-a97a-a130258d200e None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:36.203289 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 45/82] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:36.204188 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f077d-dfb8-4b43-9f11-534c9ab2aa8c None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:36.239723 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf495dd-f059-4b7d-9110-cf66f0ed7a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:36.240410 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf495dd-f059-4b7d-9110-cf66f0ed7a4c None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:36.240713 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf495dd-f059-4b7d-9110-cf66f0ed7a4c None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:36.241011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf495dd-f059-4b7d-9110-cf66f0ed7a4c None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:36.242252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf495dd-f059-4b7d-9110-cf66f0ed7a4c None admin] RBAC: Authorizing `identity:get_project(project_id=4fab63748076484db8b585b850783e19)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:36.244398 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf495dd-f059-4b7d-9110-cf66f0ed7a4c None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:36.246168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 38/83] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:36 2022] GET /identity/v3/projects/4fab63748076484db8b585b850783e19 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:36.247005 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf495dd-f059-4b7d-9110-cf66f0ed7a4c None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:36.313149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f077d-dfb8-4b43-9f11-534c9ab2aa8c None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:36.324559 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:36.344372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:36.347327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf495dd-f059-4b7d-9110-cf66f0ed7a4c None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:36.351952 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b81501-11a5-4923-bede-4f465ffe0204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:36.352633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b81501-11a5-4923-bede-4f465ffe0204 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:36.352990 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b81501-11a5-4923-bede-4f465ffe0204 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:36.353931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b81501-11a5-4923-bede-4f465ffe0204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:36.382956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64f11a-5e99-41db-b3ce-e158013d9d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:36.383832 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f11a-5e99-41db-b3ce-e158013d9d3b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:36.384201 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f11a-5e99-41db-b3ce-e158013d9d3b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:36.384581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f11a-5e99-41db-b3ce-e158013d9d3b None admin] PATH_INFO: `/v3/users/f8bac1b49f25469994adf34dd214fd0c` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:36.386175 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64f11a-5e99-41db-b3ce-e158013d9d3b None admin] RBAC: Authorizing `identity:get_user(user_id=f8bac1b49f25469994adf34dd214fd0c)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:36.388017 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64f11a-5e99-41db-b3ce-e158013d9d3b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:36.390260 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 39/84] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:36 2022] GET /identity/v3/users/f8bac1b49f25469994adf34dd214fd0c => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:36.391101 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64f11a-5e99-41db-b3ce-e158013d9d3b None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:36.429062 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b81501-11a5-4923-bede-4f465ffe0204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:36.430595 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b81501-11a5-4923-bede-4f465ffe0204 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:36.497356 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64f11a-5e99-41db-b3ce-e158013d9d3b None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:36.530933 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9f797-af22-4912-9481-4ea9bb3bf86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:36.531574 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9f797-af22-4912-9481-4ea9bb3bf86a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:36.531858 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9f797-af22-4912-9481-4ea9bb3bf86a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:36.532142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9f797-af22-4912-9481-4ea9bb3bf86a None admin] PATH_INFO: `/v3/users/f8bac1b49f25469994adf34dd214fd0c` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:36.533225 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 46/85] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:36.533346 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9f797-af22-4912-9481-4ea9bb3bf86a None admin] RBAC: Authorizing `identity:get_user(user_id=f8bac1b49f25469994adf34dd214fd0c)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:36.534077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b81501-11a5-4923-bede-4f465ffe0204 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:36.534786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9f797-af22-4912-9481-4ea9bb3bf86a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:36.536675 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 40/86] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:36 2022] GET /identity/v3/users/f8bac1b49f25469994adf34dd214fd0c => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:36.537283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9f797-af22-4912-9481-4ea9bb3bf86a None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:36.546646 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:36.575764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:36.634332 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b81501-11a5-4923-bede-4f465ffe0204 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:36.640790 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9f797-af22-4912-9481-4ea9bb3bf86a None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:36.668666 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc89a9-e90a-4695-b877-b52bb7b6be2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:36.669318 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc89a9-e90a-4695-b877-b52bb7b6be2f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:36.669611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc89a9-e90a-4695-b877-b52bb7b6be2f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:36.669899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc89a9-e90a-4695-b877-b52bb7b6be2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:36.671099 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc89a9-e90a-4695-b877-b52bb7b6be2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:36.672586 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc89a9-e90a-4695-b877-b52bb7b6be2f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:36.674196 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 47/87] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:36.674993 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc89a9-e90a-4695-b877-b52bb7b6be2f None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:36.678420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e3b89-d87b-43e9-a159-e50a06067992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:36.679068 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e3b89-d87b-43e9-a159-e50a06067992 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:36.679360 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e3b89-d87b-43e9-a159-e50a06067992 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:36.679640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e3b89-d87b-43e9-a159-e50a06067992 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:36.680433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e3b89-d87b-43e9-a159-e50a06067992 None admin] RBAC: Adding query filter params (role.id=8303560a3b6948379f524afad4b798d0, scope.project.id=4fab63748076484db8b585b850783e19, user.id=f8bac1b49f25469994adf34dd214fd0c) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:36.680746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e3b89-d87b-43e9-a159-e50a06067992 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:36.682184 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e3b89-d87b-43e9-a159-e50a06067992 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:36.697423 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 41/88] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:36 2022] GET /identity/v3/role_assignments?user.id=f8bac1b49f25469994adf34dd214fd0c&scope.project.id=4fab63748076484db8b585b850783e19&role.id=8303560a3b6948379f524afad4b798d0 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:36.697423 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e3b89-d87b-43e9-a159-e50a06067992 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:36.764434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:36.787693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc89a9-e90a-4695-b877-b52bb7b6be2f None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:36.812419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:36.816727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e3b89-d87b-43e9-a159-e50a06067992 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:36.833508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be6354-5605-4e93-a5f6-f8710952f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:36.834188 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be6354-5605-4e93-a5f6-f8710952f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:36.834506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be6354-5605-4e93-a5f6-f8710952f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:36.834794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be6354-5605-4e93-a5f6-f8710952f6f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:36.859448 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088cc30-0322-4797-8df0-4baa3b4e5c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:36.860120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088cc30-0322-4797-8df0-4baa3b4e5c98 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:36.860409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088cc30-0322-4797-8df0-4baa3b4e5c98 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:36.860688 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088cc30-0322-4797-8df0-4baa3b4e5c98 None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:36.861868 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088cc30-0322-4797-8df0-4baa3b4e5c98 None admin] RBAC: Authorizing `identity:get_project(project_id=4fab63748076484db8b585b850783e19)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:36.863373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088cc30-0322-4797-8df0-4baa3b4e5c98 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:36.865125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 42/89] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:36 2022] GET /identity/v3/projects/4fab63748076484db8b585b850783e19 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:36.865974 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088cc30-0322-4797-8df0-4baa3b4e5c98 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:36.912267 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be6354-5605-4e93-a5f6-f8710952f6f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:36.914005 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be6354-5605-4e93-a5f6-f8710952f6f0 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:36.972814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088cc30-0322-4797-8df0-4baa3b4e5c98 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:37.000972 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:37.011271 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407afe8-77b6-438c-963c-d6cd6daa9d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:37.011913 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407afe8-77b6-438c-963c-d6cd6daa9d5c None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:37.012217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407afe8-77b6-438c-963c-d6cd6daa9d5c None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:37.015315 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407afe8-77b6-438c-963c-d6cd6daa9d5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:37.029425 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 48/90] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:37.029425 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be6354-5605-4e93-a5f6-f8710952f6f0 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:37.056557 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:37.102923 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407afe8-77b6-438c-963c-d6cd6daa9d5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:37.104687 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407afe8-77b6-438c-963c-d6cd6daa9d5c None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:37.147943 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be6354-5605-4e93-a5f6-f8710952f6f0 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:37.184765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e320c1-17f9-4da8-b74d-e9ee6a670aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:37.185726 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e320c1-17f9-4da8-b74d-e9ee6a670aad None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:37.186025 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e320c1-17f9-4da8-b74d-e9ee6a670aad None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:37.186312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e320c1-17f9-4da8-b74d-e9ee6a670aad None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:37.187055 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e320c1-17f9-4da8-b74d-e9ee6a670aad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:37.189207 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e320c1-17f9-4da8-b74d-e9ee6a670aad None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:37.211497 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 43/91] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:37.212359 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407afe8-77b6-438c-963c-d6cd6daa9d5c None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:37.281173 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:37.281690 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 49/92] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jul 26 14:39:37 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:37.283007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e320c1-17f9-4da8-b74d-e9ee6a670aad None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:37.329465 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407afe8-77b6-438c-963c-d6cd6daa9d5c None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:37.340213 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:37.373897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad776b03-c0e7-4192-81e1-c1d2e46b85bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:37.374581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad776b03-c0e7-4192-81e1-c1d2e46b85bd None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:37.374868 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad776b03-c0e7-4192-81e1-c1d2e46b85bd None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:37.375147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad776b03-c0e7-4192-81e1-c1d2e46b85bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:37.375957 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad776b03-c0e7-4192-81e1-c1d2e46b85bd None admin] RBAC: Adding query filter params (role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.project.id=4fab63748076484db8b585b850783e19, user.id=2e478bb3d9ce498d853319db6606450c) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:37.376271 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad776b03-c0e7-4192-81e1-c1d2e46b85bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:37.377768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad776b03-c0e7-4192-81e1-c1d2e46b85bd None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:37.386747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 44/93] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:37 2022] GET /identity/v3/role_assignments?user.id=2e478bb3d9ce498d853319db6606450c&scope.project.id=4fab63748076484db8b585b850783e19&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:37.387865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad776b03-c0e7-4192-81e1-c1d2e46b85bd None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:37.465069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e320c1-17f9-4da8-b74d-e9ee6a670aad None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:37.518970 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7100d-6135-4243-ab1b-1c5a9dec9b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:37.519741 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7100d-6135-4243-ab1b-1c5a9dec9b02 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:37.520073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7100d-6135-4243-ab1b-1c5a9dec9b02 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:37.520519 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7100d-6135-4243-ab1b-1c5a9dec9b02 None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:37.522311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7100d-6135-4243-ab1b-1c5a9dec9b02 None admin] RBAC: Authorizing `identity:get_project(project_id=4fab63748076484db8b585b850783e19)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:37.524226 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7100d-6135-4243-ab1b-1c5a9dec9b02 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:37.526978 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 50/94] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:37 2022] GET /identity/v3/projects/4fab63748076484db8b585b850783e19 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:37.535395 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7100d-6135-4243-ab1b-1c5a9dec9b02 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:37.564035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad776b03-c0e7-4192-81e1-c1d2e46b85bd None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:37.610345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a3731-b9b2-4290-80a4-47c3cd9b8409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:37.612583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a3731-b9b2-4290-80a4-47c3cd9b8409 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:37.612583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a3731-b9b2-4290-80a4-47c3cd9b8409 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:37.612583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a3731-b9b2-4290-80a4-47c3cd9b8409 None admin] PATH_INFO: `/v3/projects/85fcebc70a724090b32778b95e34cc87` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:37.613719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a3731-b9b2-4290-80a4-47c3cd9b8409 None admin] RBAC: Authorizing `identity:get_project(project_id=85fcebc70a724090b32778b95e34cc87)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:37.615223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a3731-b9b2-4290-80a4-47c3cd9b8409 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:37.616942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 45/95] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:37 2022] GET /identity/v3/projects/85fcebc70a724090b32778b95e34cc87 => generated 312 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:37.617421 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:37.623271 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a3731-b9b2-4290-80a4-47c3cd9b8409 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:37.710205 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7100d-6135-4243-ab1b-1c5a9dec9b02 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:37.712153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:37.757945 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a3731-b9b2-4290-80a4-47c3cd9b8409 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:37.758153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4545d41-c28c-48d3-ad87-2afd8e8ecde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:37.758760 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4545d41-c28c-48d3-ad87-2afd8e8ecde3 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:37.759054 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4545d41-c28c-48d3-ad87-2afd8e8ecde3 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:37.759623 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4545d41-c28c-48d3-ad87-2afd8e8ecde3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:37.761366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4545d41-c28c-48d3-ad87-2afd8e8ecde3 None admin] RBAC: Adding query filter params (role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846, scope.project.id=4fab63748076484db8b585b850783e19, user.id=f8bac1b49f25469994adf34dd214fd0c) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:37.761692 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4545d41-c28c-48d3-ad87-2afd8e8ecde3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:37.764239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4545d41-c28c-48d3-ad87-2afd8e8ecde3 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:37.772435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 51/96] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:37 2022] GET /identity/v3/role_assignments?user.id=f8bac1b49f25469994adf34dd214fd0c&scope.project.id=4fab63748076484db8b585b850783e19&role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:37.801199 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5126e-35b2-4767-8044-733032cd483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:37.801916 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5126e-35b2-4767-8044-733032cd483a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:37.802209 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5126e-35b2-4767-8044-733032cd483a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:37.802538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5126e-35b2-4767-8044-733032cd483a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:37.803441 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5126e-35b2-4767-8044-733032cd483a None admin] RBAC: Adding query filter params (role.id=8303560a3b6948379f524afad4b798d0, scope.project.id=85fcebc70a724090b32778b95e34cc87, user.id=f8bac1b49f25469994adf34dd214fd0c) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:37.803763 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5126e-35b2-4767-8044-733032cd483a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:37.805278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5126e-35b2-4767-8044-733032cd483a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:37.812996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 46/97] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:37 2022] GET /identity/v3/role_assignments?user.id=f8bac1b49f25469994adf34dd214fd0c&scope.project.id=85fcebc70a724090b32778b95e34cc87&role.id=8303560a3b6948379f524afad4b798d0 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:39.064622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327f89a-7a51-47b6-b927-cd7824784ceb None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:39.065634 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327f89a-7a51-47b6-b927-cd7824784ceb None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:39.066123 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327f89a-7a51-47b6-b927-cd7824784ceb None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:39.067749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 52/98] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:39.073877 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdfd20-489c-4773-b6ba-fd074452efbc None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:39.074298 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdfd20-489c-4773-b6ba-fd074452efbc None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:39.074556 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdfd20-489c-4773-b6ba-fd074452efbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:39.115484 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-46cdfd20-489c-4773-b6ba-fd074452efbc None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:39.116717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-46cdfd20-489c-4773-b6ba-fd074452efbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:39.184532 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:39.193002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 47/99] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:39:39.241206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327f89a-7a51-47b6-b927-cd7824784ceb None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:39.363377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327f89a-7a51-47b6-b927-cd7824784ceb None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:39.413975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a948fc2-a388-4ccc-b9a4-87e929043a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:39.414677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a948fc2-a388-4ccc-b9a4-87e929043a0f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:39.414969 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a948fc2-a388-4ccc-b9a4-87e929043a0f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:39.415255 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a948fc2-a388-4ccc-b9a4-87e929043a0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:39.430614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a948fc2-a388-4ccc-b9a4-87e929043a0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:39.435551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-4a948fc2-a388-4ccc-b9a4-87e929043a0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:39:39.435551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:39.435551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:39.435551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:39.435551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:39.435551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:39.435551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:39.435551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:39.435551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:39.435551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:39.435551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:39.435551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:39.435551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:39.435551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:39.435551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:39.435551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:39.436359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:39.436359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:39.436359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:39.436359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:39.436359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:39.436359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:39.436359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:39.436359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:39.436359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:39.436359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:39.436359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:39.436359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:39.436359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:39.436359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:39.436359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:39.436359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:39.437091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:39.437091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:39.437091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:39.437091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:39.437091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:39.437091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:39.437091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:39.437091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:39.437091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:39.437091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:39.437091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:39:39.437091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:39:39.437091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 53/100] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:39.443684 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdfd20-489c-4773-b6ba-fd074452efbc None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:39.547118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdfd20-489c-4773-b6ba-fd074452efbc None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:39.590410 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee212436-ed99-4290-abf4-4dff433527e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:39.591051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee212436-ed99-4290-abf4-4dff433527e1 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:39.591344 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee212436-ed99-4290-abf4-4dff433527e1 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:39.591630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee212436-ed99-4290-abf4-4dff433527e1 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:39.592363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee212436-ed99-4290-abf4-4dff433527e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:39.592683 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee212436-ed99-4290-abf4-4dff433527e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:39.594077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee212436-ed99-4290-abf4-4dff433527e1 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:39.602923 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 48/101] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:39:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:39.608517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a948fc2-a388-4ccc-b9a4-87e929043a0f None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:39.650251 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:39.766118 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a948fc2-a388-4ccc-b9a4-87e929043a0f None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:39.812489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3e18d-690a-4343-bb9b-22892fc97806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:39.813160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3e18d-690a-4343-bb9b-22892fc97806 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:39.813454 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3e18d-690a-4343-bb9b-22892fc97806 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:39.813740 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3e18d-690a-4343-bb9b-22892fc97806 None admin] PATH_INFO: `/v3/users/f8bac1b49f25469994adf34dd214fd0c` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:39.814982 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3e18d-690a-4343-bb9b-22892fc97806 None admin] RBAC: Authorizing `identity:get_user(user_id=f8bac1b49f25469994adf34dd214fd0c)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:39.816453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3e18d-690a-4343-bb9b-22892fc97806 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:39.818377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 54/102] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:39 2022] GET /identity/v3/users/f8bac1b49f25469994adf34dd214fd0c => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:39.823972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee212436-ed99-4290-abf4-4dff433527e1 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:39.903938 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:40.024441 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee212436-ed99-4290-abf4-4dff433527e1 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:40.071419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ae3f5-3b10-4965-93e9-333213248a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:40.072480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ae3f5-3b10-4965-93e9-333213248a75 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:40.072974 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ae3f5-3b10-4965-93e9-333213248a75 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:40.073437 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ae3f5-3b10-4965-93e9-333213248a75 None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:40.079081 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ae3f5-3b10-4965-93e9-333213248a75 None admin] RBAC: Authorizing `identity:get_project(project_id=4fab63748076484db8b585b850783e19)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:40.081152 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ae3f5-3b10-4965-93e9-333213248a75 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:40.083062 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 49/103] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:39 2022] GET /identity/v3/projects/4fab63748076484db8b585b850783e19 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:40.088926 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3e18d-690a-4343-bb9b-22892fc97806 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:40.149480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88100b-7226-4a99-92d4-0ae3c0515fed None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:40.150370 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88100b-7226-4a99-92d4-0ae3c0515fed None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:40.151223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88100b-7226-4a99-92d4-0ae3c0515fed None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:40.153192 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 50/104] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:39:40.186482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845f9a7-7603-4e77-a4c7-d423b8990543 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:40.186482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845f9a7-7603-4e77-a4c7-d423b8990543 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:40.186482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845f9a7-7603-4e77-a4c7-d423b8990543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:40.196650 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-4845f9a7-7603-4e77-a4c7-d423b8990543 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:40.198794 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4845f9a7-7603-4e77-a4c7-d423b8990543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:40.246758 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:40.256313 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3e18d-690a-4343-bb9b-22892fc97806 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:40.324065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02276ab1-9edc-4e82-a727-73d47416167c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:40.324763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02276ab1-9edc-4e82-a727-73d47416167c None admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:40.325064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02276ab1-9edc-4e82-a727-73d47416167c None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:40.325355 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02276ab1-9edc-4e82-a727-73d47416167c None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19/users/f8bac1b49f25469994adf34dd214fd0c/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:40.328641 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02276ab1-9edc-4e82-a727-73d47416167c None admin] RBAC: Authorizing `identity:create_grant(project_id=4fab63748076484db8b585b850783e19, user_id=f8bac1b49f25469994adf34dd214fd0c, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:40.330125 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02276ab1-9edc-4e82-a727-73d47416167c None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:40.336358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 51/105] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:39:40.359418 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845f9a7-7603-4e77-a4c7-d423b8990543 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:40.413112 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 55/106] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:39:40 2022] PUT /identity/v3/projects/4fab63748076484db8b585b850783e19/users/f8bac1b49f25469994adf34dd214fd0c/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:39:40.460665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:40.521813 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845f9a7-7603-4e77-a4c7-d423b8990543 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:40.571855 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0538a-b8bc-4584-b1f9-c4f06511721d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:40.572535 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0538a-b8bc-4584-b1f9-c4f06511721d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:40.572817 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0538a-b8bc-4584-b1f9-c4f06511721d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:40.573092 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0538a-b8bc-4584-b1f9-c4f06511721d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:40.589669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0538a-b8bc-4584-b1f9-c4f06511721d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:40.594828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-6ab0538a-b8bc-4584-b1f9-c4f06511721d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:40.594828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:40.594828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:40.594828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:40.594828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:40.594828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:40.594828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:40.594828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:40.594828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:40.594828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:40.594828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:40.594828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:40.594828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:40.594828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:40.594828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:40.594828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:40.595743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:40.595743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:40.595743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:40.595743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:40.595743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:40.595743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:40.595743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:40.595743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:40.595743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:40.595743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:40.595743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:40.595743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:40.595743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:40.595743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:40.595743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:40.595743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:40.596536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:40.596536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:40.596536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:40.596536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:40.596536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:40.596536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:40.596536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:40.596536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:40.596536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:40.596536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:40.596536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:40.596536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:39:40.596536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 52/107] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:40.607546 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02276ab1-9edc-4e82-a727-73d47416167c None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:40.767263 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02276ab1-9edc-4e82-a727-73d47416167c None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:40.785813 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae0587-15e7-47f1-98aa-f8272bf91640 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:40.786474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae0587-15e7-47f1-98aa-f8272bf91640 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:40.786946 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae0587-15e7-47f1-98aa-f8272bf91640 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:40.788713 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 53/108] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:40.794196 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498651f-b714-4a47-ac22-46bd007262c2 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:40.794770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498651f-b714-4a47-ac22-46bd007262c2 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:40.795266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498651f-b714-4a47-ac22-46bd007262c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:40.819117 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf93d8-b1b2-4aff-8686-91150ed35666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:40.819763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf93d8-b1b2-4aff-8686-91150ed35666 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:40.820053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf93d8-b1b2-4aff-8686-91150ed35666 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:40.820339 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf93d8-b1b2-4aff-8686-91150ed35666 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:40.821072 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf93d8-b1b2-4aff-8686-91150ed35666 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:40.821387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf93d8-b1b2-4aff-8686-91150ed35666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:40.823474 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf93d8-b1b2-4aff-8686-91150ed35666 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:40.833824 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 56/109] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:40.835259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-d498651f-b714-4a47-ac22-46bd007262c2 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:40.836619 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d498651f-b714-4a47-ac22-46bd007262c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:40.846529 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf93d8-b1b2-4aff-8686-91150ed35666 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:40.869143 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:40.937254 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 54/110] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:39:40.938764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604fd5c-a3cf-478e-bf8e-91cf2a92f1c7 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:40.939056 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604fd5c-a3cf-478e-bf8e-91cf2a92f1c7 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:40.939340 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604fd5c-a3cf-478e-bf8e-91cf2a92f1c7 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:40.940783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 55/111] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:40.946092 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870877a1-a17c-4b3d-a516-600df46e73a5 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:40.946404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870877a1-a17c-4b3d-a516-600df46e73a5 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:40.947219 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870877a1-a17c-4b3d-a516-600df46e73a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:40.965346 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-870877a1-a17c-4b3d-a516-600df46e73a5 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:40.966596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-870877a1-a17c-4b3d-a516-600df46e73a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:40.980700 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf93d8-b1b2-4aff-8686-91150ed35666 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:41.040983 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:41.053667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310997a-6db7-4527-ab4d-bfdd56a906c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:41.054332 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310997a-6db7-4527-ab4d-bfdd56a906c3 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:41.054648 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310997a-6db7-4527-ab4d-bfdd56a906c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:41.054931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310997a-6db7-4527-ab4d-bfdd56a906c3 None admin] PATH_INFO: `/v3/users/2e478bb3d9ce498d853319db6606450c` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:41.058110 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310997a-6db7-4527-ab4d-bfdd56a906c3 None admin] RBAC: Authorizing `identity:get_user(user_id=2e478bb3d9ce498d853319db6606450c)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:41.059628 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310997a-6db7-4527-ab4d-bfdd56a906c3 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:41.064909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 57/112] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:40 2022] GET /identity/v3/users/2e478bb3d9ce498d853319db6606450c => generated 247 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:41.067852 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310997a-6db7-4527-ab4d-bfdd56a906c3 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:41.092769 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 56/113] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:39:41.097902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870877a1-a17c-4b3d-a516-600df46e73a5 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:41.252245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870877a1-a17c-4b3d-a516-600df46e73a5 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:41.256423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:41.275693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310997a-6db7-4527-ab4d-bfdd56a906c3 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:41.292893 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e7457-ee62-4d82-a3a7-aad8f5ad70d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:41.293477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e7457-ee62-4d82-a3a7-aad8f5ad70d0 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:41.293822 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e7457-ee62-4d82-a3a7-aad8f5ad70d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:41.294103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e7457-ee62-4d82-a3a7-aad8f5ad70d0 None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:41.295288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e7457-ee62-4d82-a3a7-aad8f5ad70d0 None admin] RBAC: Authorizing `identity:get_project(project_id=4fab63748076484db8b585b850783e19)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:41.296726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e7457-ee62-4d82-a3a7-aad8f5ad70d0 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:41.298579 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 57/114] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:41 2022] GET /identity/v3/projects/4fab63748076484db8b585b850783e19 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:41.303895 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e7457-ee62-4d82-a3a7-aad8f5ad70d0 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:41.312080 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221c223-b16e-44aa-8def-cccd4fcd4509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:41.312735 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221c223-b16e-44aa-8def-cccd4fcd4509 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:41.313019 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221c223-b16e-44aa-8def-cccd4fcd4509 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:41.313300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221c223-b16e-44aa-8def-cccd4fcd4509 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:41.324233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221c223-b16e-44aa-8def-cccd4fcd4509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:41.329132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-2221c223-b16e-44aa-8def-cccd4fcd4509 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:39:41.329132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:41.329132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:41.329132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:41.329132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:41.329132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:41.329132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:41.329132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:41.329132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:41.329132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:41.329132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:41.329132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:41.329132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:41.329132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:41.329132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:41.329132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:41.329967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:41.329967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:41.329967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:41.329967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:41.329967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:41.329967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:41.329967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:41.329967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:41.329967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:41.329967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:41.329967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:41.329967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:41.329967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:41.329967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:41.329967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:41.329967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:41.330727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:41.330727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:41.330727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:41.330727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:41.330727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:41.330727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:41.330727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:41.330727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:41.330727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:41.330727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:41.330727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:39:41.330727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:39:41.330727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 58/115] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:41.336856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7830dc-ba7f-40a3-87a9-e78d41bb5f09 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:41.336856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7830dc-ba7f-40a3-87a9-e78d41bb5f09 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:41.336856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7830dc-ba7f-40a3-87a9-e78d41bb5f09 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:41.336856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 59/116] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:41.336856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1846b10-5dcd-4599-a347-c98baa9ad7ac None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:41.336856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1846b10-5dcd-4599-a347-c98baa9ad7ac None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:41.337802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1846b10-5dcd-4599-a347-c98baa9ad7ac None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:41.340510 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 60/117] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:41.341200 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1846b10-5dcd-4599-a347-c98baa9ad7ac None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:41.362259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:41.430869 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e7457-ee62-4d82-a3a7-aad8f5ad70d0 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:41.457771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1846b10-5dcd-4599-a347-c98baa9ad7ac None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:41.465055 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dbec0-913c-4738-a85e-e54c970fc201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:41.465708 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dbec0-913c-4738-a85e-e54c970fc201 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:41.465998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dbec0-913c-4738-a85e-e54c970fc201 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:41.466268 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dbec0-913c-4738-a85e-e54c970fc201 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:41.467449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314dbec0-913c-4738-a85e-e54c970fc201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:41.469014 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314dbec0-913c-4738-a85e-e54c970fc201 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:41.470812 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 58/118] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:41.471398 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dbec0-913c-4738-a85e-e54c970fc201 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:41.501000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35949321-1dcb-40b0-99da-9dc42ca49aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:41.501680 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35949321-1dcb-40b0-99da-9dc42ca49aac None admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:41.501963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35949321-1dcb-40b0-99da-9dc42ca49aac None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:41.502240 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35949321-1dcb-40b0-99da-9dc42ca49aac None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19/users/2e478bb3d9ce498d853319db6606450c/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:41.504223 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35949321-1dcb-40b0-99da-9dc42ca49aac None admin] RBAC: Authorizing `identity:create_grant(project_id=4fab63748076484db8b585b850783e19, user_id=2e478bb3d9ce498d853319db6606450c, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:41.505735 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35949321-1dcb-40b0-99da-9dc42ca49aac None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:41.578786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dbec0-913c-4738-a85e-e54c970fc201 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:41.589385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:41.618419 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 61/119] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:39:41 2022] PUT /identity/v3/projects/4fab63748076484db8b585b850783e19/users/2e478bb3d9ce498d853319db6606450c/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:39:41.618419 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee16256-e578-44bf-8cb8-653822649326 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:41.618419 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee16256-e578-44bf-8cb8-653822649326 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:41.618419 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee16256-e578-44bf-8cb8-653822649326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:41.623428 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126b162-934f-4ce5-9e19-d33ef4dcfaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:41.624449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126b162-934f-4ce5-9e19-d33ef4dcfaa7 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:41.624740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126b162-934f-4ce5-9e19-d33ef4dcfaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:41.625020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126b162-934f-4ce5-9e19-d33ef4dcfaa7 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:41.625691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:41.625793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126b162-934f-4ce5-9e19-d33ef4dcfaa7 None admin] RBAC: Adding query filter params (name=member) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:41.626106 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126b162-934f-4ce5-9e19-d33ef4dcfaa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:41.627573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126b162-934f-4ce5-9e19-d33ef4dcfaa7 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:41.642465 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 59/120] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:39:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:41.642465 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642cb74-9159-432f-8bc0-2924981f32c4 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:41.642465 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642cb74-9159-432f-8bc0-2924981f32c4 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:41.642465 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642cb74-9159-432f-8bc0-2924981f32c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:41.645873 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-9ee16256-e578-44bf-8cb8-653822649326 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:41.645873 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-9ee16256-e578-44bf-8cb8-653822649326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:41.660353 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-3642cb74-9159-432f-8bc0-2924981f32c4 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:41.661908 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-3642cb74-9159-432f-8bc0-2924981f32c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:41.762701 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 60/121] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:41.764166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642cb74-9159-432f-8bc0-2924981f32c4 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:41.764457 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 62/122] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:41.765398 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee16256-e578-44bf-8cb8-653822649326 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:41.907929 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642cb74-9159-432f-8bc0-2924981f32c4 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:41.909752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:41.918038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee16256-e578-44bf-8cb8-653822649326 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:41.947755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f680de-409a-40de-beef-d0abf38a7861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:41.948784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f680de-409a-40de-beef-d0abf38a7861 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:41.949215 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f680de-409a-40de-beef-d0abf38a7861 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:41.949676 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f680de-409a-40de-beef-d0abf38a7861 None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:41.950549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f680de-409a-40de-beef-d0abf38a7861 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:41.952263 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f680de-409a-40de-beef-d0abf38a7861 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:41.961590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef27326-4693-4a0b-9911-ba17277333e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:41.962855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef27326-4693-4a0b-9911-ba17277333e8 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:41.963193 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef27326-4693-4a0b-9911-ba17277333e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:41.963483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef27326-4693-4a0b-9911-ba17277333e8 None admin] PATH_INFO: `/v3/users/f8bac1b49f25469994adf34dd214fd0c` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:41.964687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef27326-4693-4a0b-9911-ba17277333e8 None admin] RBAC: Authorizing `identity:get_user(user_id=f8bac1b49f25469994adf34dd214fd0c)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:41.966782 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef27326-4693-4a0b-9911-ba17277333e8 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:41.968932 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 63/123] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:41 2022] GET /identity/v3/users/f8bac1b49f25469994adf34dd214fd0c => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:41.969956 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef27326-4693-4a0b-9911-ba17277333e8 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:41.973289 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:42.061285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 61/124] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jul 26 14:39:41 2022] POST /identity/v3/projects => generated 302 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:42.062482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f680de-409a-40de-beef-d0abf38a7861 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:42.109736 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef27326-4693-4a0b-9911-ba17277333e8 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:42.188743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a033541-dc5d-406b-89ca-78c26f8e06f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:42.188743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a033541-dc5d-406b-89ca-78c26f8e06f0 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:42.188743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a033541-dc5d-406b-89ca-78c26f8e06f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:42.188743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a033541-dc5d-406b-89ca-78c26f8e06f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:42.223668 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f680de-409a-40de-beef-d0abf38a7861 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:42.225154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a033541-dc5d-406b-89ca-78c26f8e06f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:42.231358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-5a033541-dc5d-406b-89ca-78c26f8e06f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:39:42.231358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:42.231358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:42.231358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:42.231358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:42.231358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:42.231358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:42.231358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:42.231358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:42.231358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:42.231358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:42.231358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:42.231358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:42.231358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:42.231358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:42.231358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:42.232386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:42.232386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:42.232386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:42.232386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:42.232386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:42.232386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:42.232386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:42.232386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:42.232386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:42.232386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:42.232386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:42.232386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:42.232386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:42.232386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:42.232386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:42.232386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:42.233158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:42.233158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:42.233158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:42.233158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:42.233158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:42.233158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:42.233158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:42.233158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:42.233158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:42.233158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:42.233158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:39:42.233158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:39:42.236046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 64/125] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:42.237131 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a033541-dc5d-406b-89ca-78c26f8e06f0 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:42.283597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598dc3a-168c-442c-a648-ba6bd38b240c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:42.284584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598dc3a-168c-442c-a648-ba6bd38b240c None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:42.285011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598dc3a-168c-442c-a648-ba6bd38b240c None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:42.285299 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598dc3a-168c-442c-a648-ba6bd38b240c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:42.299349 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598dc3a-168c-442c-a648-ba6bd38b240c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:42.305841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-8598dc3a-168c-442c-a648-ba6bd38b240c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:39:42.305841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:42.305841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:42.305841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:42.305841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:42.305841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:42.305841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:42.305841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:42.305841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:42.305841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:42.305841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:42.305841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:42.305841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:42.305841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:42.305841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:42.305841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:42.306764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:42.306764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:42.306764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:42.306764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:42.306764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:42.306764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:42.306764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:42.306764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:42.306764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:42.306764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:42.306764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:42.306764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:42.306764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:42.306764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:42.306764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:42.306764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:42.307509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:42.307509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:42.307509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:42.307509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:42.307509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:42.307509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:42.307509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:42.307509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:42.307509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:42.307509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:42.307509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:39:42.307509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:39:42.307509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 62/126] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:39:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:42.308296 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598dc3a-168c-442c-a648-ba6bd38b240c None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:42.334443 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:42.335312 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:42.387522 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a033541-dc5d-406b-89ca-78c26f8e06f0 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:42.436132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19f36c-c260-434f-96e9-cdfdfcc665f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:42.436941 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19f36c-c260-434f-96e9-cdfdfcc665f7 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:42.437303 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19f36c-c260-434f-96e9-cdfdfcc665f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:42.437661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19f36c-c260-434f-96e9-cdfdfcc665f7 None admin] PATH_INFO: `/v3/projects/85fcebc70a724090b32778b95e34cc87` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:42.439197 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19f36c-c260-434f-96e9-cdfdfcc665f7 None admin] RBAC: Authorizing `identity:get_project(project_id=85fcebc70a724090b32778b95e34cc87)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:42.441358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19f36c-c260-434f-96e9-cdfdfcc665f7 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:42.444010 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 65/127] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:42 2022] GET /identity/v3/projects/85fcebc70a724090b32778b95e34cc87 => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:42.445108 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19f36c-c260-434f-96e9-cdfdfcc665f7 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:42.457584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598dc3a-168c-442c-a648-ba6bd38b240c None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:42.494842 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36670ea8-a937-4efd-a02c-e84bb9bf458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:42.495892 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36670ea8-a937-4efd-a02c-e84bb9bf458d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:42.496313 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36670ea8-a937-4efd-a02c-e84bb9bf458d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:42.496663 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36670ea8-a937-4efd-a02c-e84bb9bf458d None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:42.497500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36670ea8-a937-4efd-a02c-e84bb9bf458d None admin] RBAC: Adding query filter params (name=reader) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:42.497915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36670ea8-a937-4efd-a02c-e84bb9bf458d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:42.500009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36670ea8-a937-4efd-a02c-e84bb9bf458d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:42.510683 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 63/128] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:39:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:42.511873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36670ea8-a937-4efd-a02c-e84bb9bf458d None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:42.610795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:42.646678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19f36c-c260-434f-96e9-cdfdfcc665f7 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:42.654798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36670ea8-a937-4efd-a02c-e84bb9bf458d None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:42.707981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:42.718423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6da6e3-ff57-40b8-a801-3cb5cd45e925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:42.718423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6da6e3-ff57-40b8-a801-3cb5cd45e925 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:42.718423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6da6e3-ff57-40b8-a801-3cb5cd45e925 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:42.718423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6da6e3-ff57-40b8-a801-3cb5cd45e925 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:42.723021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6da6e3-ff57-40b8-a801-3cb5cd45e925 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:42.723021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6da6e3-ff57-40b8-a801-3cb5cd45e925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:42.723021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6da6e3-ff57-40b8-a801-3cb5cd45e925 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:42.723238 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47595415-6607-4091-8ad4-0995b7d2f787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:42.723496 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47595415-6607-4091-8ad4-0995b7d2f787 None admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:42.723925 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47595415-6607-4091-8ad4-0995b7d2f787 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:42.724337 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47595415-6607-4091-8ad4-0995b7d2f787 None admin] PATH_INFO: `/v3/projects/85fcebc70a724090b32778b95e34cc87/users/f8bac1b49f25469994adf34dd214fd0c/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:42.733308 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 66/129] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:42.733984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6da6e3-ff57-40b8-a801-3cb5cd45e925 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:42.735193 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47595415-6607-4091-8ad4-0995b7d2f787 None admin] RBAC: Authorizing `identity:create_grant(project_id=85fcebc70a724090b32778b95e34cc87, user_id=f8bac1b49f25469994adf34dd214fd0c, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:42.736660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47595415-6607-4091-8ad4-0995b7d2f787 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:42.812212 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 64/130] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:39:42 2022] PUT /identity/v3/projects/85fcebc70a724090b32778b95e34cc87/users/f8bac1b49f25469994adf34dd214fd0c/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:39:42.813119 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47595415-6607-4091-8ad4-0995b7d2f787 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:42.896649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6da6e3-ff57-40b8-a801-3cb5cd45e925 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:42.971886 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d85d9-e930-4d24-aedf-a11aa2e723b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:42.972774 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d85d9-e930-4d24-aedf-a11aa2e723b8 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:42.973213 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d85d9-e930-4d24-aedf-a11aa2e723b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:42.974275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d85d9-e930-4d24-aedf-a11aa2e723b8 None admin] PATH_INFO: `/v3/users/3f8861ddb2604de68dd4fa0cfe6aa100` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:42.996874 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d85d9-e930-4d24-aedf-a11aa2e723b8 None admin] RBAC: Authorizing `identity:get_user(user_id=3f8861ddb2604de68dd4fa0cfe6aa100)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:42.998892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d85d9-e930-4d24-aedf-a11aa2e723b8 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:43.004741 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 67/131] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:42 2022] GET /identity/v3/users/3f8861ddb2604de68dd4fa0cfe6aa100 => generated 289 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:43.010863 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d85d9-e930-4d24-aedf-a11aa2e723b8 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:43.089857 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47595415-6607-4091-8ad4-0995b7d2f787 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:43.094486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:43.135184 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49378553-136c-4441-8964-daa1d2215e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:43.135903 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49378553-136c-4441-8964-daa1d2215e0b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:43.136200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49378553-136c-4441-8964-daa1d2215e0b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:43.136487 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49378553-136c-4441-8964-daa1d2215e0b None admin] PATH_INFO: `/v3/users/f8bac1b49f25469994adf34dd214fd0c` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:43.137812 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49378553-136c-4441-8964-daa1d2215e0b None admin] RBAC: Authorizing `identity:get_user(user_id=f8bac1b49f25469994adf34dd214fd0c)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:43.139434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49378553-136c-4441-8964-daa1d2215e0b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:43.141346 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 65/132] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:42 2022] GET /identity/v3/users/f8bac1b49f25469994adf34dd214fd0c => generated 275 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:43.142457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d647608-278c-4542-9ca7-7cea1b2476e3 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:43.142753 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d647608-278c-4542-9ca7-7cea1b2476e3 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:43.143150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d647608-278c-4542-9ca7-7cea1b2476e3 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:43.144387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 66/133] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:43.149277 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d647608-278c-4542-9ca7-7cea1b2476e3 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:43.155110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:43.159132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d85d9-e930-4d24-aedf-a11aa2e723b8 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:43.222508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2a23e-7750-4539-9f50-f5c79aec9986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:43.223135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2a23e-7750-4539-9f50-f5c79aec9986 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:43.223480 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2a23e-7750-4539-9f50-f5c79aec9986 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:43.223770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2a23e-7750-4539-9f50-f5c79aec9986 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:43.313907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2a23e-7750-4539-9f50-f5c79aec9986 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:43.315439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2a23e-7750-4539-9f50-f5c79aec9986 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:43.335104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d647608-278c-4542-9ca7-7cea1b2476e3 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:43.373277 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f97b2-2e7d-44a0-91ea-ba44b0647c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:43.374202 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f97b2-2e7d-44a0-91ea-ba44b0647c8b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:43.374523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f97b2-2e7d-44a0-91ea-ba44b0647c8b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:43.374810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f97b2-2e7d-44a0-91ea-ba44b0647c8b None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:43.377375 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f97b2-2e7d-44a0-91ea-ba44b0647c8b None admin] RBAC: Authorizing `identity:get_project(project_id=4fab63748076484db8b585b850783e19)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:43.379707 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f97b2-2e7d-44a0-91ea-ba44b0647c8b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:43.385227 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 67/134] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:43 2022] GET /identity/v3/projects/4fab63748076484db8b585b850783e19 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:43.390621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58086118-5bb9-4075-aecf-48b211b2a50d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:43.390933 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58086118-5bb9-4075-aecf-48b211b2a50d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:43.391276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58086118-5bb9-4075-aecf-48b211b2a50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:43.415297 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:43.426140 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-58086118-5bb9-4075-aecf-48b211b2a50d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:43.427382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-58086118-5bb9-4075-aecf-48b211b2a50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:43.522171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 68/135] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:43.523105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58086118-5bb9-4075-aecf-48b211b2a50d None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:43.526370 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 68/136] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:43.532642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:43.547320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2a23e-7750-4539-9f50-f5c79aec9986 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:43.659206 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58086118-5bb9-4075-aecf-48b211b2a50d None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:43.695297 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95696040-d398-4694-b92c-b4991ed9c6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:43.696101 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95696040-d398-4694-b92c-b4991ed9c6ef None admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:43.696395 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95696040-d398-4694-b92c-b4991ed9c6ef None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:43.696709 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95696040-d398-4694-b92c-b4991ed9c6ef None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19/users/f8bac1b49f25469994adf34dd214fd0c/roles/9cc7bf3bc6aa4b33ab6dee0dd67e1846` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:43.699028 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95696040-d398-4694-b92c-b4991ed9c6ef None admin] RBAC: Authorizing `identity:create_grant(project_id=4fab63748076484db8b585b850783e19, user_id=f8bac1b49f25469994adf34dd214fd0c, role_id=9cc7bf3bc6aa4b33ab6dee0dd67e1846)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:43.700497 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95696040-d398-4694-b92c-b4991ed9c6ef None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:43.773815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2a23e-7750-4539-9f50-f5c79aec9986 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:43.797928 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 69/137] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:39:43 2022] PUT /identity/v3/projects/4fab63748076484db8b585b850783e19/users/f8bac1b49f25469994adf34dd214fd0c/roles/9cc7bf3bc6aa4b33ab6dee0dd67e1846 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:39:43.798868 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95696040-d398-4694-b92c-b4991ed9c6ef None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:43.822326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee8dd8-4466-4738-aa28-73bb51f55c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:43.823043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee8dd8-4466-4738-aa28-73bb51f55c36 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:43.823336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee8dd8-4466-4738-aa28-73bb51f55c36 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:43.823623 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee8dd8-4466-4738-aa28-73bb51f55c36 None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:43.831473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee8dd8-4466-4738-aa28-73bb51f55c36 None admin] RBAC: Authorizing `identity:get_project(project_id=4fab63748076484db8b585b850783e19)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:43.833006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee8dd8-4466-4738-aa28-73bb51f55c36 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:43.835056 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 69/138] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:43 2022] GET /identity/v3/projects/4fab63748076484db8b585b850783e19 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:43.841729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee8dd8-4466-4738-aa28-73bb51f55c36 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:43.902228 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:43.948589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:43.988024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95696040-d398-4694-b92c-b4991ed9c6ef None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:44.028312 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d8fce-8ab9-435d-9218-808a6685e67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:44.029288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d8fce-8ab9-435d-9218-808a6685e67d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:44.029775 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d8fce-8ab9-435d-9218-808a6685e67d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:44.030249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d8fce-8ab9-435d-9218-808a6685e67d None admin] PATH_INFO: `/v3/roles/member` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:44.044072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d8fce-8ab9-435d-9218-808a6685e67d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:44.049370 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee8dd8-4466-4738-aa28-73bb51f55c36 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:44.050621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-134d8fce-8ab9-435d-9218-808a6685e67d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:39:44.050621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:44.050621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:44.050621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:44.050621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:44.050621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:44.050621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:44.050621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:44.050621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:44.050621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:44.050621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:44.050621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:44.050621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:44.050621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:44.050621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:44.050621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:44.051630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:44.051630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:44.051630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:44.051630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:44.051630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:44.051630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:44.051630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:44.051630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:44.051630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:44.051630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:44.051630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:44.051630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:44.051630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:44.051630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:44.051630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:44.051630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:44.052380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:44.052380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:44.052380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:44.052380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:44.052380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:44.052380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:44.052380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:44.052380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:44.052380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:44.052380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:44.052380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:39:44.052380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:39:44.053426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 70/139] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:44.056060 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2882dd-06f1-422c-bbaa-b2ddd3c9a324 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:44.056654 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2882dd-06f1-422c-bbaa-b2ddd3c9a324 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:44.057075 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2882dd-06f1-422c-bbaa-b2ddd3c9a324 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:44.058538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 71/140] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:44.060127 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2882dd-06f1-422c-bbaa-b2ddd3c9a324 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:44.098856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70cf66-9f6f-48f5-8f50-8cab23ff0952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:44.099621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70cf66-9f6f-48f5-8f50-8cab23ff0952 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:44.100055 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70cf66-9f6f-48f5-8f50-8cab23ff0952 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:44.100452 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70cf66-9f6f-48f5-8f50-8cab23ff0952 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:44.101467 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70cf66-9f6f-48f5-8f50-8cab23ff0952 None admin] RBAC: Adding query filter params (role.id=1b8bdabcd591423d91aaf8f30f7cd6f5, scope.project.id=4fab63748076484db8b585b850783e19, user.id=3f8861ddb2604de68dd4fa0cfe6aa100) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:44.101882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70cf66-9f6f-48f5-8f50-8cab23ff0952 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:44.104010 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70cf66-9f6f-48f5-8f50-8cab23ff0952 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:44.110553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 70/141] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:43 2022] GET /identity/v3/role_assignments?user.id=3f8861ddb2604de68dd4fa0cfe6aa100&scope.project.id=4fab63748076484db8b585b850783e19&role.id=1b8bdabcd591423d91aaf8f30f7cd6f5 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:44.111762 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b061cb9-d51d-4443-a155-51f055f32d89 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:44.112150 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b061cb9-d51d-4443-a155-51f055f32d89 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:44.119575 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b061cb9-d51d-4443-a155-51f055f32d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:44.155709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-2b061cb9-d51d-4443-a155-51f055f32d89 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:44.157233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2b061cb9-d51d-4443-a155-51f055f32d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:44.217720 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2882dd-06f1-422c-bbaa-b2ddd3c9a324 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:44.273886 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:44.293244 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cff5c-a855-4eaa-9ff7-c6a6d9e4967c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:44.293244 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cff5c-a855-4eaa-9ff7-c6a6d9e4967c None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:44.293244 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cff5c-a855-4eaa-9ff7-c6a6d9e4967c None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:44.293244 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cff5c-a855-4eaa-9ff7-c6a6d9e4967c None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:44.293810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cff5c-a855-4eaa-9ff7-c6a6d9e4967c None admin] RBAC: Adding query filter params (name=member) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:44.294183 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cff5c-a855-4eaa-9ff7-c6a6d9e4967c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:44.295937 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cff5c-a855-4eaa-9ff7-c6a6d9e4967c None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:44.316583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 72/142] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:39:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:44.322418 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cff5c-a855-4eaa-9ff7-c6a6d9e4967c None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:44.339772 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 71/143] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:44.376576 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b061cb9-d51d-4443-a155-51f055f32d89 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:44.408676 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:44.473276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cff5c-a855-4eaa-9ff7-c6a6d9e4967c None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:44.531106 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649bf02-0ae1-4fdc-a145-3d77bd26ca5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:44.531771 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649bf02-0ae1-4fdc-a145-3d77bd26ca5a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:44.532054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649bf02-0ae1-4fdc-a145-3d77bd26ca5a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:44.532331 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649bf02-0ae1-4fdc-a145-3d77bd26ca5a None admin] PATH_INFO: `/v3/users/f8bac1b49f25469994adf34dd214fd0c` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:44.533559 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649bf02-0ae1-4fdc-a145-3d77bd26ca5a None admin] RBAC: Authorizing `identity:get_user(user_id=f8bac1b49f25469994adf34dd214fd0c)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:44.535060 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649bf02-0ae1-4fdc-a145-3d77bd26ca5a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:44.536964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 73/144] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:44 2022] GET /identity/v3/users/f8bac1b49f25469994adf34dd214fd0c => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:44.542533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649bf02-0ae1-4fdc-a145-3d77bd26ca5a None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:44.591210 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b061cb9-d51d-4443-a155-51f055f32d89 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:44.671060 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:44.707169 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f59d20-6ec6-4a17-8efa-710a7e9d3260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:44.707863 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f59d20-6ec6-4a17-8efa-710a7e9d3260 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:44.708157 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f59d20-6ec6-4a17-8efa-710a7e9d3260 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:44.708441 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f59d20-6ec6-4a17-8efa-710a7e9d3260 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:44.733501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f59d20-6ec6-4a17-8efa-710a7e9d3260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:44.738783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-17f59d20-6ec6-4a17-8efa-710a7e9d3260 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:44.738783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:44.738783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:44.738783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:44.738783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:44.738783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:44.738783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:44.738783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:44.738783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:44.738783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:44.738783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:44.738783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:44.738783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:44.738783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:44.738783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:44.738783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:44.739611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:44.739611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:44.739611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:44.739611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:44.739611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:44.739611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:44.739611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:44.739611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:44.739611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:44.739611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:44.739611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:44.739611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:44.739611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:44.739611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:44.739611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:44.739611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:44.740614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:44.740614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:44.740614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:44.740614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:44.740614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:44.740614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:44.740614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:44.740614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:44.740614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:44.740614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:44.740614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:44.740614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:39:44.750819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 72/145] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:44.751970 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f59d20-6ec6-4a17-8efa-710a7e9d3260 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:44.776458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649bf02-0ae1-4fdc-a145-3d77bd26ca5a None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:44.835159 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ec691-15ae-488d-8149-02b23ed6a8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:44.835966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ec691-15ae-488d-8149-02b23ed6a8ed None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:44.836258 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ec691-15ae-488d-8149-02b23ed6a8ed None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:44.836542 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ec691-15ae-488d-8149-02b23ed6a8ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:44.903190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:44.938978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ec691-15ae-488d-8149-02b23ed6a8ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:44.940454 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ec691-15ae-488d-8149-02b23ed6a8ed None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:44.959461 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f59d20-6ec6-4a17-8efa-710a7e9d3260 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:45.036154 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:45.048000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a01379-578c-4549-9394-17a04a8b7d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:45.048656 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a01379-578c-4549-9394-17a04a8b7d15 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:45.048941 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a01379-578c-4549-9394-17a04a8b7d15 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:45.049214 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a01379-578c-4549-9394-17a04a8b7d15 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:45.049939 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a01379-578c-4549-9394-17a04a8b7d15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:45.050327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a01379-578c-4549-9394-17a04a8b7d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:45.051733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a01379-578c-4549-9394-17a04a8b7d15 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:45.070077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 73/146] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:45.071430 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc59450-af75-48f9-a8cc-ef317843bf51 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:45.071981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc59450-af75-48f9-a8cc-ef317843bf51 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:45.072470 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc59450-af75-48f9-a8cc-ef317843bf51 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:45.074624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 74/147] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:45.079630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dafc1-9cd7-4056-8882-1c8e668abf8d None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:45.080135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dafc1-9cd7-4056-8882-1c8e668abf8d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:45.080602 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dafc1-9cd7-4056-8882-1c8e668abf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:45.100265 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-c63dafc1-9cd7-4056-8882-1c8e668abf8d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:45.101903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c63dafc1-9cd7-4056-8882-1c8e668abf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:45.114903 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 74/148] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:45.116038 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ec691-15ae-488d-8149-02b23ed6a8ed None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:45.195164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 75/149] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:45.196093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dafc1-9cd7-4056-8882-1c8e668abf8d None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:45.224691 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ec691-15ae-488d-8149-02b23ed6a8ed None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:45.265815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14406d54-1755-4e30-aac9-af9304f00f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:45.267799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14406d54-1755-4e30-aac9-af9304f00f89 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:45.268299 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14406d54-1755-4e30-aac9-af9304f00f89 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:45.268778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14406d54-1755-4e30-aac9-af9304f00f89 None admin] PATH_INFO: `/v3/users/2e478bb3d9ce498d853319db6606450c` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:45.270220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14406d54-1755-4e30-aac9-af9304f00f89 None admin] RBAC: Authorizing `identity:get_user(user_id=2e478bb3d9ce498d853319db6606450c)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:45.271908 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14406d54-1755-4e30-aac9-af9304f00f89 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:45.274330 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 75/150] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:45 2022] GET /identity/v3/users/2e478bb3d9ce498d853319db6606450c => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:45.275961 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14406d54-1755-4e30-aac9-af9304f00f89 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:45.303496 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:45.327013 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:45.372645 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dafc1-9cd7-4056-8882-1c8e668abf8d None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:45.397956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14406d54-1755-4e30-aac9-af9304f00f89 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:45.422772 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066b01d-a4f8-47e0-a73a-01155d2ee7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:45.424344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066b01d-a4f8-47e0-a73a-01155d2ee7e2 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:45.424850 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066b01d-a4f8-47e0-a73a-01155d2ee7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:45.425602 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066b01d-a4f8-47e0-a73a-01155d2ee7e2 None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:45.427699 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066b01d-a4f8-47e0-a73a-01155d2ee7e2 None admin] RBAC: Authorizing `identity:get_project(project_id=4fab63748076484db8b585b850783e19)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:45.430071 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066b01d-a4f8-47e0-a73a-01155d2ee7e2 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:45.433317 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 76/151] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:45 2022] GET /identity/v3/projects/4fab63748076484db8b585b850783e19 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:45.434561 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066b01d-a4f8-47e0-a73a-01155d2ee7e2 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:45.435140 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c7f5c-ee51-44b0-9152-e8c06cca6b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:45.435911 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c7f5c-ee51-44b0-9152-e8c06cca6b57 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:45.436268 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c7f5c-ee51-44b0-9152-e8c06cca6b57 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:45.436651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c7f5c-ee51-44b0-9152-e8c06cca6b57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:45.437950 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c7f5c-ee51-44b0-9152-e8c06cca6b57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:45.440013 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c7f5c-ee51-44b0-9152-e8c06cca6b57 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:45.441473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 76/152] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:45.442745 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8a1ae-7b6b-4cd7-a7b4-dfe1d75d702a None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:45.443104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8a1ae-7b6b-4cd7-a7b4-dfe1d75d702a None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:45.443456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8a1ae-7b6b-4cd7-a7b4-dfe1d75d702a None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:45.448914 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 77/153] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:45.449816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8a1ae-7b6b-4cd7-a7b4-dfe1d75d702a None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:45.546074 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:45.561352 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8a1ae-7b6b-4cd7-a7b4-dfe1d75d702a None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:45.576170 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066b01d-a4f8-47e0-a73a-01155d2ee7e2 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:45.597524 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a14bf-ef5d-4537-ab5c-25531818cbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:45.598142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a14bf-ef5d-4537-ab5c-25531818cbca None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:45.598443 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a14bf-ef5d-4537-ab5c-25531818cbca None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:45.598720 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a14bf-ef5d-4537-ab5c-25531818cbca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:45.599506 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a14bf-ef5d-4537-ab5c-25531818cbca None admin] RBAC: Adding query filter params (role.id=8303560a3b6948379f524afad4b798d0, scope.project.id=4fab63748076484db8b585b850783e19, user.id=f8bac1b49f25469994adf34dd214fd0c) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:45.599965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a14bf-ef5d-4537-ab5c-25531818cbca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:45.601407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a14bf-ef5d-4537-ab5c-25531818cbca None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:45.608632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 78/154] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:45 2022] GET /identity/v3/role_assignments?user.id=f8bac1b49f25469994adf34dd214fd0c&scope.project.id=4fab63748076484db8b585b850783e19&role.id=8303560a3b6948379f524afad4b798d0 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:45.609425 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a14bf-ef5d-4537-ab5c-25531818cbca None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:45.630513 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:45.635499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213ed62-8fcb-4028-87c8-9341d7516c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:45.636238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213ed62-8fcb-4028-87c8-9341d7516c42 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:45.636632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213ed62-8fcb-4028-87c8-9341d7516c42 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:45.636915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213ed62-8fcb-4028-87c8-9341d7516c42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:45.718567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213ed62-8fcb-4028-87c8-9341d7516c42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:45.721020 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213ed62-8fcb-4028-87c8-9341d7516c42 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:45.866155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 77/155] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:45.867676 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee0524-8678-46cd-b52e-d440a77778f2 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:45.868034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee0524-8678-46cd-b52e-d440a77778f2 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:45.868403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee0524-8678-46cd-b52e-d440a77778f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:45.869490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a14bf-ef5d-4537-ab5c-25531818cbca None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:45.889343 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-62ee0524-8678-46cd-b52e-d440a77778f2 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:45.890558 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-62ee0524-8678-46cd-b52e-d440a77778f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:45.908859 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcab59b-1dd4-400b-bd88-4172f8064a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:45.909602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcab59b-1dd4-400b-bd88-4172f8064a4f None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:45.909888 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcab59b-1dd4-400b-bd88-4172f8064a4f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:45.910162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcab59b-1dd4-400b-bd88-4172f8064a4f None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:45.910898 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcab59b-1dd4-400b-bd88-4172f8064a4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:45.912627 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcab59b-1dd4-400b-bd88-4172f8064a4f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:45.921930 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:45.981126 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 78/156] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:45.981922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee0524-8678-46cd-b52e-d440a77778f2 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:46.039306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 79/157] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jul 26 14:39:45 2022] POST /identity/v3/users => generated 283 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:46.046419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcab59b-1dd4-400b-bd88-4172f8064a4f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:46.072854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:46.125408 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee0524-8678-46cd-b52e-d440a77778f2 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:46.165950 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb258a-c58e-460e-a4ba-878156b441d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:46.166646 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb258a-c58e-460e-a4ba-878156b441d1 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:46.166937 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb258a-c58e-460e-a4ba-878156b441d1 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:46.167224 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb258a-c58e-460e-a4ba-878156b441d1 None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:46.168444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb258a-c58e-460e-a4ba-878156b441d1 None admin] RBAC: Authorizing `identity:get_project(project_id=4fab63748076484db8b585b850783e19)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:46.170003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb258a-c58e-460e-a4ba-878156b441d1 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:46.177128 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 79/158] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:45 2022] GET /identity/v3/projects/4fab63748076484db8b585b850783e19 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:46.178735 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb258a-c58e-460e-a4ba-878156b441d1 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:46.243153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:46.247261 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcab59b-1dd4-400b-bd88-4172f8064a4f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:46.299815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a9784-d1e1-4dac-a95a-ce4e148844cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:46.300483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a9784-d1e1-4dac-a95a-ce4e148844cb None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:46.300773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a9784-d1e1-4dac-a95a-ce4e148844cb None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:46.301059 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a9784-d1e1-4dac-a95a-ce4e148844cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:46.316240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a9784-d1e1-4dac-a95a-ce4e148844cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:46.322169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-f10a9784-d1e1-4dac-a95a-ce4e148844cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:39:46.322169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:46.322169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:46.322169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:46.322169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:46.322169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:46.322169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:46.322169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:46.322169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:46.322169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:46.322169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:46.322169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:46.322169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:46.322169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:46.322169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:46.322169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:46.323264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:46.323264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:46.323264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:46.323264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:46.323264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:46.323264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:46.323264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:46.323264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:46.323264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:46.323264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:46.323264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:46.323264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:46.323264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:46.323264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:46.323264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:46.323264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:46.324116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:46.324116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:46.324116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:46.324116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:46.324116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:46.324116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:46.324116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:46.324116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:46.324116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:46.324116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:46.324116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:39:46.324116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:39:46.324116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 80/159] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:46.328872 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a9784-d1e1-4dac-a95a-ce4e148844cb None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:46.342787 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb258a-c58e-460e-a4ba-878156b441d1 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:46.389294 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6779ef7-e4f6-4f03-8c35-6276405e8275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:46.390973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6779ef7-e4f6-4f03-8c35-6276405e8275 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:46.391442 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6779ef7-e4f6-4f03-8c35-6276405e8275 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:46.392008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6779ef7-e4f6-4f03-8c35-6276405e8275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:46.393136 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6779ef7-e4f6-4f03-8c35-6276405e8275 None admin] RBAC: Adding query filter params (role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.project.id=4fab63748076484db8b585b850783e19, user.id=2e478bb3d9ce498d853319db6606450c) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:46.393864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6779ef7-e4f6-4f03-8c35-6276405e8275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:46.395925 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6779ef7-e4f6-4f03-8c35-6276405e8275 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:46.414590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 80/160] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:46 2022] GET /identity/v3/role_assignments?user.id=2e478bb3d9ce498d853319db6606450c&scope.project.id=4fab63748076484db8b585b850783e19&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:46.421090 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:46.459783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a9784-d1e1-4dac-a95a-ce4e148844cb None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:46.501095 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ee264-a96e-466c-a8a5-9d9f517afb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:46.501993 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ee264-a96e-466c-a8a5-9d9f517afb16 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:46.502516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ee264-a96e-466c-a8a5-9d9f517afb16 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:46.502940 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ee264-a96e-466c-a8a5-9d9f517afb16 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:46.503866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ee264-a96e-466c-a8a5-9d9f517afb16 None admin] RBAC: Adding query filter params (name=member) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:46.504323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ee264-a96e-466c-a8a5-9d9f517afb16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:46.505910 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ee264-a96e-466c-a8a5-9d9f517afb16 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:46.515964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 81/161] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:39:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:46.523165 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6779ef7-e4f6-4f03-8c35-6276405e8275 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:46.634281 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:46.641661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6779ef7-e4f6-4f03-8c35-6276405e8275 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:46.671756 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0f61e-fe5c-4646-b42b-826f0f1dc6c8 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:46.672191 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0f61e-fe5c-4646-b42b-826f0f1dc6c8 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:46.672322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0f61e-fe5c-4646-b42b-826f0f1dc6c8 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:46.673972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 82/162] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:46.680133 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e280abf-048e-4026-847f-63ef53109660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:46.680799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280abf-048e-4026-847f-63ef53109660 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:46.681120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280abf-048e-4026-847f-63ef53109660 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:46.681406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280abf-048e-4026-847f-63ef53109660 None admin] PATH_INFO: `/v3/users/f8bac1b49f25469994adf34dd214fd0c` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:46.681699 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb442d8b-e6d9-416d-bd0a-a389593db185 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:46.681985 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb442d8b-e6d9-416d-bd0a-a389593db185 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:46.682277 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb442d8b-e6d9-416d-bd0a-a389593db185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:46.682676 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e280abf-048e-4026-847f-63ef53109660 None admin] RBAC: Authorizing `identity:get_user(user_id=f8bac1b49f25469994adf34dd214fd0c)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:46.684152 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e280abf-048e-4026-847f-63ef53109660 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:46.685789 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 81/163] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:46 2022] GET /identity/v3/users/f8bac1b49f25469994adf34dd214fd0c => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:46.694900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e280abf-048e-4026-847f-63ef53109660 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:46.710608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-cb442d8b-e6d9-416d-bd0a-a389593db185 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:46.712988 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-cb442d8b-e6d9-416d-bd0a-a389593db185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:46.803200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 83/164] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:46.826498 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb442d8b-e6d9-416d-bd0a-a389593db185 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:46.847299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e280abf-048e-4026-847f-63ef53109660 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:46.890378 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5bbaa-5fb6-4647-bd30-c40a2d57034a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:46.890378 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5bbaa-5fb6-4647-bd30-c40a2d57034a None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:46.890764 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5bbaa-5fb6-4647-bd30-c40a2d57034a None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:46.890853 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5bbaa-5fb6-4647-bd30-c40a2d57034a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:46.906563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:46.933113 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:46.967559 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb442d8b-e6d9-416d-bd0a-a389593db185 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:46.991393 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5bbaa-5fb6-4647-bd30-c40a2d57034a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:46.992886 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5bbaa-5fb6-4647-bd30-c40a2d57034a None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:47.009977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43094f-108f-4cc1-838f-e614114b87bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:47.010660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43094f-108f-4cc1-838f-e614114b87bc None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:47.010946 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43094f-108f-4cc1-838f-e614114b87bc None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:47.011219 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43094f-108f-4cc1-838f-e614114b87bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:47.022064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43094f-108f-4cc1-838f-e614114b87bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:47.027601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-cc43094f-108f-4cc1-838f-e614114b87bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:39:47.027601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:47.027601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:47.027601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:47.027601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:47.027601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:47.027601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:47.027601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:47.027601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:47.027601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:47.027601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:47.027601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:47.027601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:47.027601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:47.027601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:47.027601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:47.028486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:47.028486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:47.028486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:47.028486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:47.028486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:47.028486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:47.028486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:47.028486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:47.028486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:47.028486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:47.028486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:47.028486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:47.028486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:47.028486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:47.028486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:47.028486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:47.029459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:47.029459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:47.029459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:47.029459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:47.029459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:47.029459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:47.029459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:47.029459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:47.029459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:47.029459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:47.029459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:39:47.029459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:39:47.029459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 84/165] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:39:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:47.030259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692bda1-1a12-428c-b65e-742bcc72c194 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:47.034629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692bda1-1a12-428c-b65e-742bcc72c194 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:47.034923 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692bda1-1a12-428c-b65e-742bcc72c194 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:47.036356 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 85/166] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:47.039063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692bda1-1a12-428c-b65e-742bcc72c194 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:47.133204 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 82/167] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:39:47.135745 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4ac1c-136a-4528-8553-fb58cf1eb882 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:47.136660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4ac1c-136a-4528-8553-fb58cf1eb882 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:47.137094 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4ac1c-136a-4528-8553-fb58cf1eb882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:47.161263 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-27c4ac1c-136a-4528-8553-fb58cf1eb882 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:47.163486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-27c4ac1c-136a-4528-8553-fb58cf1eb882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:47.175461 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692bda1-1a12-428c-b65e-742bcc72c194 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:47.223449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:47.238804 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:47.248166 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 83/168] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:47.249788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4ac1c-136a-4528-8553-fb58cf1eb882 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:47.283421 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5232c-7321-44fe-ad4d-d15a1e0104a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:47.284065 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5232c-7321-44fe-ad4d-d15a1e0104a2 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:47.284354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5232c-7321-44fe-ad4d-d15a1e0104a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:47.284670 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5232c-7321-44fe-ad4d-d15a1e0104a2 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:47.285401 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5232c-7321-44fe-ad4d-d15a1e0104a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:47.285706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5232c-7321-44fe-ad4d-d15a1e0104a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:47.287137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5232c-7321-44fe-ad4d-d15a1e0104a2 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:47.308576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 86/169] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:47.309439 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5232c-7321-44fe-ad4d-d15a1e0104a2 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:47.364352 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4ac1c-136a-4528-8553-fb58cf1eb882 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:47.402472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311a9b4-49ad-4c73-8401-470d551a4113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:47.403040 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311a9b4-49ad-4c73-8401-470d551a4113 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:47.403340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311a9b4-49ad-4c73-8401-470d551a4113 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:47.403653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311a9b4-49ad-4c73-8401-470d551a4113 None admin] PATH_INFO: `/v3/projects/85fcebc70a724090b32778b95e34cc87` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:47.404950 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311a9b4-49ad-4c73-8401-470d551a4113 None admin] RBAC: Authorizing `identity:get_project(project_id=85fcebc70a724090b32778b95e34cc87)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:47.406424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311a9b4-49ad-4c73-8401-470d551a4113 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:47.408275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 84/170] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:47 2022] GET /identity/v3/projects/85fcebc70a724090b32778b95e34cc87 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:47.409184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311a9b4-49ad-4c73-8401-470d551a4113 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:47.428009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5232c-7321-44fe-ad4d-d15a1e0104a2 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:47.483092 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9fc55-1750-4682-b0db-a5e6bacc20ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:47.484042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9fc55-1750-4682-b0db-a5e6bacc20ac None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:47.484485 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9fc55-1750-4682-b0db-a5e6bacc20ac None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:47.484630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:47.484764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9fc55-1750-4682-b0db-a5e6bacc20ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:47.504217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9fc55-1750-4682-b0db-a5e6bacc20ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:47.509743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-0ff9fc55-1750-4682-b0db-a5e6bacc20ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:39:47.509743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:47.509743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:47.509743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:47.509743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:47.509743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:47.509743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:47.509743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:47.509743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:47.509743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:47.509743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:47.509743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:47.509743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:47.509743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:47.509743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:47.509743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:47.510819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:47.510819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:47.510819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:47.510819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:47.510819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:47.510819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:47.510819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:47.510819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:47.510819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:47.510819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:47.510819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:47.510819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:47.510819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:47.510819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:47.510819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:47.510819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:47.511584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:47.511584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:47.511584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:47.511584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:47.511584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:47.511584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:47.511584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:47.511584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:47.511584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:47.511584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:47.511584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:39:47.511584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:39:47.515916 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 87/171] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:47.517457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9fc55-1750-4682-b0db-a5e6bacc20ac None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:47.537567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311a9b4-49ad-4c73-8401-470d551a4113 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:47.595001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:47.610504 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4bb27-9998-43d3-a611-da0ea0dfdefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:47.611174 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4bb27-9998-43d3-a611-da0ea0dfdefe None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:47.611471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4bb27-9998-43d3-a611-da0ea0dfdefe None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:47.612101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4bb27-9998-43d3-a611-da0ea0dfdefe None admin] PATH_INFO: `/v3/users/f8bac1b49f25469994adf34dd214fd0c` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:47.613609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4bb27-9998-43d3-a611-da0ea0dfdefe None admin] RBAC: Authorizing `identity:get_user(user_id=f8bac1b49f25469994adf34dd214fd0c)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:47.615302 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4bb27-9998-43d3-a611-da0ea0dfdefe None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:47.619062 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 85/172] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:47 2022] GET /identity/v3/users/f8bac1b49f25469994adf34dd214fd0c => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:47.620094 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4bb27-9998-43d3-a611-da0ea0dfdefe None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:47.699642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9fc55-1750-4682-b0db-a5e6bacc20ac None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:47.747689 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cc403-37ce-4c10-b265-4eea22ee9693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:47.748324 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cc403-37ce-4c10-b265-4eea22ee9693 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:47.752504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cc403-37ce-4c10-b265-4eea22ee9693 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:47.752804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cc403-37ce-4c10-b265-4eea22ee9693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:47.753623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cc403-37ce-4c10-b265-4eea22ee9693 None admin] RBAC: Adding query filter params (role.id=8303560a3b6948379f524afad4b798d0, scope.project.id=85fcebc70a724090b32778b95e34cc87, user.id=f8bac1b49f25469994adf34dd214fd0c) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:47.753937 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cc403-37ce-4c10-b265-4eea22ee9693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:47.755440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cc403-37ce-4c10-b265-4eea22ee9693 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:47.772815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 88/173] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:47 2022] GET /identity/v3/role_assignments?user.id=f8bac1b49f25469994adf34dd214fd0c&scope.project.id=85fcebc70a724090b32778b95e34cc87&role.id=8303560a3b6948379f524afad4b798d0 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:47.773489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cc403-37ce-4c10-b265-4eea22ee9693 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:47.798345 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4bb27-9998-43d3-a611-da0ea0dfdefe None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:47.829817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:47.838490 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bf674-f78b-44ec-978f-b353e16e2619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:47.839257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bf674-f78b-44ec-978f-b353e16e2619 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:47.839544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bf674-f78b-44ec-978f-b353e16e2619 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:47.843339 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bf674-f78b-44ec-978f-b353e16e2619 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:47.843339 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bf674-f78b-44ec-978f-b353e16e2619 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:47.843339 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bf674-f78b-44ec-978f-b353e16e2619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:47.843339 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bf674-f78b-44ec-978f-b353e16e2619 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:47.853697 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 86/174] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:39:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:47.859421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bf674-f78b-44ec-978f-b353e16e2619 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:47.986759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bf674-f78b-44ec-978f-b353e16e2619 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:48.026091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c9259-1dbc-441e-a289-35fa9577ca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:48.026837 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c9259-1dbc-441e-a289-35fa9577ca02 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:48.027130 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c9259-1dbc-441e-a289-35fa9577ca02 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:48.027397 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c9259-1dbc-441e-a289-35fa9577ca02 None admin] PATH_INFO: `/v3/users/3f8861ddb2604de68dd4fa0cfe6aa100` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:48.028615 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c9259-1dbc-441e-a289-35fa9577ca02 None admin] RBAC: Authorizing `identity:get_user(user_id=3f8861ddb2604de68dd4fa0cfe6aa100)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:48.030165 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c9259-1dbc-441e-a289-35fa9577ca02 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:48.036522 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 87/175] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:47 2022] GET /identity/v3/users/3f8861ddb2604de68dd4fa0cfe6aa100 => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:48.038027 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c9259-1dbc-441e-a289-35fa9577ca02 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:48.048404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cc403-37ce-4c10-b265-4eea22ee9693 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:48.058774 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:48.103899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:48.147648 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d9286-3858-4dba-afd0-d3bc5c3898a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:48.148294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d9286-3858-4dba-afd0-d3bc5c3898a1 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:48.148582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d9286-3858-4dba-afd0-d3bc5c3898a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:48.148865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d9286-3858-4dba-afd0-d3bc5c3898a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:48.151034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c9259-1dbc-441e-a289-35fa9577ca02 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:48.188028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9491c8-68d8-41fa-a481-fcec46c18add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:48.188920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9491c8-68d8-41fa-a481-fcec46c18add None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:48.189420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9491c8-68d8-41fa-a481-fcec46c18add None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:48.189840 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9491c8-68d8-41fa-a481-fcec46c18add None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:48.191221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9491c8-68d8-41fa-a481-fcec46c18add None admin] RBAC: Authorizing `identity:get_project(project_id=4fab63748076484db8b585b850783e19)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:48.192950 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9491c8-68d8-41fa-a481-fcec46c18add None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:48.194922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 88/176] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:48 2022] GET /identity/v3/projects/4fab63748076484db8b585b850783e19 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:48.200875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9491c8-68d8-41fa-a481-fcec46c18add None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:48.301226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d9286-3858-4dba-afd0-d3bc5c3898a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:48.303090 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d9286-3858-4dba-afd0-d3bc5c3898a1 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:48.313824 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9491c8-68d8-41fa-a481-fcec46c18add None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:48.343011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:48.352591 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71891e-de89-4716-84a5-9b8a18c5f3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:48.354178 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71891e-de89-4716-84a5-9b8a18c5f3d4 None admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:48.354737 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71891e-de89-4716-84a5-9b8a18c5f3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:48.355160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71891e-de89-4716-84a5-9b8a18c5f3d4 None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19/users/3f8861ddb2604de68dd4fa0cfe6aa100/roles/1b8bdabcd591423d91aaf8f30f7cd6f5` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:48.357295 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71891e-de89-4716-84a5-9b8a18c5f3d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fab63748076484db8b585b850783e19, user_id=3f8861ddb2604de68dd4fa0cfe6aa100, role_id=1b8bdabcd591423d91aaf8f30f7cd6f5)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:48.359187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71891e-de89-4716-84a5-9b8a18c5f3d4 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:48.438148 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 89/177] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:48.443192 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d9286-3858-4dba-afd0-d3bc5c3898a1 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:48.453368 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:48.478867 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 89/178] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:39:48 2022] PUT /identity/v3/projects/4fab63748076484db8b585b850783e19/users/3f8861ddb2604de68dd4fa0cfe6aa100/roles/1b8bdabcd591423d91aaf8f30f7cd6f5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 14:39:48.561879 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d9286-3858-4dba-afd0-d3bc5c3898a1 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:48.613035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693715f-fbb4-40cb-a471-c4c4187d74ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:48.613704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693715f-fbb4-40cb-a471-c4c4187d74ba None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:48.613992 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693715f-fbb4-40cb-a471-c4c4187d74ba None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:48.614270 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693715f-fbb4-40cb-a471-c4c4187d74ba None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:48.617125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693715f-fbb4-40cb-a471-c4c4187d74ba None admin] RBAC: Authorizing `identity:get_project(project_id=4fab63748076484db8b585b850783e19)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:48.619340 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693715f-fbb4-40cb-a471-c4c4187d74ba None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:48.621349 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 90/179] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:48 2022] GET /identity/v3/projects/4fab63748076484db8b585b850783e19 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:48.627228 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71891e-de89-4716-84a5-9b8a18c5f3d4 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:48.757858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71891e-de89-4716-84a5-9b8a18c5f3d4 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:48.796521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162df04-84af-4d3e-b629-b09b3e0edd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:48.797160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162df04-84af-4d3e-b629-b09b3e0edd9c None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:48.797451 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162df04-84af-4d3e-b629-b09b3e0edd9c None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:48.797730 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162df04-84af-4d3e-b629-b09b3e0edd9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:48.798572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162df04-84af-4d3e-b629-b09b3e0edd9c None admin] RBAC: Adding query filter params (role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846, scope.project.id=4fab63748076484db8b585b850783e19, user.id=f8bac1b49f25469994adf34dd214fd0c) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:48.799099 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162df04-84af-4d3e-b629-b09b3e0edd9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:48.800339 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162df04-84af-4d3e-b629-b09b3e0edd9c None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:48.806709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 90/180] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:48 2022] GET /identity/v3/role_assignments?user.id=f8bac1b49f25469994adf34dd214fd0c&scope.project.id=4fab63748076484db8b585b850783e19&role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:49.083507 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcc851-865f-4bc8-a72d-9a24df13ab1b None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:49.084079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcc851-865f-4bc8-a72d-9a24df13ab1b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:49.084315 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcc851-865f-4bc8-a72d-9a24df13ab1b None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:49.085918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 91/181] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:49.091421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77a52a-e2eb-4821-8bf0-3dde2978fcb8 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:49.091718 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77a52a-e2eb-4821-8bf0-3dde2978fcb8 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:49.092001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77a52a-e2eb-4821-8bf0-3dde2978fcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:49.113779 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-ac77a52a-e2eb-4821-8bf0-3dde2978fcb8 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:49.115002 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ac77a52a-e2eb-4821-8bf0-3dde2978fcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:49.173808 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:49.200260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 91/182] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:49.225298 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcc851-865f-4bc8-a72d-9a24df13ab1b None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:49.323376 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:49.355194 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcc851-865f-4bc8-a72d-9a24df13ab1b None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:49.392304 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee56d7a-d1d1-47c3-ad5e-e17175a3a7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:49.392962 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee56d7a-d1d1-47c3-ad5e-e17175a3a7ec None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:49.393252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee56d7a-d1d1-47c3-ad5e-e17175a3a7ec None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:49.393529 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee56d7a-d1d1-47c3-ad5e-e17175a3a7ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:49.404560 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee56d7a-d1d1-47c3-ad5e-e17175a3a7ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:49.409495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-1ee56d7a-d1d1-47c3-ad5e-e17175a3a7ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:49.409495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:49.409495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:49.409495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:49.409495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:49.409495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:49.409495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:49.409495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:49.409495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:49.409495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:49.409495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:49.409495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:49.409495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:49.409495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:49.409495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:49.409495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:49.410345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:49.410345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:49.410345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:49.410345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:49.410345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:49.410345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:49.410345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:49.410345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:49.410345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:49.410345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:49.410345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:49.410345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:49.410345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:49.410345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:49.410345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:49.410345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:49.411150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:49.411150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:49.411150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:49.411150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:49.411150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:49.411150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:49.411150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:49.411150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:49.411150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:49.411150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:49.411150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:49.411150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:39:49.411150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 92/183] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:49.418630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77a52a-e2eb-4821-8bf0-3dde2978fcb8 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:49.428250 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc78565-08b8-4e7f-b308-9150d982adcb None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:49.428250 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc78565-08b8-4e7f-b308-9150d982adcb None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:49.428250 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc78565-08b8-4e7f-b308-9150d982adcb None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:49.428250 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 93/184] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:39:49.434125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b6d66-9e6c-4f9b-8986-d4878f05eba8 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:49.434620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b6d66-9e6c-4f9b-8986-d4878f05eba8 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:49.435040 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b6d66-9e6c-4f9b-8986-d4878f05eba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:49.455891 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-5f7b6d66-9e6c-4f9b-8986-d4878f05eba8 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:49.457364 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-5f7b6d66-9e6c-4f9b-8986-d4878f05eba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:49.530603 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77a52a-e2eb-4821-8bf0-3dde2978fcb8 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:49.543952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 94/185] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:39:49.543952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b30dee-0ac4-48dd-a55a-793e29b458dc None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:49.543952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b30dee-0ac4-48dd-a55a-793e29b458dc None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:49.543952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b30dee-0ac4-48dd-a55a-793e29b458dc None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:49.543952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 95/186] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:49.549247 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676b27a-63ea-427c-95c5-e2363f375eb9 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:49.549544 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676b27a-63ea-427c-95c5-e2363f375eb9 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:49.549824 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676b27a-63ea-427c-95c5-e2363f375eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:49.568505 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d04ac-e38f-4e11-ab25-dd2f3bff99d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:49.568867 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-8676b27a-63ea-427c-95c5-e2363f375eb9 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:49.569177 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d04ac-e38f-4e11-ab25-dd2f3bff99d4 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:49.569466 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d04ac-e38f-4e11-ab25-dd2f3bff99d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:49.569749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d04ac-e38f-4e11-ab25-dd2f3bff99d4 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:49.570056 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8676b27a-63ea-427c-95c5-e2363f375eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:49.570514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d04ac-e38f-4e11-ab25-dd2f3bff99d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:49.570827 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d04ac-e38f-4e11-ab25-dd2f3bff99d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:49.572212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d04ac-e38f-4e11-ab25-dd2f3bff99d4 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:49.580999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 92/187] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:49.585614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d04ac-e38f-4e11-ab25-dd2f3bff99d4 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:49.635302 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:49.639404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:49.648022 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 96/188] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:39:49.656325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676b27a-63ea-427c-95c5-e2363f375eb9 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:49.707194 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d04ac-e38f-4e11-ab25-dd2f3bff99d4 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:49.743390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257d6b9-b76d-438d-8d59-1165eaa645e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:49.744468 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257d6b9-b76d-438d-8d59-1165eaa645e7 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:49.744862 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257d6b9-b76d-438d-8d59-1165eaa645e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:49.745147 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257d6b9-b76d-438d-8d59-1165eaa645e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:49.746310 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257d6b9-b76d-438d-8d59-1165eaa645e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:49.747804 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257d6b9-b76d-438d-8d59-1165eaa645e7 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:49.753967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 93/189] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:49.753967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257d6b9-b76d-438d-8d59-1165eaa645e7 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:49.762674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676b27a-63ea-427c-95c5-e2363f375eb9 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:49.796740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f857ed8-f0d0-4e05-8ff8-622f7d0ce65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:49.797400 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f857ed8-f0d0-4e05-8ff8-622f7d0ce65e None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:49.797684 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f857ed8-f0d0-4e05-8ff8-622f7d0ce65e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:49.797963 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f857ed8-f0d0-4e05-8ff8-622f7d0ce65e None admin] PATH_INFO: `/v3/users/c264c60f8984431e8b67b5c94ebbc926` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:49.813740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f857ed8-f0d0-4e05-8ff8-622f7d0ce65e None admin] RBAC: Authorizing `identity:get_user(user_id=c264c60f8984431e8b67b5c94ebbc926)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:49.815451 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f857ed8-f0d0-4e05-8ff8-622f7d0ce65e None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:49.817279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 97/190] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:49 2022] GET /identity/v3/users/c264c60f8984431e8b67b5c94ebbc926 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:49.818014 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f857ed8-f0d0-4e05-8ff8-622f7d0ce65e None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:49.866332 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257d6b9-b76d-438d-8d59-1165eaa645e7 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:49.877700 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:49.879692 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:49.902718 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39700e02-1cda-42ff-b2e2-a00188557270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:49.903308 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39700e02-1cda-42ff-b2e2-a00188557270 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:49.903595 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39700e02-1cda-42ff-b2e2-a00188557270 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:49.903874 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39700e02-1cda-42ff-b2e2-a00188557270 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:49.916272 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39700e02-1cda-42ff-b2e2-a00188557270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:49.921384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-39700e02-1cda-42ff-b2e2-a00188557270 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:39:49.921384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:49.921384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:49.921384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:49.921384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:49.921384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:49.921384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:49.921384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:49.921384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:49.921384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:49.921384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:49.921384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:49.921384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:49.921384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:49.921384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:49.921384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:49.922501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:49.922501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:49.922501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:49.922501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:49.922501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:49.922501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:49.922501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:49.922501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:49.922501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:49.922501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:49.922501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:49.922501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:49.922501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:49.922501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:49.922501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:49.922501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:49.923293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:49.923293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:49.923293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:49.923293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:49.923293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:49.923293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:49.923293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:49.923293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:49.923293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:49.923293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:49.923293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:39:49.923293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:39:49.923293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 94/191] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:39:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:49.924957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39700e02-1cda-42ff-b2e2-a00188557270 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:49.935619 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f857ed8-f0d0-4e05-8ff8-622f7d0ce65e None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:49.976106 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7715ef-d076-4736-b01d-de1675deaa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:49.976889 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7715ef-d076-4736-b01d-de1675deaa89 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:49.976889 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7715ef-d076-4736-b01d-de1675deaa89 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:49.977424 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7715ef-d076-4736-b01d-de1675deaa89 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:49.978025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7715ef-d076-4736-b01d-de1675deaa89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:49.979525 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7715ef-d076-4736-b01d-de1675deaa89 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:50.035379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39700e02-1cda-42ff-b2e2-a00188557270 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:50.067831 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0abcf-cff0-4563-bcfd-4ca8f4c82441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:50.068455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0abcf-cff0-4563-bcfd-4ca8f4c82441 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:50.068735 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0abcf-cff0-4563-bcfd-4ca8f4c82441 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:50.069014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0abcf-cff0-4563-bcfd-4ca8f4c82441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:50.108996 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:50.139851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0abcf-cff0-4563-bcfd-4ca8f4c82441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:50.141390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0abcf-cff0-4563-bcfd-4ca8f4c82441 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:50.167722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 98/192] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jul 26 14:39:49 2022] POST /identity/v3/users => generated 297 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:50.167722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7715ef-d076-4736-b01d-de1675deaa89 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:50.292681 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 95/193] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:50.300033 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0abcf-cff0-4563-bcfd-4ca8f4c82441 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:50.323997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7715ef-d076-4736-b01d-de1675deaa89 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:50.337908 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:50.385618 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1c2b9-ffc0-4e4d-98d3-dd6407b408fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:50.386544 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1c2b9-ffc0-4e4d-98d3-dd6407b408fa None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:50.387011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1c2b9-ffc0-4e4d-98d3-dd6407b408fa None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:50.387454 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1c2b9-ffc0-4e4d-98d3-dd6407b408fa None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:50.388434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1c2b9-ffc0-4e4d-98d3-dd6407b408fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:50.388884 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1c2b9-ffc0-4e4d-98d3-dd6407b408fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:50.390489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1c2b9-ffc0-4e4d-98d3-dd6407b408fa None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:50.401671 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 99/194] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:50.412309 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:50.413961 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1c2b9-ffc0-4e4d-98d3-dd6407b408fa None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:50.448967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0abcf-cff0-4563-bcfd-4ca8f4c82441 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:50.506255 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801d218-f520-4447-aa0e-5db0fd64c75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:50.507121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801d218-f520-4447-aa0e-5db0fd64c75a None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:50.507454 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801d218-f520-4447-aa0e-5db0fd64c75a None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:50.508027 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801d218-f520-4447-aa0e-5db0fd64c75a None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:50.511016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801d218-f520-4447-aa0e-5db0fd64c75a None admin] RBAC: Authorizing `identity:get_project(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:50.512489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801d218-f520-4447-aa0e-5db0fd64c75a None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:50.514413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 96/195] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:50 2022] GET /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:50.524591 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801d218-f520-4447-aa0e-5db0fd64c75a None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:50.568143 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1c2b9-ffc0-4e4d-98d3-dd6407b408fa None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:50.624092 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2a5bc-574c-46aa-8993-e0205b99a46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:50.625886 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2a5bc-574c-46aa-8993-e0205b99a46f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:50.626329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2a5bc-574c-46aa-8993-e0205b99a46f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:50.626847 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2a5bc-574c-46aa-8993-e0205b99a46f None admin] PATH_INFO: `/v3/users/c264c60f8984431e8b67b5c94ebbc926` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:50.628832 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2a5bc-574c-46aa-8993-e0205b99a46f None admin] RBAC: Authorizing `identity:get_user(user_id=c264c60f8984431e8b67b5c94ebbc926)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:50.631054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2a5bc-574c-46aa-8993-e0205b99a46f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:50.633796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 100/196] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:50 2022] GET /identity/v3/users/c264c60f8984431e8b67b5c94ebbc926 => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:50.640360 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2a5bc-574c-46aa-8993-e0205b99a46f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:50.681480 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801d218-f520-4447-aa0e-5db0fd64c75a None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:50.708594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:50.755872 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582265e-eb21-4ee3-95c7-860f53ba88e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:50.756618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582265e-eb21-4ee3-95c7-860f53ba88e2 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:50.756898 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582265e-eb21-4ee3-95c7-860f53ba88e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:50.757171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582265e-eb21-4ee3-95c7-860f53ba88e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:50.757970 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582265e-eb21-4ee3-95c7-860f53ba88e2 None admin] RBAC: Adding query filter params (role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e, user.id=c264c60f8984431e8b67b5c94ebbc926) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:50.758278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582265e-eb21-4ee3-95c7-860f53ba88e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:50.760341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582265e-eb21-4ee3-95c7-860f53ba88e2 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:50.779437 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 97/197] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:50 2022] GET /identity/v3/role_assignments?user.id=c264c60f8984431e8b67b5c94ebbc926&scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:50.815305 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2a5bc-574c-46aa-8993-e0205b99a46f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:50.889052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c5060-d73a-4079-bf8f-09127a72e9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:50.889781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c5060-d73a-4079-bf8f-09127a72e9fd None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:50.890061 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c5060-d73a-4079-bf8f-09127a72e9fd None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:50.890332 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c5060-d73a-4079-bf8f-09127a72e9fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:50.988164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90831f-1e50-4a4d-a6d7-b8d88c0f7de2 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:50.988656 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90831f-1e50-4a4d-a6d7-b8d88c0f7de2 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:50.988656 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90831f-1e50-4a4d-a6d7-b8d88c0f7de2 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:50.990149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 98/198] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:39:50.996401 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d760e6-599e-46b5-bc19-38e4e6bea0d4 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:50.996711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d760e6-599e-46b5-bc19-38e4e6bea0d4 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:50.996949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d760e6-599e-46b5-bc19-38e4e6bea0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:51.002457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c5060-d73a-4079-bf8f-09127a72e9fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:51.004462 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c5060-d73a-4079-bf8f-09127a72e9fd None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:51.005697 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:51.026430 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-f2d760e6-599e-46b5-bc19-38e4e6bea0d4 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:51.026430 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-f2d760e6-599e-46b5-bc19-38e4e6bea0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:51.084704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:51.098361 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 99/199] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:39:51.128933 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d760e6-599e-46b5-bc19-38e4e6bea0d4 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:51.194284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 101/200] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:39:51.204425 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c5060-d73a-4079-bf8f-09127a72e9fd None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:51.254131 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d760e6-599e-46b5-bc19-38e4e6bea0d4 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:51.297486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:51.312184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a3046-a1ac-4b7b-8d3e-a7893f1e05f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:51.312853 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a3046-a1ac-4b7b-8d3e-a7893f1e05f1 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:51.313135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a3046-a1ac-4b7b-8d3e-a7893f1e05f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:51.313409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a3046-a1ac-4b7b-8d3e-a7893f1e05f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:51.334453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a3046-a1ac-4b7b-8d3e-a7893f1e05f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:51.347308 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c5060-d73a-4079-bf8f-09127a72e9fd None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:51.348034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-7e3a3046-a1ac-4b7b-8d3e-a7893f1e05f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:39:51.348034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:51.348034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:51.348034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:51.348034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:51.348034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:51.348034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:51.348034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:51.348034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:51.348034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:51.348034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:51.348034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:51.348034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:51.348034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:51.348034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:51.348034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:51.348921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:51.348921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:51.348921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:51.348921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:51.348921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:51.348921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:51.348921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:51.348921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:51.348921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:51.348921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:51.348921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:51.348921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:51.348921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:51.348921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:51.348921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:51.348921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:51.349694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:51.349694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:51.349694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:51.349694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:51.349694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:51.349694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:51.349694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:51.349694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:51.349694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:51.349694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:51.349694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:39:51.349694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:39:51.350374 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 100/201] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:51.357796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a3046-a1ac-4b7b-8d3e-a7893f1e05f1 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:51.404080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fec7a-c94c-41af-991c-6baa537981d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:51.404751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fec7a-c94c-41af-991c-6baa537981d2 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:51.405036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fec7a-c94c-41af-991c-6baa537981d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:51.405373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fec7a-c94c-41af-991c-6baa537981d2 None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:51.411200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fec7a-c94c-41af-991c-6baa537981d2 None admin] RBAC: Authorizing `identity:get_project(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:51.413025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fec7a-c94c-41af-991c-6baa537981d2 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:51.415192 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 102/202] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:51 2022] GET /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:51.420755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fec7a-c94c-41af-991c-6baa537981d2 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:51.432962 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:51.495565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a3046-a1ac-4b7b-8d3e-a7893f1e05f1 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:51.530175 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fec7a-c94c-41af-991c-6baa537981d2 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:51.555095 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a232c1-1d48-4958-8103-00591a04952f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:51.556466 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a232c1-1d48-4958-8103-00591a04952f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:51.556923 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a232c1-1d48-4958-8103-00591a04952f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:51.557207 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a232c1-1d48-4958-8103-00591a04952f None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:51.557941 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a232c1-1d48-4958-8103-00591a04952f None admin] RBAC: Adding query filter params (name=reader) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:51.558249 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a232c1-1d48-4958-8103-00591a04952f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:51.559692 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a232c1-1d48-4958-8103-00591a04952f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:51.569184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 101/203] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:39:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:51.572967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e229f-cbfd-4381-9e94-251d04ac53fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:51.573603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e229f-cbfd-4381-9e94-251d04ac53fc None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:51.573987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e229f-cbfd-4381-9e94-251d04ac53fc None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:51.575009 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a232c1-1d48-4958-8103-00591a04952f None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:51.580147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e229f-cbfd-4381-9e94-251d04ac53fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:51.580982 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e229f-cbfd-4381-9e94-251d04ac53fc None admin] RBAC: Adding query filter params (role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846, scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e, user.id=c264c60f8984431e8b67b5c94ebbc926) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:51.582448 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e229f-cbfd-4381-9e94-251d04ac53fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:51.586805 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e229f-cbfd-4381-9e94-251d04ac53fc None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:51.597094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 103/204] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:51 2022] GET /identity/v3/role_assignments?user.id=c264c60f8984431e8b67b5c94ebbc926&scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e&role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:51.639757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:51.689559 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a232c1-1d48-4958-8103-00591a04952f None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:51.727031 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2856b4-b894-4324-a636-875985ad2739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:51.727740 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2856b4-b894-4324-a636-875985ad2739 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:51.728023 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2856b4-b894-4324-a636-875985ad2739 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:51.728302 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2856b4-b894-4324-a636-875985ad2739 None admin] PATH_INFO: `/v3/users/3f8861ddb2604de68dd4fa0cfe6aa100` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:51.729910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2856b4-b894-4324-a636-875985ad2739 None admin] RBAC: Authorizing `identity:get_user(user_id=3f8861ddb2604de68dd4fa0cfe6aa100)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:51.732594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2856b4-b894-4324-a636-875985ad2739 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:51.735694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 102/205] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:51 2022] GET /identity/v3/users/3f8861ddb2604de68dd4fa0cfe6aa100 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:51.741585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e229f-cbfd-4381-9e94-251d04ac53fc None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:51.855010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:51.891776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e229f-cbfd-4381-9e94-251d04ac53fc None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:51.938482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fed4a3-89ba-4016-afbe-059529e609c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:51.939122 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fed4a3-89ba-4016-afbe-059529e609c0 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:51.939411 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fed4a3-89ba-4016-afbe-059529e609c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:51.939696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fed4a3-89ba-4016-afbe-059529e609c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:52.034589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fed4a3-89ba-4016-afbe-059529e609c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:52.036055 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fed4a3-89ba-4016-afbe-059529e609c0 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:52.134703 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:52.175586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 104/206] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:52.182018 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2856b4-b894-4324-a636-875985ad2739 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:52.319345 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2856b4-b894-4324-a636-875985ad2739 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:52.353907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:52.365635 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94883d-9733-4dc5-96ed-815545a7b50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:52.366297 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94883d-9733-4dc5-96ed-815545a7b50e None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:52.366741 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94883d-9733-4dc5-96ed-815545a7b50e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:52.367020 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94883d-9733-4dc5-96ed-815545a7b50e None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:52.368265 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94883d-9733-4dc5-96ed-815545a7b50e None admin] RBAC: Authorizing `identity:get_project(project_id=4fab63748076484db8b585b850783e19)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:52.369741 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94883d-9733-4dc5-96ed-815545a7b50e None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:52.372005 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 103/207] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:52 2022] GET /identity/v3/projects/4fab63748076484db8b585b850783e19 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:52.379742 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fed4a3-89ba-4016-afbe-059529e609c0 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:52.536125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fed4a3-89ba-4016-afbe-059529e609c0 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:52.571559 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5b221-d853-4f76-abd0-9bf9214d209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:52.572183 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5b221-d853-4f76-abd0-9bf9214d209b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:52.572463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5b221-d853-4f76-abd0-9bf9214d209b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:52.572735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5b221-d853-4f76-abd0-9bf9214d209b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:52.573518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5b221-d853-4f76-abd0-9bf9214d209b None admin] RBAC: Adding query filter params (role.id=1b8bdabcd591423d91aaf8f30f7cd6f5, scope.project.id=4fab63748076484db8b585b850783e19, user.id=3f8861ddb2604de68dd4fa0cfe6aa100) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:52.573825 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5b221-d853-4f76-abd0-9bf9214d209b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:52.575292 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5b221-d853-4f76-abd0-9bf9214d209b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:52.586540 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 105/208] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:52 2022] GET /identity/v3/role_assignments?user.id=3f8861ddb2604de68dd4fa0cfe6aa100&scope.project.id=4fab63748076484db8b585b850783e19&role.id=1b8bdabcd591423d91aaf8f30f7cd6f5 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:52.977094 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fda067-7627-4947-bc0b-7bcf872b75a0 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:52.977733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fda067-7627-4947-bc0b-7bcf872b75a0 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:52.978232 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fda067-7627-4947-bc0b-7bcf872b75a0 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:52.979845 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 104/209] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:52.985187 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bac0e8-721f-4598-a88a-39ed768e5582 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:52.985720 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bac0e8-721f-4598-a88a-39ed768e5582 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:52.986190 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bac0e8-721f-4598-a88a-39ed768e5582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:53.005479 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-85bac0e8-721f-4598-a88a-39ed768e5582 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:53.007388 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-85bac0e8-721f-4598-a88a-39ed768e5582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:53.039324 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:53.047713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac60c-c6e1-4432-92eb-59f99696c186 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:53.048047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac60c-c6e1-4432-92eb-59f99696c186 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:53.048271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac60c-c6e1-4432-92eb-59f99696c186 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:53.051231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 105/210] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:39:53.055120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992e66a-7242-47de-8eb0-3a62a189ddac None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:53.055653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992e66a-7242-47de-8eb0-3a62a189ddac None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:53.056163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992e66a-7242-47de-8eb0-3a62a189ddac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:53.079026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-9992e66a-7242-47de-8eb0-3a62a189ddac None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:53.080570 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-9992e66a-7242-47de-8eb0-3a62a189ddac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:53.092403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 106/211] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:53.131590 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bac0e8-721f-4598-a88a-39ed768e5582 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:53.166440 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 106/212] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:39:53.188284 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992e66a-7242-47de-8eb0-3a62a189ddac None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:53.250235 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bac0e8-721f-4598-a88a-39ed768e5582 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:53.286230 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b3503-8550-4191-a6ee-5dbe94b67eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:53.287443 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b3503-8550-4191-a6ee-5dbe94b67eb4 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:53.287928 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b3503-8550-4191-a6ee-5dbe94b67eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:53.288415 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b3503-8550-4191-a6ee-5dbe94b67eb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:53.289787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b3503-8550-4191-a6ee-5dbe94b67eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:53.291506 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b3503-8550-4191-a6ee-5dbe94b67eb4 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:53.293595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 107/213] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:53.298824 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b3503-8550-4191-a6ee-5dbe94b67eb4 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:53.304449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992e66a-7242-47de-8eb0-3a62a189ddac None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:53.327204 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:53.335176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:53.347043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956aed5-3b64-4c42-b14f-02e8d9cce39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:53.347731 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956aed5-3b64-4c42-b14f-02e8d9cce39e None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:53.348024 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956aed5-3b64-4c42-b14f-02e8d9cce39e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:53.348309 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956aed5-3b64-4c42-b14f-02e8d9cce39e None admin] PATH_INFO: `/v3/roles/member` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:53.359455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956aed5-3b64-4c42-b14f-02e8d9cce39e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:53.365053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-6956aed5-3b64-4c42-b14f-02e8d9cce39e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:39:53.365053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:53.365053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:53.365053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:53.365053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:53.365053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:53.365053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:53.365053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:53.365053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:53.365053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:53.365053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:53.365053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:53.365053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:53.365053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:53.365053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:53.365053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:53.366105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:53.366105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:53.366105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:53.366105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:53.366105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:53.366105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:53.366105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:53.366105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:53.366105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:53.366105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:53.366105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:53.366105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:53.366105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:53.366105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:53.366105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:53.366105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:53.374044 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:53.374044 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:53.374044 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:53.374044 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:53.374044 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:53.374044 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:53.374044 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:53.374044 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:53.374044 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:53.374044 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:53.374044 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:39:53.374044 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:39:53.374044 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 107/214] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:53.374044 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee8b2b-6956-432e-b22c-11ec6975460d None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:53.374777 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee8b2b-6956-432e-b22c-11ec6975460d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:53.374777 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee8b2b-6956-432e-b22c-11ec6975460d None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:53.374777 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 108/215] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:53.374777 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee8b2b-6956-432e-b22c-11ec6975460d None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:53.419339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b3503-8550-4191-a6ee-5dbe94b67eb4 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:53.455559 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddbfa9-155d-432a-b03f-547a9ab10690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:53.456181 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddbfa9-155d-432a-b03f-547a9ab10690 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:53.456465 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddbfa9-155d-432a-b03f-547a9ab10690 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:53.456746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddbfa9-155d-432a-b03f-547a9ab10690 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:53.457435 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddbfa9-155d-432a-b03f-547a9ab10690 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:53.458907 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddbfa9-155d-432a-b03f-547a9ab10690 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:53.482779 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee8b2b-6956-432e-b22c-11ec6975460d None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:53.519354 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceece78f-d0a8-41ab-8217-6746d1192dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:53.519911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceece78f-d0a8-41ab-8217-6746d1192dec None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:53.520195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceece78f-d0a8-41ab-8217-6746d1192dec None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:53.520470 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceece78f-d0a8-41ab-8217-6746d1192dec None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:53.521189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceece78f-d0a8-41ab-8217-6746d1192dec None admin] RBAC: Adding query filter params (name=member) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:53.521496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceece78f-d0a8-41ab-8217-6746d1192dec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:53.523021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceece78f-d0a8-41ab-8217-6746d1192dec None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:53.532949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 109/216] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:39:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:53.534139 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b343-a2a8-4845-9344-c402bca132c7 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:53.534491 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b343-a2a8-4845-9344-c402bca132c7 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:53.534776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b343-a2a8-4845-9344-c402bca132c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:53.553468 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-0b17b343-a2a8-4845-9344-c402bca132c7 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:53.554030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 108/217] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jul 26 14:39:53 2022] POST /identity/v3/users => generated 297 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:53.554689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0b17b343-a2a8-4845-9344-c402bca132c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:53.563611 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddbfa9-155d-432a-b03f-547a9ab10690 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:53.618176 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:53.670913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 110/218] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:53.685490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:53.689875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17b343-a2a8-4845-9344-c402bca132c7 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:53.707997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddbfa9-155d-432a-b03f-547a9ab10690 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:53.750706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276791c-1843-47dc-86d7-f78627035e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:53.751366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276791c-1843-47dc-86d7-f78627035e01 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:53.751712 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276791c-1843-47dc-86d7-f78627035e01 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:53.752005 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276791c-1843-47dc-86d7-f78627035e01 None admin] PATH_INFO: `/v3/users/f352fe683e26434793efc35dc8446bee` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:53.771417 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276791c-1843-47dc-86d7-f78627035e01 None admin] RBAC: Authorizing `identity:get_user(user_id=f352fe683e26434793efc35dc8446bee)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:53.772807 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276791c-1843-47dc-86d7-f78627035e01 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:53.774764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 109/219] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:53 2022] GET /identity/v3/users/f352fe683e26434793efc35dc8446bee => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:53.780371 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276791c-1843-47dc-86d7-f78627035e01 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:53.816688 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17b343-a2a8-4845-9344-c402bca132c7 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:53.864065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef93baa-3247-4308-b724-7d0315515de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:53.864729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef93baa-3247-4308-b724-7d0315515de9 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:53.865013 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef93baa-3247-4308-b724-7d0315515de9 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:53.865287 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef93baa-3247-4308-b724-7d0315515de9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:53.880214 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef93baa-3247-4308-b724-7d0315515de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:53.885644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-8ef93baa-3247-4308-b724-7d0315515de9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:53.885644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:53.885644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:53.885644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:53.885644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:53.885644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:53.885644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:53.885644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:53.885644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:53.885644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:53.885644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:53.885644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:53.885644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:53.885644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:53.885644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:53.885644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:53.886521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:53.886521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:53.886521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:53.886521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:53.886521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:53.886521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:53.886521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:53.886521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:53.886521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:53.886521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:53.886521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:53.886521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:53.886521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:53.886521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:53.886521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:53.886521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:53.887304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:53.887304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:53.887304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:53.887304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:53.887304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:53.887304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:53.887304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:53.887304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:53.887304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:53.887304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:53.887304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:53.887304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:39:53.888353 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 111/220] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:53.894658 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef93baa-3247-4308-b724-7d0315515de9 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:53.917948 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276791c-1843-47dc-86d7-f78627035e01 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:53.934220 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:54.050357 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdc7e7-9fd7-4e2e-bc1c-a063a4cd150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:54.050937 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdc7e7-9fd7-4e2e-bc1c-a063a4cd150a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:54.051218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdc7e7-9fd7-4e2e-bc1c-a063a4cd150a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:54.051498 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdc7e7-9fd7-4e2e-bc1c-a063a4cd150a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:54.082763 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:54.136753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef93baa-3247-4308-b724-7d0315515de9 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:54.185054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdc7e7-9fd7-4e2e-bc1c-a063a4cd150a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:54.187666 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdc7e7-9fd7-4e2e-bc1c-a063a4cd150a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:54.206560 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddd402-9aa9-4976-96cf-8bd08e2ec032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:54.207130 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddd402-9aa9-4976-96cf-8bd08e2ec032 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:54.207386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddd402-9aa9-4976-96cf-8bd08e2ec032 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:54.207665 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddd402-9aa9-4976-96cf-8bd08e2ec032 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:54.208387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddd402-9aa9-4976-96cf-8bd08e2ec032 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:54.208692 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddd402-9aa9-4976-96cf-8bd08e2ec032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:54.210246 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddd402-9aa9-4976-96cf-8bd08e2ec032 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:54.220083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 112/221] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:54.225706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b507c-dad0-4132-a46e-9c4b048d570b None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:54.225706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b507c-dad0-4132-a46e-9c4b048d570b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:54.225706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b507c-dad0-4132-a46e-9c4b048d570b None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:54.225706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 113/222] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:54.225706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b507c-dad0-4132-a46e-9c4b048d570b None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:54.321073 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 110/223] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:54.323336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37b10d-1d43-488d-9a19-b35cbf9a99a3 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:54.323769 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37b10d-1d43-488d-9a19-b35cbf9a99a3 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:54.324313 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37b10d-1d43-488d-9a19-b35cbf9a99a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:54.341556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:54.345417 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-5e37b10d-1d43-488d-9a19-b35cbf9a99a3 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:54.346748 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-5e37b10d-1d43-488d-9a19-b35cbf9a99a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:54.350977 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b507c-dad0-4132-a46e-9c4b048d570b None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:54.390891 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715bce8-2247-4141-b8e2-23c676587956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:54.391504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:54.392703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715bce8-2247-4141-b8e2-23c676587956 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:54.393165 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715bce8-2247-4141-b8e2-23c676587956 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:54.393612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715bce8-2247-4141-b8e2-23c676587956 None admin] PATH_INFO: `/v3/users/c264c60f8984431e8b67b5c94ebbc926` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:54.394991 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715bce8-2247-4141-b8e2-23c676587956 None admin] RBAC: Authorizing `identity:get_user(user_id=c264c60f8984431e8b67b5c94ebbc926)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:54.396703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715bce8-2247-4141-b8e2-23c676587956 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:54.398816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 114/224] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:54 2022] GET /identity/v3/users/c264c60f8984431e8b67b5c94ebbc926 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:54.404900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715bce8-2247-4141-b8e2-23c676587956 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:54.418752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 111/225] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:54.427926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37b10d-1d43-488d-9a19-b35cbf9a99a3 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:54.521602 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715bce8-2247-4141-b8e2-23c676587956 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:54.550613 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37b10d-1d43-488d-9a19-b35cbf9a99a3 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:54.560807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017c50c-39a7-46d8-9bec-06ce1272a3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:54.561846 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017c50c-39a7-46d8-9bec-06ce1272a3b7 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:54.562307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017c50c-39a7-46d8-9bec-06ce1272a3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:54.562780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017c50c-39a7-46d8-9bec-06ce1272a3b7 None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:54.564179 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017c50c-39a7-46d8-9bec-06ce1272a3b7 None admin] RBAC: Authorizing `identity:get_project(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:54.565971 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017c50c-39a7-46d8-9bec-06ce1272a3b7 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:54.568016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 115/226] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:54 2022] GET /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:54.569114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017c50c-39a7-46d8-9bec-06ce1272a3b7 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:54.586680 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a9f73-94ed-428c-9c72-eb62e710da65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:54.587854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a9f73-94ed-428c-9c72-eb62e710da65 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:54.588140 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a9f73-94ed-428c-9c72-eb62e710da65 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:54.588419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a9f73-94ed-428c-9c72-eb62e710da65 None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:54.589784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a9f73-94ed-428c-9c72-eb62e710da65 None admin] RBAC: Authorizing `identity:get_project(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:54.591384 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a9f73-94ed-428c-9c72-eb62e710da65 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:54.593672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 112/227] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:54 2022] GET /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:54.594588 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a9f73-94ed-428c-9c72-eb62e710da65 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:54.606235 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:54.643362 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:54.692984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017c50c-39a7-46d8-9bec-06ce1272a3b7 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:54.698080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a9f73-94ed-428c-9c72-eb62e710da65 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:54.732604 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8373860-386b-460c-a726-841ea52c4a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:54.733088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777ae26-53ad-4273-8ec0-b680b7973463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:54.733707 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777ae26-53ad-4273-8ec0-b680b7973463 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:54.733990 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777ae26-53ad-4273-8ec0-b680b7973463 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:54.734115 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8373860-386b-460c-a726-841ea52c4a8d None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:54.734272 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777ae26-53ad-4273-8ec0-b680b7973463 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:54.734765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8373860-386b-460c-a726-841ea52c4a8d None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:54.735150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777ae26-53ad-4273-8ec0-b680b7973463 None admin] RBAC: Adding query filter params (role.id=8303560a3b6948379f524afad4b798d0, scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e, user.id=f352fe683e26434793efc35dc8446bee) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:54.735449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8373860-386b-460c-a726-841ea52c4a8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:54.735563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777ae26-53ad-4273-8ec0-b680b7973463 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:54.736959 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777ae26-53ad-4273-8ec0-b680b7973463 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:54.742915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 113/228] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:54 2022] GET /identity/v3/role_assignments?user.id=f352fe683e26434793efc35dc8446bee&scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e&role.id=8303560a3b6948379f524afad4b798d0 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:54.743893 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777ae26-53ad-4273-8ec0-b680b7973463 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:54.748104 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8373860-386b-460c-a726-841ea52c4a8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:54.753984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-d8373860-386b-460c-a726-841ea52c4a8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:39:54.753984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:54.753984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:54.753984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:54.753984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:54.753984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:54.753984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:54.753984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:54.753984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:54.753984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:54.753984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:54.753984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:54.753984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:54.753984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:54.753984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:54.753984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:54.755069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:54.755069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:54.755069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:54.755069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:54.755069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:54.755069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:54.755069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:54.755069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:54.755069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:54.755069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:54.755069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:54.755069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:54.755069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:54.755069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:54.755069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:54.755069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:54.756237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:54.756237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:54.756237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:54.756237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:54.756237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:54.756237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:54.756237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:54.756237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:54.756237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:54.756237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:54.756237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:39:54.756237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:39:54.758714 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 116/229] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:39:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:54.769414 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8373860-386b-460c-a726-841ea52c4a8d None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:54.853785 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777ae26-53ad-4273-8ec0-b680b7973463 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:54.867895 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:54.900228 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a5798-f1c0-4803-9bce-f95f547bf43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:54.900930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a5798-f1c0-4803-9bce-f95f547bf43c None admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:54.901211 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a5798-f1c0-4803-9bce-f95f547bf43c None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:54.901489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a5798-f1c0-4803-9bce-f95f547bf43c None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e/users/c264c60f8984431e8b67b5c94ebbc926/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:54.904733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a5798-f1c0-4803-9bce-f95f547bf43c None admin] RBAC: Authorizing `identity:create_grant(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e, user_id=c264c60f8984431e8b67b5c94ebbc926, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:54.906214 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a5798-f1c0-4803-9bce-f95f547bf43c None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:54.937108 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:54.948538 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8373860-386b-460c-a726-841ea52c4a8d None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:54.991422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 114/230] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:39:54 2022] PUT /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e/users/c264c60f8984431e8b67b5c94ebbc926/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:39:55.007672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33881c58-988b-4e14-8b87-68f0e7c997be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:55.008383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33881c58-988b-4e14-8b87-68f0e7c997be None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:55.008664 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33881c58-988b-4e14-8b87-68f0e7c997be None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:55.008970 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33881c58-988b-4e14-8b87-68f0e7c997be None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:55.009775 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33881c58-988b-4e14-8b87-68f0e7c997be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:55.010088 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33881c58-988b-4e14-8b87-68f0e7c997be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:55.013359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33881c58-988b-4e14-8b87-68f0e7c997be None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:55.028608 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 117/231] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:55.034840 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a5798-f1c0-4803-9bce-f95f547bf43c None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:55.174722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a5798-f1c0-4803-9bce-f95f547bf43c None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:55.220424 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab95724-db63-491e-bb05-f9e64f3c3b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:55.221121 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab95724-db63-491e-bb05-f9e64f3c3b41 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:55.221404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab95724-db63-491e-bb05-f9e64f3c3b41 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:55.221727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab95724-db63-491e-bb05-f9e64f3c3b41 None admin] PATH_INFO: `/v3/users/c264c60f8984431e8b67b5c94ebbc926` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:55.222936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab95724-db63-491e-bb05-f9e64f3c3b41 None admin] RBAC: Authorizing `identity:get_user(user_id=c264c60f8984431e8b67b5c94ebbc926)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:55.224396 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab95724-db63-491e-bb05-f9e64f3c3b41 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:55.226358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 115/232] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:55 2022] GET /identity/v3/users/c264c60f8984431e8b67b5c94ebbc926 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:55.232102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33881c58-988b-4e14-8b87-68f0e7c997be None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:55.375476 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33881c58-988b-4e14-8b87-68f0e7c997be None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:55.423180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875a22c-e9d9-4c11-b510-c4e91fe8fb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:55.423933 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875a22c-e9d9-4c11-b510-c4e91fe8fb06 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:55.424355 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875a22c-e9d9-4c11-b510-c4e91fe8fb06 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:55.424839 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875a22c-e9d9-4c11-b510-c4e91fe8fb06 None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:55.425976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875a22c-e9d9-4c11-b510-c4e91fe8fb06 None admin] RBAC: Authorizing `identity:get_project(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:55.427524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875a22c-e9d9-4c11-b510-c4e91fe8fb06 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:55.429558 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 118/233] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:55 2022] GET /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:55.434894 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab95724-db63-491e-bb05-f9e64f3c3b41 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:55.488867 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:55.574424 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab95724-db63-491e-bb05-f9e64f3c3b41 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:55.624714 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275a4c5-df9d-45dd-a4f5-4fa1f50cdac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:55.625403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275a4c5-df9d-45dd-a4f5-4fa1f50cdac9 None admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:55.625683 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275a4c5-df9d-45dd-a4f5-4fa1f50cdac9 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:55.625958 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275a4c5-df9d-45dd-a4f5-4fa1f50cdac9 None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e/users/c264c60f8984431e8b67b5c94ebbc926/roles/9cc7bf3bc6aa4b33ab6dee0dd67e1846` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:55.628231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275a4c5-df9d-45dd-a4f5-4fa1f50cdac9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e, user_id=c264c60f8984431e8b67b5c94ebbc926, role_id=9cc7bf3bc6aa4b33ab6dee0dd67e1846)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:55.629696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275a4c5-df9d-45dd-a4f5-4fa1f50cdac9 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:55.706014 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 116/234] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:39:55 2022] PUT /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e/users/c264c60f8984431e8b67b5c94ebbc926/roles/9cc7bf3bc6aa4b33ab6dee0dd67e1846 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:39:55.995459 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea75cd5-27f5-4b32-bc25-c443fa604352 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:55.995797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea75cd5-27f5-4b32-bc25-c443fa604352 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:55.995965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea75cd5-27f5-4b32-bc25-c443fa604352 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:55.997551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 119/235] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:56.002853 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdee31-6855-4d22-b1b5-9446153bb222 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:56.003148 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdee31-6855-4d22-b1b5-9446153bb222 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:56.003432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdee31-6855-4d22-b1b5-9446153bb222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:56.005921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe28779-9c97-4b10-ad48-d095a3fb45f9 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:56.006211 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe28779-9c97-4b10-ad48-d095a3fb45f9 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:56.006531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe28779-9c97-4b10-ad48-d095a3fb45f9 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:56.007966 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 120/236] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:39:56.014007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f4032-8009-4aa0-b146-448839914c91 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:56.014292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f4032-8009-4aa0-b146-448839914c91 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:56.014620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f4032-8009-4aa0-b146-448839914c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:56.038086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-ec5f4032-8009-4aa0-b146-448839914c91 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:56.039382 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ec5f4032-8009-4aa0-b146-448839914c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:56.041098 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-96bdee31-6855-4d22-b1b5-9446153bb222 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:56.042597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-96bdee31-6855-4d22-b1b5-9446153bb222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:56.058180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:56.144880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 121/237] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:39:56.162126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 117/238] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:56.170617 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f4032-8009-4aa0-b146-448839914c91 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:56.192520 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bdee31-6855-4d22-b1b5-9446153bb222 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:56.244623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:56.307794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f4032-8009-4aa0-b146-448839914c91 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:56.349683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b2b9c-e94c-4bd0-8c00-f3a9075b037a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:56.349683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b2b9c-e94c-4bd0-8c00-f3a9075b037a None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:56.349683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b2b9c-e94c-4bd0-8c00-f3a9075b037a None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:56.349683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b2b9c-e94c-4bd0-8c00-f3a9075b037a None admin] PATH_INFO: `/v3/domains/default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:56.350814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b2b9c-e94c-4bd0-8c00-f3a9075b037a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:56.354162 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b2b9c-e94c-4bd0-8c00-f3a9075b037a None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:56.356597 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 122/239] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:56.362986 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b2b9c-e94c-4bd0-8c00-f3a9075b037a None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:56.385167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:56.460347 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bdee31-6855-4d22-b1b5-9446153bb222 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:56.482212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b2b9c-e94c-4bd0-8c00-f3a9075b037a None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:56.523277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d2426-bfc8-4cbb-bbab-6a4ae7f7cf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:56.524286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d2426-bfc8-4cbb-bbab-6a4ae7f7cf1e None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:56.524793 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d2426-bfc8-4cbb-bbab-6a4ae7f7cf1e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:56.525266 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d2426-bfc8-4cbb-bbab-6a4ae7f7cf1e None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:56.526171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d2426-bfc8-4cbb-bbab-6a4ae7f7cf1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:56.528094 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d2426-bfc8-4cbb-bbab-6a4ae7f7cf1e None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:56.550205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0483dc-e7f4-4417-b235-29553369a06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:56.551650 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0483dc-e7f4-4417-b235-29553369a06f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:56.552138 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0483dc-e7f4-4417-b235-29553369a06f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:56.559177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0483dc-e7f4-4417-b235-29553369a06f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:56.565983 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0483dc-e7f4-4417-b235-29553369a06f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:56.571582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-fd0483dc-e7f4-4417-b235-29553369a06f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:39:56.571582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:56.571582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:56.571582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:56.571582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:56.571582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:56.571582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:56.571582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:56.571582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:56.571582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:56.571582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:56.571582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:56.571582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:56.571582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:56.571582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:56.571582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:56.572433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:56.572433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:56.572433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:56.572433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:56.572433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:56.572433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:56.572433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:56.572433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:56.572433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:56.572433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:56.572433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:56.572433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:56.572433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:56.572433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:56.572433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:56.572433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:56.573518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:56.573518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:56.573518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:56.573518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:56.573518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:56.573518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:56.573518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:56.573518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:56.573518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:56.573518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:56.573518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:39:56.573518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:39:56.575980 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 118/240] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:56.581995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0483dc-e7f4-4417-b235-29553369a06f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:56.625391 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 123/241] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jul 26 14:39:56 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:56.691956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:56.709314 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0483dc-e7f4-4417-b235-29553369a06f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:56.751660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10d9ea-5adb-49a3-a9c4-73e86945c093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:56.752305 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10d9ea-5adb-49a3-a9c4-73e86945c093 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:56.752586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10d9ea-5adb-49a3-a9c4-73e86945c093 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:56.752859 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10d9ea-5adb-49a3-a9c4-73e86945c093 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:56.753601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10d9ea-5adb-49a3-a9c4-73e86945c093 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:56.753901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10d9ea-5adb-49a3-a9c4-73e86945c093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:56.755350 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10d9ea-5adb-49a3-a9c4-73e86945c093 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:56.765099 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 119/242] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:39:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:56.770818 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d2426-bfc8-4cbb-bbab-6a4ae7f7cf1e None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:56.869603 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:56.903765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d2426-bfc8-4cbb-bbab-6a4ae7f7cf1e None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:56.940385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005783e1-bb42-4e9c-a2a9-7a76c53e6bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:56.941038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005783e1-bb42-4e9c-a2a9-7a76c53e6bda None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:56.941369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005783e1-bb42-4e9c-a2a9-7a76c53e6bda None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:56.941652 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005783e1-bb42-4e9c-a2a9-7a76c53e6bda None admin] PATH_INFO: `/v3/users/3745aae7f1534a3fb431cd221c8dee48` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:56.957050 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005783e1-bb42-4e9c-a2a9-7a76c53e6bda None admin] RBAC: Authorizing `identity:get_user(user_id=3745aae7f1534a3fb431cd221c8dee48)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:56.958536 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005783e1-bb42-4e9c-a2a9-7a76c53e6bda None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:56.960538 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 124/243] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:56 2022] GET /identity/v3/users/3745aae7f1534a3fb431cd221c8dee48 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:56.966690 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10d9ea-5adb-49a3-a9c4-73e86945c093 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:57.077727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10d9ea-5adb-49a3-a9c4-73e86945c093 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:57.112971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fd350-db02-4e95-91c7-2388fbe41b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:57.113601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fd350-db02-4e95-91c7-2388fbe41b5d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:57.113883 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fd350-db02-4e95-91c7-2388fbe41b5d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:57.114160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fd350-db02-4e95-91c7-2388fbe41b5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:57.138179 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:57.186078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fd350-db02-4e95-91c7-2388fbe41b5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:57.187574 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fd350-db02-4e95-91c7-2388fbe41b5d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:57.292084 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 120/244] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:57.299635 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005783e1-bb42-4e9c-a2a9-7a76c53e6bda None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:57.369975 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3daac7-870c-4f84-9cbd-2e2bfced2e2b None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:57.370280 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3daac7-870c-4f84-9cbd-2e2bfced2e2b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:57.370563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3daac7-870c-4f84-9cbd-2e2bfced2e2b None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:57.372161 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 121/245] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:39:57.377821 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21688c-d8a1-45ce-b2de-23f47617d710 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:57.378108 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21688c-d8a1-45ce-b2de-23f47617d710 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:57.378380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21688c-d8a1-45ce-b2de-23f47617d710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:57.401874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-6f21688c-d8a1-45ce-b2de-23f47617d710 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:57.403455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-6f21688c-d8a1-45ce-b2de-23f47617d710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:57.444303 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005783e1-bb42-4e9c-a2a9-7a76c53e6bda None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:57.466963 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:57.480764 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:57.486539 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04818a79-f1b2-41f6-ad5a-a9e0051e116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:57.487201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04818a79-f1b2-41f6-ad5a-a9e0051e116d None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:57.496446 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04818a79-f1b2-41f6-ad5a-a9e0051e116d None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:57.496446 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04818a79-f1b2-41f6-ad5a-a9e0051e116d None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:57.496663 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 122/246] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:39:57.496736 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04818a79-f1b2-41f6-ad5a-a9e0051e116d None admin] RBAC: Authorizing `identity:get_project(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:57.496736 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04818a79-f1b2-41f6-ad5a-a9e0051e116d None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:57.496736 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 125/247] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:57 2022] GET /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:57.499535 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21688c-d8a1-45ce-b2de-23f47617d710 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:57.526649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04818a79-f1b2-41f6-ad5a-a9e0051e116d None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:57.616325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21688c-d8a1-45ce-b2de-23f47617d710 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:57.655040 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04818a79-f1b2-41f6-ad5a-a9e0051e116d None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:57.655740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d9c5c-b608-47fb-a5ff-53b2ad1824ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:57.656687 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d9c5c-b608-47fb-a5ff-53b2ad1824ba None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:57.657156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d9c5c-b608-47fb-a5ff-53b2ad1824ba None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:57.657660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d9c5c-b608-47fb-a5ff-53b2ad1824ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:57.658688 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d9c5c-b608-47fb-a5ff-53b2ad1824ba None admin] RBAC: Adding query filter params (role.id=1b8bdabcd591423d91aaf8f30f7cd6f5, scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e, user.id=3745aae7f1534a3fb431cd221c8dee48) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:57.659278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d9c5c-b608-47fb-a5ff-53b2ad1824ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:57.661031 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d9c5c-b608-47fb-a5ff-53b2ad1824ba None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:57.667661 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 123/248] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:57 2022] GET /identity/v3/role_assignments?user.id=3745aae7f1534a3fb431cd221c8dee48&scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e&role.id=1b8bdabcd591423d91aaf8f30f7cd6f5 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:57.669396 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5274e0e-c319-420d-a5da-61bf3588dda5 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:57.669851 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5274e0e-c319-420d-a5da-61bf3588dda5 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:57.670322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5274e0e-c319-420d-a5da-61bf3588dda5 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:57.672039 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 124/249] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:57.679475 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66257081-b7ca-417c-a327-cd4396648965 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:57.680048 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66257081-b7ca-417c-a327-cd4396648965 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:57.680536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66257081-b7ca-417c-a327-cd4396648965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:57.721328 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-66257081-b7ca-417c-a327-cd4396648965 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:57.725396 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-66257081-b7ca-417c-a327-cd4396648965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:57.738919 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91f322-4033-46a2-a344-e4f7af64277a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:57.740245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91f322-4033-46a2-a344-e4f7af64277a None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:57.740771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91f322-4033-46a2-a344-e4f7af64277a None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:57.741223 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91f322-4033-46a2-a344-e4f7af64277a None admin] PATH_INFO: `/v3/roles/member` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:57.795831 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91f322-4033-46a2-a344-e4f7af64277a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:57.801784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-4b91f322-4033-46a2-a344-e4f7af64277a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:39:57.801784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:57.801784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:57.801784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:57.801784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:57.801784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:57.801784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:57.801784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:57.801784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:57.801784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:57.801784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:57.801784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:57.801784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:57.801784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:57.801784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:57.801784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:57.802783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:57.802783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:57.802783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:57.802783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:57.802783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:57.802783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:57.802783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:57.802783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:57.802783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:57.802783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:57.802783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:57.802783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:57.802783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:57.802783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:57.802783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:57.802783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:57.803542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:57.803542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:57.803542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:57.803542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:57.803542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:57.803542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:57.803542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:57.803542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:57.803542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:57.803542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:57.803542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:39:57.803542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:39:57.811372 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 126/250] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:57.812792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:57.817803 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91f322-4033-46a2-a344-e4f7af64277a None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:57.857831 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 125/251] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:57.893071 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66257081-b7ca-417c-a327-cd4396648965 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:57.911396 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:57.959319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91f322-4033-46a2-a344-e4f7af64277a None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:58.010723 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4c105-4d04-4e40-b64b-00190a4f88b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:58.011717 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4c105-4d04-4e40-b64b-00190a4f88b0 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:58.012291 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4c105-4d04-4e40-b64b-00190a4f88b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:58.012749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4c105-4d04-4e40-b64b-00190a4f88b0 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:58.013752 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4c105-4d04-4e40-b64b-00190a4f88b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:58.014243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4c105-4d04-4e40-b64b-00190a4f88b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:58.015840 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4c105-4d04-4e40-b64b-00190a4f88b0 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:58.030809 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 127/252] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:39:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:58.038890 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4c105-4d04-4e40-b64b-00190a4f88b0 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:58.061832 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66257081-b7ca-417c-a327-cd4396648965 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:58.124354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c0d60-c0f6-4b5b-b4e1-03192e624d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:58.125446 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0d60-c0f6-4b5b-b4e1-03192e624d4e None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:58.127769 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0d60-c0f6-4b5b-b4e1-03192e624d4e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:58.128258 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0d60-c0f6-4b5b-b4e1-03192e624d4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:58.157183 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c0d60-c0f6-4b5b-b4e1-03192e624d4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:58.162168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-307c0d60-c0f6-4b5b-b4e1-03192e624d4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:58.162168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:58.162168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:58.162168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:58.162168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:58.162168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:58.162168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:58.162168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:58.162168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:58.162168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:58.162168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:58.162168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:58.162168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:58.162168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:58.162168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:58.162168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:58.163079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:58.163079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:58.163079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:58.163079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:58.163079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:58.163079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:58.163079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:58.163079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:58.163079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:58.163079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:58.163079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:58.163079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:58.163079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:58.163079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:58.163079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:58.163079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:58.163865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:58.163865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:58.163865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:58.163865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:58.163865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:58.163865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:58.163865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:58.163865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:58.163865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:58.163865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:58.163865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:58.163865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:39:58.163865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 126/253] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:58.169964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c0d60-c0f6-4b5b-b4e1-03192e624d4e None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:58.171108 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4c105-4d04-4e40-b64b-00190a4f88b0 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:58.196776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:58.211833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b1567-ff48-42b2-baca-236df76294ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:58.214045 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b1567-ff48-42b2-baca-236df76294ad None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:58.214689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b1567-ff48-42b2-baca-236df76294ad None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:58.215911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b1567-ff48-42b2-baca-236df76294ad None admin] PATH_INFO: `/v3/users/f352fe683e26434793efc35dc8446bee` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:58.219412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b1567-ff48-42b2-baca-236df76294ad None admin] RBAC: Authorizing `identity:get_user(user_id=f352fe683e26434793efc35dc8446bee)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:58.221061 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b1567-ff48-42b2-baca-236df76294ad None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:58.223170 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 128/254] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:58 2022] GET /identity/v3/users/f352fe683e26434793efc35dc8446bee => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:58.230555 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b1567-ff48-42b2-baca-236df76294ad None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:58.251866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:58.365491 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b1567-ff48-42b2-baca-236df76294ad None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:58.376549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c0d60-c0f6-4b5b-b4e1-03192e624d4e None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:58.409385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac9332-9a60-4851-9828-3a1f273f9f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:58.410330 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac9332-9a60-4851-9828-3a1f273f9f4c None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:58.411568 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac9332-9a60-4851-9828-3a1f273f9f4c None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:58.412034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac9332-9a60-4851-9828-3a1f273f9f4c None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:58.417209 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac9332-9a60-4851-9828-3a1f273f9f4c None admin] RBAC: Authorizing `identity:get_project(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:58.418183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac9332-9a60-4851-9828-3a1f273f9f4c None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:58.422416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 129/255] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:58 2022] GET /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:58.422416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63dc7d-1604-4703-ba46-89a06d05dced None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:58.422416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63dc7d-1604-4703-ba46-89a06d05dced None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:58.422416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63dc7d-1604-4703-ba46-89a06d05dced None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:58.423313 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 130/256] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:58.429174 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87217529-dbcc-4fbc-b540-69d68b75eefc None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:58.429467 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87217529-dbcc-4fbc-b540-69d68b75eefc None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:58.429748 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87217529-dbcc-4fbc-b540-69d68b75eefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:58.440414 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5e61c-9c9c-46cb-b512-8dd6164833fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:58.441327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5e61c-9c9c-46cb-b512-8dd6164833fb None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:58.441801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5e61c-9c9c-46cb-b512-8dd6164833fb None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:58.442267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5e61c-9c9c-46cb-b512-8dd6164833fb None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:58.443225 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5e61c-9c9c-46cb-b512-8dd6164833fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:58.443725 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5e61c-9c9c-46cb-b512-8dd6164833fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:58.445305 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5e61c-9c9c-46cb-b512-8dd6164833fb None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:58.454080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 127/257] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:58.455117 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5e61c-9c9c-46cb-b512-8dd6164833fb None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:58.462262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-87217529-dbcc-4fbc-b540-69d68b75eefc None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:58.463516 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-87217529-dbcc-4fbc-b540-69d68b75eefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:58.564874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:58.572267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5e61c-9c9c-46cb-b512-8dd6164833fb None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:58.586646 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:58.607849 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3e5a0-d214-43c7-9279-77f25ffc39d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:58.608939 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3e5a0-d214-43c7-9279-77f25ffc39d5 None admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:58.609510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3e5a0-d214-43c7-9279-77f25ffc39d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:58.610082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3e5a0-d214-43c7-9279-77f25ffc39d5 None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e/users/f352fe683e26434793efc35dc8446bee/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:58.612323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3e5a0-d214-43c7-9279-77f25ffc39d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e, user_id=f352fe683e26434793efc35dc8446bee, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:58.612527 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 131/258] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:58.613352 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87217529-dbcc-4fbc-b540-69d68b75eefc None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:58.622794 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3e5a0-d214-43c7-9279-77f25ffc39d5 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:58.731741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 128/259] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:39:58 2022] PUT /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e/users/f352fe683e26434793efc35dc8446bee/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:39:58.733131 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3e5a0-d214-43c7-9279-77f25ffc39d5 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:58.766090 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87217529-dbcc-4fbc-b540-69d68b75eefc None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:58.827222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e115996-e27e-4587-833c-749056962590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:58.828317 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115996-e27e-4587-833c-749056962590 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:58.828802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115996-e27e-4587-833c-749056962590 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:58.829301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115996-e27e-4587-833c-749056962590 None admin] PATH_INFO: `/v3/users/c264c60f8984431e8b67b5c94ebbc926` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:58.830895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e115996-e27e-4587-833c-749056962590 None admin] RBAC: Authorizing `identity:get_user(user_id=c264c60f8984431e8b67b5c94ebbc926)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:58.832623 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e115996-e27e-4587-833c-749056962590 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:58.834795 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 132/260] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:58 2022] GET /identity/v3/users/c264c60f8984431e8b67b5c94ebbc926 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:58.856108 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e115996-e27e-4587-833c-749056962590 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:58.882433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3e5a0-d214-43c7-9279-77f25ffc39d5 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:58.946688 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8159f-e22f-43a0-af65-098803e598c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:58.947304 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8159f-e22f-43a0-af65-098803e598c7 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:58.947595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8159f-e22f-43a0-af65-098803e598c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:58.947868 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8159f-e22f-43a0-af65-098803e598c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:58.949753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:58.972845 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8159f-e22f-43a0-af65-098803e598c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:58.981204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-43e8159f-e22f-43a0-af65-098803e598c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:39:58.981204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:58.981204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:58.981204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:58.981204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:58.981204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:58.981204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:58.981204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:58.981204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:58.981204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:58.981204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:58.981204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:58.981204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:58.981204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:58.981204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:58.981204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:58.982120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:58.982120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:58.982120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:58.982120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:58.982120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:58.982120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:58.982120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:58.982120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:58.982120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:58.982120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:58.982120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:58.982120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:58.982120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:58.982120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:58.982120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:58.982120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:58.983001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:58.983001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:58.983001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:58.983001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:58.983001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:58.983001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:58.983001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:58.983001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:58.983001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:58.983001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:58.983001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:39:58.983001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:39:58.988006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 129/261] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:39:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:58.995445 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8159f-e22f-43a0-af65-098803e598c7 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:59.032504 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e115996-e27e-4587-833c-749056962590 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:59.033608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:59.105291 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961cf8e-0c67-4ed9-a675-e6dcbfb86182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:59.105940 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961cf8e-0c67-4ed9-a675-e6dcbfb86182 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:59.106326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961cf8e-0c67-4ed9-a675-e6dcbfb86182 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:59.106628 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961cf8e-0c67-4ed9-a675-e6dcbfb86182 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:59.202404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8159f-e22f-43a0-af65-098803e598c7 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:59.239501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961cf8e-0c67-4ed9-a675-e6dcbfb86182 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:59.241048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961cf8e-0c67-4ed9-a675-e6dcbfb86182 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:59.268399 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866484e-9600-4edc-85ba-81e6b45496f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:59.269811 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866484e-9600-4edc-85ba-81e6b45496f1 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:59.270099 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866484e-9600-4edc-85ba-81e6b45496f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:59.270378 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866484e-9600-4edc-85ba-81e6b45496f1 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:59.272848 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866484e-9600-4edc-85ba-81e6b45496f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:59.273164 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866484e-9600-4edc-85ba-81e6b45496f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:59.275977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866484e-9600-4edc-85ba-81e6b45496f1 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:59.292453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 130/262] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:59.299408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866484e-9600-4edc-85ba-81e6b45496f1 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:59.346747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:59.434250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 133/263] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:39:59.440894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961cf8e-0c67-4ed9-a675-e6dcbfb86182 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:59.463681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:59.514601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866484e-9600-4edc-85ba-81e6b45496f1 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:59.567161 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbfda4-906e-4bb8-84de-702d988f5e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:59.567904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbfda4-906e-4bb8-84de-702d988f5e37 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:59.568100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbfda4-906e-4bb8-84de-702d988f5e37 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:59.568380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbfda4-906e-4bb8-84de-702d988f5e37 None admin] PATH_INFO: `/v3/users/c264c60f8984431e8b67b5c94ebbc926` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:59.569693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbfda4-906e-4bb8-84de-702d988f5e37 None admin] RBAC: Authorizing `identity:get_user(user_id=c264c60f8984431e8b67b5c94ebbc926)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:59.571712 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbfda4-906e-4bb8-84de-702d988f5e37 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:59.573724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 131/264] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:59 2022] GET /identity/v3/users/c264c60f8984431e8b67b5c94ebbc926 => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:59.579369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbfda4-906e-4bb8-84de-702d988f5e37 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:59.657225 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961cf8e-0c67-4ed9-a675-e6dcbfb86182 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:59.730317 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ed236-1974-4505-acff-d21ff321f965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:59.730991 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ed236-1974-4505-acff-d21ff321f965 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:59.731277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ed236-1974-4505-acff-d21ff321f965 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:59.731555 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ed236-1974-4505-acff-d21ff321f965 None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:59.732929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ed236-1974-4505-acff-d21ff321f965 None admin] RBAC: Authorizing `identity:get_project(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:59.734451 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ed236-1974-4505-acff-d21ff321f965 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:59.738577 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 134/265] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:59 2022] GET /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:59.750770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ed236-1974-4505-acff-d21ff321f965 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:59.753471 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbfda4-906e-4bb8-84de-702d988f5e37 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:59.801004 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:59.826408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa323ab-f601-4a93-8740-2d25936fd440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:59.827291 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa323ab-f601-4a93-8740-2d25936fd440 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:59.827718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa323ab-f601-4a93-8740-2d25936fd440 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:59.828171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa323ab-f601-4a93-8740-2d25936fd440 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:59.861325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:59.946046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ed236-1974-4505-acff-d21ff321f965 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:59.984637 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e51f0-6f75-49e7-ae9c-bdca43138cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:59.985492 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e51f0-6f75-49e7-ae9c-bdca43138cb9 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:59.985938 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e51f0-6f75-49e7-ae9c-bdca43138cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:59.986352 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e51f0-6f75-49e7-ae9c-bdca43138cb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:59.987304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e51f0-6f75-49e7-ae9c-bdca43138cb9 None admin] RBAC: Adding query filter params (role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e, user.id=c264c60f8984431e8b67b5c94ebbc926) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:59.987487 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa323ab-f601-4a93-8740-2d25936fd440 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:59.987910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e51f0-6f75-49e7-ae9c-bdca43138cb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:59.988994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa323ab-f601-4a93-8740-2d25936fd440 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:59.989672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e51f0-6f75-49e7-ae9c-bdca43138cb9 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:59.997404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 135/266] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:59 2022] GET /identity/v3/role_assignments?user.id=c264c60f8984431e8b67b5c94ebbc926&scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:00.120094 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee0bfb-378d-4e67-ab79-a93175cf117e None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:00.120452 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee0bfb-378d-4e67-ab79-a93175cf117e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:00.120653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee0bfb-378d-4e67-ab79-a93175cf117e None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:00.122141 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 136/267] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:40:00.128383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20f6f2-2fe3-4b29-ba2f-754ee1d33b1e None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:00.128991 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20f6f2-2fe3-4b29-ba2f-754ee1d33b1e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:00.129484 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20f6f2-2fe3-4b29-ba2f-754ee1d33b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:00.149178 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-dc20f6f2-2fe3-4b29-ba2f-754ee1d33b1e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:00.151290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-dc20f6f2-2fe3-4b29-ba2f-754ee1d33b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:00.164978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 132/268] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:00.171025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa323ab-f601-4a93-8740-2d25936fd440 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:00.238991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:00.288079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 137/269] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:00.301290 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa323ab-f601-4a93-8740-2d25936fd440 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:00.325667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20f6f2-2fe3-4b29-ba2f-754ee1d33b1e None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:00.347401 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:00.348146 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5a9e2-aa80-4711-a678-8e9643e9a1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:00.348815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5a9e2-aa80-4711-a678-8e9643e9a1f1 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:00.349098 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5a9e2-aa80-4711-a678-8e9643e9a1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:00.349373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5a9e2-aa80-4711-a678-8e9643e9a1f1 None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:00.355277 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5a9e2-aa80-4711-a678-8e9643e9a1f1 None admin] RBAC: Authorizing `identity:get_project(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:00.356806 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5a9e2-aa80-4711-a678-8e9643e9a1f1 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:00.358982 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 133/270] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:00 2022] GET /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:00.368248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a1fe9-ab14-4278-bd97-9f33ecf4c915 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:00.368547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a1fe9-ab14-4278-bd97-9f33ecf4c915 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:00.368833 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a1fe9-ab14-4278-bd97-9f33ecf4c915 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:00.370310 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 134/271] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:40:00.373233 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a1fe9-ab14-4278-bd97-9f33ecf4c915 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:00.456180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20f6f2-2fe3-4b29-ba2f-754ee1d33b1e None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:00.489790 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a1fe9-ab14-4278-bd97-9f33ecf4c915 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:00.495544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55d2b7-8f21-4215-be0c-c1a71a0eb413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:00.496390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55d2b7-8f21-4215-be0c-c1a71a0eb413 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:00.496817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55d2b7-8f21-4215-be0c-c1a71a0eb413 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:00.497334 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55d2b7-8f21-4215-be0c-c1a71a0eb413 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:00.503646 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:00.512077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55d2b7-8f21-4215-be0c-c1a71a0eb413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:00.517611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-dd55d2b7-8f21-4215-be0c-c1a71a0eb413 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:00.517611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:00.517611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:00.517611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:00.517611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:00.517611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:00.517611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:00.517611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:00.517611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:00.517611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:00.517611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:00.517611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:00.517611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:00.517611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:00.517611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:00.517611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:00.521864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:00.521864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:00.521864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:00.521864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:00.521864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:00.521864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:00.521864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:00.521864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:00.521864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:00.521864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:00.521864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:00.521864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:00.521864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:00.521864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:00.521864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:00.521864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:00.522650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:00.522650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:00.522650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:00.522650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:00.522650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:00.522650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:00.522650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:00.522650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:00.522650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:00.522650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:00.522650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:00.522650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:00.522650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 138/272] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:00.522650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2115bd-568c-49be-a778-0d336889b0de None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:00.523363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2115bd-568c-49be-a778-0d336889b0de None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:00.523363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2115bd-568c-49be-a778-0d336889b0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:00.529640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad17e7-d81d-4691-8049-8af8dd22ce31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:00.530630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad17e7-d81d-4691-8049-8af8dd22ce31 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:00.531141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad17e7-d81d-4691-8049-8af8dd22ce31 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:00.531661 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad17e7-d81d-4691-8049-8af8dd22ce31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:00.532654 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad17e7-d81d-4691-8049-8af8dd22ce31 None admin] RBAC: Adding query filter params (role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846, scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e, user.id=c264c60f8984431e8b67b5c94ebbc926) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:00.533160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad17e7-d81d-4691-8049-8af8dd22ce31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:00.535088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad17e7-d81d-4691-8049-8af8dd22ce31 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:00.543686 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 135/273] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:00 2022] GET /identity/v3/role_assignments?user.id=c264c60f8984431e8b67b5c94ebbc926&scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e&role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:00.544766 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad17e7-d81d-4691-8049-8af8dd22ce31 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:00.561464 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-fa2115bd-568c-49be-a778-0d336889b0de None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:00.563270 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-fa2115bd-568c-49be-a778-0d336889b0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:00.736384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 139/274] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:00.737704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6a9c-4af0-4a70-b89d-d9a57bf54858 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:00.738635 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6a9c-4af0-4a70-b89d-d9a57bf54858 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:00.738945 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6a9c-4af0-4a70-b89d-d9a57bf54858 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:00.740417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 140/275] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:00.741520 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad17e7-d81d-4691-8049-8af8dd22ce31 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:00.750658 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7826c7-813e-4d27-bd4b-77d9940123d3 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:00.750950 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7826c7-813e-4d27-bd4b-77d9940123d3 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:00.751220 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7826c7-813e-4d27-bd4b-77d9940123d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:00.770860 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-2d7826c7-813e-4d27-bd4b-77d9940123d3 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:00.772056 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2d7826c7-813e-4d27-bd4b-77d9940123d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:00.774168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:00.796917 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d7d7a-ca91-4950-943b-6de0a8e4b60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:00.798331 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d7d7a-ca91-4950-943b-6de0a8e4b60a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:00.798646 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d7d7a-ca91-4950-943b-6de0a8e4b60a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:00.799749 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d7d7a-ca91-4950-943b-6de0a8e4b60a None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:00.800482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d7d7a-ca91-4950-943b-6de0a8e4b60a None admin] RBAC: Adding query filter params (name=member) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:00.800795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d7d7a-ca91-4950-943b-6de0a8e4b60a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:00.802192 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d7d7a-ca91-4950-943b-6de0a8e4b60a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:00.814644 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 136/276] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:40:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:00.815589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d7d7a-ca91-4950-943b-6de0a8e4b60a None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:00.870414 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 141/277] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:40:00.870414 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7826c7-813e-4d27-bd4b-77d9940123d3 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:00.870680 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:00.937502 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d7d7a-ca91-4950-943b-6de0a8e4b60a None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:00.975908 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c313cb3-6243-4f01-bf2d-e6af6e676a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:00.976817 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c313cb3-6243-4f01-bf2d-e6af6e676a7a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:00.977097 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c313cb3-6243-4f01-bf2d-e6af6e676a7a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:00.978205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c313cb3-6243-4f01-bf2d-e6af6e676a7a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:00.981760 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7826c7-813e-4d27-bd4b-77d9940123d3 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:00.991644 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c313cb3-6243-4f01-bf2d-e6af6e676a7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:01.000220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-7c313cb3-6243-4f01-bf2d-e6af6e676a7a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:40:01.000220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:01.000220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:01.000220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:01.000220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:01.000220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:01.000220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:01.000220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:01.000220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:01.000220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:01.000220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:01.000220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:01.000220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:01.000220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:01.000220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:01.000220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:01.001077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:01.001077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:01.001077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:01.001077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:01.001077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:01.001077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:01.001077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:01.001077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:01.001077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:01.001077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:01.001077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:01.001077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:01.001077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:01.001077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:01.001077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:01.001077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:01.001850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:01.001850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:01.001850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:01.001850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:01.001850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:01.001850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:01.001850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:01.001850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:01.001850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:01.001850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:01.001850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:40:01.001850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:01.001850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 137/278] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:01.002545 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c313cb3-6243-4f01-bf2d-e6af6e676a7a None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:01.017496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8154f6-e9df-4224-b477-faa4688f724b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:01.018146 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8154f6-e9df-4224-b477-faa4688f724b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:01.018463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8154f6-e9df-4224-b477-faa4688f724b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:01.018741 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8154f6-e9df-4224-b477-faa4688f724b None admin] PATH_INFO: `/v3/users/30c3f719262544f989ac7b56b4d40794` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:01.027559 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:01.033786 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8154f6-e9df-4224-b477-faa4688f724b None admin] RBAC: Authorizing `identity:get_user(user_id=30c3f719262544f989ac7b56b4d40794)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:01.035278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8154f6-e9df-4224-b477-faa4688f724b None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:01.040114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 142/279] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:00 2022] GET /identity/v3/users/30c3f719262544f989ac7b56b4d40794 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:01.040114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8154f6-e9df-4224-b477-faa4688f724b None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:01.111412 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:01.115678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c313cb3-6243-4f01-bf2d-e6af6e676a7a None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:01.148115 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8154f6-e9df-4224-b477-faa4688f724b None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:01.152814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c832d77-ce45-40a1-8ad8-590970339540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:01.153633 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c832d77-ce45-40a1-8ad8-590970339540 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:01.154075 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c832d77-ce45-40a1-8ad8-590970339540 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:01.154531 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c832d77-ce45-40a1-8ad8-590970339540 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:01.155804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c832d77-ce45-40a1-8ad8-590970339540 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:01.157492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c832d77-ce45-40a1-8ad8-590970339540 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:01.159300 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 138/280] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:01.160177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c832d77-ce45-40a1-8ad8-590970339540 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:01.187463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e192cdc-5175-4cf2-ae42-7293ce9ef3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:01.188083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e192cdc-5175-4cf2-ae42-7293ce9ef3e9 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:01.188363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e192cdc-5175-4cf2-ae42-7293ce9ef3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:01.188684 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e192cdc-5175-4cf2-ae42-7293ce9ef3e9 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:01.189414 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e192cdc-5175-4cf2-ae42-7293ce9ef3e9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:01.189719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e192cdc-5175-4cf2-ae42-7293ce9ef3e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:01.191132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e192cdc-5175-4cf2-ae42-7293ce9ef3e9 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:01.200252 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 143/281] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:40:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:01.201082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e192cdc-5175-4cf2-ae42-7293ce9ef3e9 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:01.265813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:01.268556 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c832d77-ce45-40a1-8ad8-590970339540 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:01.306518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be1613-37e2-4b69-aec5-79e00895607e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:01.307149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be1613-37e2-4b69-aec5-79e00895607e None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:01.307425 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be1613-37e2-4b69-aec5-79e00895607e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:01.307701 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be1613-37e2-4b69-aec5-79e00895607e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:01.308483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be1613-37e2-4b69-aec5-79e00895607e None admin] RBAC: Adding query filter params (role.id=8303560a3b6948379f524afad4b798d0, user.id=30c3f719262544f989ac7b56b4d40794, scope.system=all) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:01.308791 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be1613-37e2-4b69-aec5-79e00895607e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:01.309117 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e192cdc-5175-4cf2-ae42-7293ce9ef3e9 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:01.310220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be1613-37e2-4b69-aec5-79e00895607e None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:01.326663 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 139/282] 10.222.0.86 () {56 vars in 1308 bytes} [Tue Jul 26 14:40:01 2022] GET /identity/v3/role_assignments?user.id=30c3f719262544f989ac7b56b4d40794&scope.system=all&role.id=8303560a3b6948379f524afad4b798d0 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:01.326663 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be1613-37e2-4b69-aec5-79e00895607e None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:01.360113 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:01.371791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8e70c-d237-405f-ab8e-456785f0a6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:01.378711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8e70c-d237-405f-ab8e-456785f0a6cf None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:01.378711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8e70c-d237-405f-ab8e-456785f0a6cf None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:01.378711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8e70c-d237-405f-ab8e-456785f0a6cf None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:01.378711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8e70c-d237-405f-ab8e-456785f0a6cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:01.378711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8e70c-d237-405f-ab8e-456785f0a6cf None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:01.443417 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be1613-37e2-4b69-aec5-79e00895607e None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:01.466795 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 144/283] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jul 26 14:40:01 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:40:01.489461 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafa136-cc4e-4862-b745-654a16e1d969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:01.490152 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafa136-cc4e-4862-b745-654a16e1d969 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:01.490463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafa136-cc4e-4862-b745-654a16e1d969 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:01.490746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafa136-cc4e-4862-b745-654a16e1d969 None admin] PATH_INFO: `/v3/users/3745aae7f1534a3fb431cd221c8dee48` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:01.492013 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafa136-cc4e-4862-b745-654a16e1d969 None admin] RBAC: Authorizing `identity:get_user(user_id=3745aae7f1534a3fb431cd221c8dee48)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:01.495543 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafa136-cc4e-4862-b745-654a16e1d969 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:01.498469 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 140/284] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:01 2022] GET /identity/v3/users/3745aae7f1534a3fb431cd221c8dee48 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:01.504686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8e70c-d237-405f-ab8e-456785f0a6cf None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:01.629345 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8e70c-d237-405f-ab8e-456785f0a6cf None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:01.645395 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:01.667320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe526ea3-8ece-408f-b979-97a8cc741c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:01.668135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe526ea3-8ece-408f-b979-97a8cc741c7b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:01.668420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe526ea3-8ece-408f-b979-97a8cc741c7b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:01.668698 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe526ea3-8ece-408f-b979-97a8cc741c7b None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:01.669978 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe526ea3-8ece-408f-b979-97a8cc741c7b None admin] RBAC: Authorizing `identity:get_project(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:01.673614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe526ea3-8ece-408f-b979-97a8cc741c7b None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:01.673614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 145/285] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:01 2022] GET /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:01.676479 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1af2f-d0e4-49de-8284-f78f515d9932 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:01.676770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1af2f-d0e4-49de-8284-f78f515d9932 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:01.677048 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1af2f-d0e4-49de-8284-f78f515d9932 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:01.680449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 141/286] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:01.681585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe526ea3-8ece-408f-b979-97a8cc741c7b None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:01.687960 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea7821-49ec-4348-8f47-9a30066722ef None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:01.688254 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea7821-49ec-4348-8f47-9a30066722ef None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:01.688530 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea7821-49ec-4348-8f47-9a30066722ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:01.712868 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-5cea7821-49ec-4348-8f47-9a30066722ef None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:01.714186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-5cea7821-49ec-4348-8f47-9a30066722ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:01.810158 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 142/287] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:01.814401 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe526ea3-8ece-408f-b979-97a8cc741c7b None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:01.832895 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea7821-49ec-4348-8f47-9a30066722ef None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:01.853079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9ea67-9668-468e-b750-afa306c4e4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:01.853776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9ea67-9668-468e-b750-afa306c4e4ed None admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:01.854120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9ea67-9668-468e-b750-afa306c4e4ed None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:01.854873 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9ea67-9668-468e-b750-afa306c4e4ed None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e/users/3745aae7f1534a3fb431cd221c8dee48/roles/1b8bdabcd591423d91aaf8f30f7cd6f5` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:01.857104 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9ea67-9668-468e-b750-afa306c4e4ed None admin] RBAC: Authorizing `identity:create_grant(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e, user_id=3745aae7f1534a3fb431cd221c8dee48, role_id=1b8bdabcd591423d91aaf8f30f7cd6f5)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:01.859026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9ea67-9668-468e-b750-afa306c4e4ed None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:01.871312 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:01.941166 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 146/288] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:40:01 2022] PUT /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e/users/3745aae7f1534a3fb431cd221c8dee48/roles/1b8bdabcd591423d91aaf8f30f7cd6f5 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:40:01.973373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea7821-49ec-4348-8f47-9a30066722ef None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:02.031673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a5b05-be22-4ad2-96a2-e4d82a9952f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:02.032722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a5b05-be22-4ad2-96a2-e4d82a9952f0 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:02.033211 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a5b05-be22-4ad2-96a2-e4d82a9952f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:02.033737 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a5b05-be22-4ad2-96a2-e4d82a9952f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:02.056525 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a5b05-be22-4ad2-96a2-e4d82a9952f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:02.062057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-f95a5b05-be22-4ad2-96a2-e4d82a9952f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:02.062057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:02.062057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:02.062057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:02.062057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:02.062057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:02.062057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:02.062057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:02.062057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:02.062057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:02.062057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:02.062057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:02.062057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:02.062057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:02.062057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:02.062057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:02.063016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:02.063016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:02.063016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:02.063016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:02.063016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:02.063016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:02.063016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:02.063016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:02.063016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:02.063016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:02.063016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:02.063016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:02.063016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:02.063016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:02.063016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:02.063016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:02.063795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:02.063795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:02.063795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:02.063795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:02.063795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:02.063795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:02.063795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:02.063795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:02.063795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:02.063795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:02.063795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:02.063795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:02.066205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 143/289] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:40:02.072999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9ea67-9668-468e-b750-afa306c4e4ed None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:02.157330 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:02.227455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9ea67-9668-468e-b750-afa306c4e4ed None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:02.265116 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9e8a2-7a44-40a4-bc91-85d48a055cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:02.265747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9e8a2-7a44-40a4-bc91-85d48a055cfb None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:02.266031 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9e8a2-7a44-40a4-bc91-85d48a055cfb None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:02.266305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9e8a2-7a44-40a4-bc91-85d48a055cfb None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:02.267102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9e8a2-7a44-40a4-bc91-85d48a055cfb None admin] RBAC: Adding query filter params (name=member) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:02.267405 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9e8a2-7a44-40a4-bc91-85d48a055cfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:02.268845 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9e8a2-7a44-40a4-bc91-85d48a055cfb None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:02.278956 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 147/290] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:40:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:02.284318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a5b05-be22-4ad2-96a2-e4d82a9952f0 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:02.443016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:02.460636 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a5b05-be22-4ad2-96a2-e4d82a9952f0 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:02.506777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f706ce-85ed-4b7f-8cec-4c549db8c606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:02.507440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f706ce-85ed-4b7f-8cec-4c549db8c606 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:02.507733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f706ce-85ed-4b7f-8cec-4c549db8c606 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:02.508053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f706ce-85ed-4b7f-8cec-4c549db8c606 None admin] PATH_INFO: `/v3/users/f352fe683e26434793efc35dc8446bee` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:02.515118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f706ce-85ed-4b7f-8cec-4c549db8c606 None admin] RBAC: Authorizing `identity:get_user(user_id=f352fe683e26434793efc35dc8446bee)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:02.516591 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f706ce-85ed-4b7f-8cec-4c549db8c606 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:02.518609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 144/291] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:02 2022] GET /identity/v3/users/f352fe683e26434793efc35dc8446bee => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:02.524479 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9e8a2-7a44-40a4-bc91-85d48a055cfb None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:02.705183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9e8a2-7a44-40a4-bc91-85d48a055cfb None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:02.711435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:02.753482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33123a2d-4a1a-4580-8c31-0b4acac3ea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:02.754122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33123a2d-4a1a-4580-8c31-0b4acac3ea65 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:02.754423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33123a2d-4a1a-4580-8c31-0b4acac3ea65 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:02.754711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33123a2d-4a1a-4580-8c31-0b4acac3ea65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:02.842218 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33123a2d-4a1a-4580-8c31-0b4acac3ea65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:02.844451 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33123a2d-4a1a-4580-8c31-0b4acac3ea65 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:02.959142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 148/292] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:02.965678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f706ce-85ed-4b7f-8cec-4c549db8c606 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:03.099739 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f706ce-85ed-4b7f-8cec-4c549db8c606 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:03.151948 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387f299-4990-4383-8931-b8e5de00cb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:03.152601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387f299-4990-4383-8931-b8e5de00cb3e None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:03.152887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387f299-4990-4383-8931-b8e5de00cb3e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:03.153165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387f299-4990-4383-8931-b8e5de00cb3e None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:03.154358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387f299-4990-4383-8931-b8e5de00cb3e None admin] RBAC: Authorizing `identity:get_project(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:03.155818 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387f299-4990-4383-8931-b8e5de00cb3e None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:03.157851 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 145/293] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:02 2022] GET /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:03.163758 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33123a2d-4a1a-4580-8c31-0b4acac3ea65 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:03.168397 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:03.280893 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33123a2d-4a1a-4580-8c31-0b4acac3ea65 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:03.322459 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299643b8-1ecd-4286-b75d-b2bbdd92153c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:03.323450 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299643b8-1ecd-4286-b75d-b2bbdd92153c None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:03.323934 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299643b8-1ecd-4286-b75d-b2bbdd92153c None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:03.324438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299643b8-1ecd-4286-b75d-b2bbdd92153c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:03.325432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299643b8-1ecd-4286-b75d-b2bbdd92153c None admin] RBAC: Adding query filter params (role.id=8303560a3b6948379f524afad4b798d0, scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e, user.id=f352fe683e26434793efc35dc8446bee) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:03.325945 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299643b8-1ecd-4286-b75d-b2bbdd92153c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:03.327608 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299643b8-1ecd-4286-b75d-b2bbdd92153c None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:03.334823 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 149/294] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:03 2022] GET /identity/v3/role_assignments?user.id=f352fe683e26434793efc35dc8446bee&scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e&role.id=8303560a3b6948379f524afad4b798d0 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:03.916914 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f074202-a397-4d8f-b2ae-93f640793063 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:03.917595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f074202-a397-4d8f-b2ae-93f640793063 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:03.918080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f074202-a397-4d8f-b2ae-93f640793063 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:03.919774 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 146/295] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:03.922046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aac30d-98cd-4e4c-9517-5c44caaed7ea None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:03.922520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aac30d-98cd-4e4c-9517-5c44caaed7ea None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:03.922596 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aac30d-98cd-4e4c-9517-5c44caaed7ea None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:03.924118 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 150/296] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:03.925013 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfbdaf-2565-4502-a127-512b15c16c1f None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:03.925298 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfbdaf-2565-4502-a127-512b15c16c1f None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:03.925578 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfbdaf-2565-4502-a127-512b15c16c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:03.929950 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9197c7-b576-4348-8674-a6c4380d3d19 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:03.930545 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9197c7-b576-4348-8674-a6c4380d3d19 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:03.931047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9197c7-b576-4348-8674-a6c4380d3d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:03.944752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-86bfbdaf-2565-4502-a127-512b15c16c1f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:03.945950 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-86bfbdaf-2565-4502-a127-512b15c16c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:03.951237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-7e9197c7-b576-4348-8674-a6c4380d3d19 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:03.952680 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-7e9197c7-b576-4348-8674-a6c4380d3d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:03.966047 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:04.040889 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 147/297] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:40:04.048156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:04.050149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 151/298] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:40:04.063814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfbdaf-2565-4502-a127-512b15c16c1f None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:04.074994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9197c7-b576-4348-8674-a6c4380d3d19 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:04.177584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfbdaf-2565-4502-a127-512b15c16c1f None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:04.201747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9197c7-b576-4348-8674-a6c4380d3d19 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:04.212984 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea9859-47f3-4af4-8f34-fc240fc08e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:04.213988 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea9859-47f3-4af4-8f34-fc240fc08e0e None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:04.214522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea9859-47f3-4af4-8f34-fc240fc08e0e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:04.215005 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea9859-47f3-4af4-8f34-fc240fc08e0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:04.225744 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea9859-47f3-4af4-8f34-fc240fc08e0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:04.230994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-45ea9859-47f3-4af4-8f34-fc240fc08e0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:40:04.230994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:04.230994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:04.230994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:04.230994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:04.230994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:04.230994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:04.230994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:04.230994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:04.230994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:04.230994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:04.230994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:04.230994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:04.230994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:04.230994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:04.230994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:04.231871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:04.231871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:04.231871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:04.231871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:04.231871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:04.231871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:04.231871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:04.231871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:04.231871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:04.231871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:04.231871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:04.231871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:04.231871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:04.231871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:04.231871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:04.231871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:04.232623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:04.232623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:04.232623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:04.232623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:04.232623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:04.232623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:04.232623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:04.232623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:04.232623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:04.232623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:04.232623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:40:04.232623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:04.234922 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 148/299] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:04.240638 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea9859-47f3-4af4-8f34-fc240fc08e0e None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:04.242694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66719878-9fa6-4d8d-8bad-295a74a4b8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:04.243392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66719878-9fa6-4d8d-8bad-295a74a4b8f1 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:04.243682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66719878-9fa6-4d8d-8bad-295a74a4b8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:04.243965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66719878-9fa6-4d8d-8bad-295a74a4b8f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:04.256752 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66719878-9fa6-4d8d-8bad-295a74a4b8f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:04.262794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-66719878-9fa6-4d8d-8bad-295a74a4b8f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:04.262794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:04.262794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:04.262794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:04.262794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:04.262794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:04.262794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:04.262794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:04.262794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:04.262794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:04.262794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:04.262794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:04.262794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:04.262794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:04.262794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:04.262794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:04.263660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:04.263660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:04.263660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:04.263660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:04.263660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:04.263660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:04.263660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:04.263660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:04.263660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:04.263660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:04.263660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:04.263660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:04.263660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:04.263660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:04.263660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:04.263660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:04.264427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:04.264427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:04.264427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:04.264427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:04.264427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:04.264427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:04.264427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:04.264427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:04.264427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:04.264427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:04.264427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:04.264427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:04.267023 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 152/300] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:40:04.270370 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:04.274151 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66719878-9fa6-4d8d-8bad-295a74a4b8f1 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:04.336795 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:04.367132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea9859-47f3-4af4-8f34-fc240fc08e0e None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:04.381602 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66719878-9fa6-4d8d-8bad-295a74a4b8f1 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:04.403015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a5eed-007a-4207-8ebc-255aa398b0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:04.403635 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a5eed-007a-4207-8ebc-255aa398b0ed None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:04.403920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a5eed-007a-4207-8ebc-255aa398b0ed None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:04.404195 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a5eed-007a-4207-8ebc-255aa398b0ed None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:04.404907 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a5eed-007a-4207-8ebc-255aa398b0ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:04.405210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a5eed-007a-4207-8ebc-255aa398b0ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:04.406614 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a5eed-007a-4207-8ebc-255aa398b0ed None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:04.414548 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 149/301] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:40:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:04.415723 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55015d-3afe-4f60-a7f0-0721402d377a None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:04.416011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55015d-3afe-4f60-a7f0-0721402d377a None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:04.416290 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55015d-3afe-4f60-a7f0-0721402d377a None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:04.417500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 150/302] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:04.418551 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adc2cd-92ad-488b-8250-5fd8b8d435d7 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:04.418834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adc2cd-92ad-488b-8250-5fd8b8d435d7 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:04.419325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adc2cd-92ad-488b-8250-5fd8b8d435d7 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:04.420530 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 151/303] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:04.420936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899e72a-e480-4366-9444-39afa13d32cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:04.421221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adc2cd-92ad-488b-8250-5fd8b8d435d7 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:04.422017 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899e72a-e480-4366-9444-39afa13d32cb None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:04.422641 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899e72a-e480-4366-9444-39afa13d32cb None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:04.423089 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899e72a-e480-4366-9444-39afa13d32cb None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:04.424032 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899e72a-e480-4366-9444-39afa13d32cb None admin] RBAC: Adding query filter params (name=member) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:04.424550 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899e72a-e480-4366-9444-39afa13d32cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:04.425938 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899e72a-e480-4366-9444-39afa13d32cb None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:04.437163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 153/304] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:40:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:04.437322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aba273-d6fc-4f14-a15b-10be3a0783a4 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:04.437505 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aba273-d6fc-4f14-a15b-10be3a0783a4 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:04.437787 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aba273-d6fc-4f14-a15b-10be3a0783a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:04.456074 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-88aba273-d6fc-4f14-a15b-10be3a0783a4 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:04.457319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-88aba273-d6fc-4f14-a15b-10be3a0783a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:04.509462 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:04.526510 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 154/305] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:04.527821 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37798cbe-1c4c-4f3c-a16d-b948e5966563 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:04.528114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37798cbe-1c4c-4f3c-a16d-b948e5966563 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:04.528393 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37798cbe-1c4c-4f3c-a16d-b948e5966563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:04.533411 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adc2cd-92ad-488b-8250-5fd8b8d435d7 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:04.552058 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-37798cbe-1c4c-4f3c-a16d-b948e5966563 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:04.553373 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-37798cbe-1c4c-4f3c-a16d-b948e5966563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:04.568215 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438fcda-689c-47ef-875a-bc1545c1e94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:04.568867 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438fcda-689c-47ef-875a-bc1545c1e94b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:04.569152 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438fcda-689c-47ef-875a-bc1545c1e94b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:04.569430 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438fcda-689c-47ef-875a-bc1545c1e94b None admin] PATH_INFO: `/v3/users/bf45b230541743ddb01d168c405ebf27` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:04.583950 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438fcda-689c-47ef-875a-bc1545c1e94b None admin] RBAC: Authorizing `identity:get_user(user_id=bf45b230541743ddb01d168c405ebf27)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:04.585405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438fcda-689c-47ef-875a-bc1545c1e94b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:04.587117 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 152/306] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:04 2022] GET /identity/v3/users/bf45b230541743ddb01d168c405ebf27 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:04.587882 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438fcda-689c-47ef-875a-bc1545c1e94b None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:04.605457 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:04.630452 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 155/307] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:04.632297 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37798cbe-1c4c-4f3c-a16d-b948e5966563 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:04.703811 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438fcda-689c-47ef-875a-bc1545c1e94b None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:04.737734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370f955-3dd3-4bed-b125-787d7ec23694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:04.737913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37798cbe-1c4c-4f3c-a16d-b948e5966563 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:04.738381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370f955-3dd3-4bed-b125-787d7ec23694 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:04.738694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370f955-3dd3-4bed-b125-787d7ec23694 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:04.738970 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370f955-3dd3-4bed-b125-787d7ec23694 None admin] PATH_INFO: `/v3/users/30c3f719262544f989ac7b56b4d40794` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:04.740140 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370f955-3dd3-4bed-b125-787d7ec23694 None admin] RBAC: Authorizing `identity:get_user(user_id=30c3f719262544f989ac7b56b4d40794)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:04.741578 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370f955-3dd3-4bed-b125-787d7ec23694 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:04.743297 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 153/308] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:04 2022] GET /identity/v3/users/30c3f719262544f989ac7b56b4d40794 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:04.748862 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370f955-3dd3-4bed-b125-787d7ec23694 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:04.748862 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:04.772284 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97179f35-b336-42ea-8e74-6aae9d94d2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:04.772929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97179f35-b336-42ea-8e74-6aae9d94d2c4 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:04.773215 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97179f35-b336-42ea-8e74-6aae9d94d2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:04.773491 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97179f35-b336-42ea-8e74-6aae9d94d2c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:04.774770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97179f35-b336-42ea-8e74-6aae9d94d2c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:04.776212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97179f35-b336-42ea-8e74-6aae9d94d2c4 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:04.777823 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 156/309] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:04.778611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97179f35-b336-42ea-8e74-6aae9d94d2c4 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:04.828232 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:04.844017 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370f955-3dd3-4bed-b125-787d7ec23694 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:04.880001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97179f35-b336-42ea-8e74-6aae9d94d2c4 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:04.887507 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73a104-eaaa-4129-ab92-c01bcbb8d3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:04.888133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73a104-eaaa-4129-ab92-c01bcbb8d3bb None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:04.888411 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73a104-eaaa-4129-ab92-c01bcbb8d3bb None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:04.888732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73a104-eaaa-4129-ab92-c01bcbb8d3bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:04.889515 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73a104-eaaa-4129-ab92-c01bcbb8d3bb None admin] RBAC: Adding query filter params (role.id=1b8bdabcd591423d91aaf8f30f7cd6f5, user.id=bf45b230541743ddb01d168c405ebf27, scope.system=all) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:04.889828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73a104-eaaa-4129-ab92-c01bcbb8d3bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:04.891279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73a104-eaaa-4129-ab92-c01bcbb8d3bb None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:04.896350 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 154/310] 10.222.0.86 () {56 vars in 1308 bytes} [Tue Jul 26 14:40:04 2022] GET /identity/v3/role_assignments?user.id=bf45b230541743ddb01d168c405ebf27&scope.system=all&role.id=1b8bdabcd591423d91aaf8f30f7cd6f5 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:04.896926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73a104-eaaa-4129-ab92-c01bcbb8d3bb None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:04.933774 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e48a98-4a73-4343-8951-61c89c850b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:04.934610 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e48a98-4a73-4343-8951-61c89c850b77 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:04.934898 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e48a98-4a73-4343-8951-61c89c850b77 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:04.935178 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e48a98-4a73-4343-8951-61c89c850b77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:04.946949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e48a98-4a73-4343-8951-61c89c850b77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:04.952120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-87e48a98-4a73-4343-8951-61c89c850b77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:40:04.952120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:04.952120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:04.952120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:04.952120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:04.952120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:04.952120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:04.952120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:04.952120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:04.952120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:04.952120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:04.952120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:04.952120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:04.952120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:04.952120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:04.952120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:04.953096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:04.953096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:04.953096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:04.953096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:04.953096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:04.953096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:04.953096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:04.953096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:04.953096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:04.953096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:04.953096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:04.953096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:04.953096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:04.953096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:04.953096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:04.953096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:04.953948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:04.953948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:04.953948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:04.953948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:04.953948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:04.953948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:04.953948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:04.953948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:04.953948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:04.953948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:04.953948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:40:04.953948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:04.953948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 157/311] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:04.955361 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e48a98-4a73-4343-8951-61c89c850b77 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:04.981645 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:05.030796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73a104-eaaa-4129-ab92-c01bcbb8d3bb None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:05.070980 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04eff04-8ed8-40cb-b2cc-0f3627c3943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:05.071875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e48a98-4a73-4343-8951-61c89c850b77 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:05.072144 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04eff04-8ed8-40cb-b2cc-0f3627c3943c None admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:05.072425 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04eff04-8ed8-40cb-b2cc-0f3627c3943c None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:05.072698 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04eff04-8ed8-40cb-b2cc-0f3627c3943c None admin] PATH_INFO: `/v3/system/users/30c3f719262544f989ac7b56b4d40794/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:05.074139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04eff04-8ed8-40cb-b2cc-0f3627c3943c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=30c3f719262544f989ac7b56b4d40794, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:05.075555 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04eff04-8ed8-40cb-b2cc-0f3627c3943c None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:05.083869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:05.109001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2900c3a-4228-41a3-a119-227e1a6a7295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:05.109627 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2900c3a-4228-41a3-a119-227e1a6a7295 None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:05.109915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2900c3a-4228-41a3-a119-227e1a6a7295 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:05.110196 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2900c3a-4228-41a3-a119-227e1a6a7295 None admin] PATH_INFO: `/v3/groups` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:05.110901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2900c3a-4228-41a3-a119-227e1a6a7295 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:05.112360 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2900c3a-4228-41a3-a119-227e1a6a7295 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:05.171009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 155/312] 10.222.0.86 () {58 vars in 1334 bytes} [Tue Jul 26 14:40:04 2022] PUT /identity/v3/system/users/30c3f719262544f989ac7b56b4d40794/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:40:05.172012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04eff04-8ed8-40cb-b2cc-0f3627c3943c None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:05.222773 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 158/313] 10.222.0.86 () {60 vars in 1134 bytes} [Tue Jul 26 14:40:04 2022] POST /identity/v3/groups => generated 229 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:40:05.314346 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04eff04-8ed8-40cb-b2cc-0f3627c3943c None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:05.348894 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:05.356363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7ffd3-feaf-4451-b548-20a95e5a57ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:05.357165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7ffd3-feaf-4451-b548-20a95e5a57ff None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:05.357452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7ffd3-feaf-4451-b548-20a95e5a57ff None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:05.357774 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7ffd3-feaf-4451-b548-20a95e5a57ff None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:05.358574 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7ffd3-feaf-4451-b548-20a95e5a57ff None admin] RBAC: Adding query filter params (name=reader) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:05.358885 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7ffd3-feaf-4451-b548-20a95e5a57ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:05.360291 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7ffd3-feaf-4451-b548-20a95e5a57ff None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:05.371833 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 156/314] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:40:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:05.377569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2900c3a-4228-41a3-a119-227e1a6a7295 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:05.491927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2900c3a-4228-41a3-a119-227e1a6a7295 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:05.527957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6ab4f-1e36-452c-9d70-e669af89fd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:05.528603 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6ab4f-1e36-452c-9d70-e669af89fd51 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:05.528928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6ab4f-1e36-452c-9d70-e669af89fd51 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:05.529243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6ab4f-1e36-452c-9d70-e669af89fd51 None admin] PATH_INFO: `/v3/users/3745aae7f1534a3fb431cd221c8dee48` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:05.530455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6ab4f-1e36-452c-9d70-e669af89fd51 None admin] RBAC: Authorizing `identity:get_user(user_id=3745aae7f1534a3fb431cd221c8dee48)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:05.531971 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6ab4f-1e36-452c-9d70-e669af89fd51 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:05.533966 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 159/315] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:05 2022] GET /identity/v3/users/3745aae7f1534a3fb431cd221c8dee48 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:05.539318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7ffd3-feaf-4451-b548-20a95e5a57ff None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:05.658816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7ffd3-feaf-4451-b548-20a95e5a57ff None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:05.695875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0cdfd-a574-4eef-82db-551bfc730234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:05.696816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0cdfd-a574-4eef-82db-551bfc730234 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:05.697274 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0cdfd-a574-4eef-82db-551bfc730234 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:05.697714 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0cdfd-a574-4eef-82db-551bfc730234 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:05.762467 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:05.771893 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0cdfd-a574-4eef-82db-551bfc730234 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:05.773353 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0cdfd-a574-4eef-82db-551bfc730234 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:05.874503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 157/316] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:05.886436 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6ab4f-1e36-452c-9d70-e669af89fd51 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:05.923759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:05.995739 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6ab4f-1e36-452c-9d70-e669af89fd51 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:06.031509 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4fb17-5999-4396-a374-e2660b6f52e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:06.032080 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4fb17-5999-4396-a374-e2660b6f52e5 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:06.032368 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4fb17-5999-4396-a374-e2660b6f52e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:06.032648 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4fb17-5999-4396-a374-e2660b6f52e5 None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:06.033847 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4fb17-5999-4396-a374-e2660b6f52e5 None admin] RBAC: Authorizing `identity:get_project(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:06.035374 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4fb17-5999-4396-a374-e2660b6f52e5 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:06.037502 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 160/317] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:05 2022] GET /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:06.044110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0cdfd-a574-4eef-82db-551bfc730234 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:06.142252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:06.152492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0cdfd-a574-4eef-82db-551bfc730234 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:06.190553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14503fc-cfb4-48d4-902f-2ff9a04d8e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:06.191491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14503fc-cfb4-48d4-902f-2ff9a04d8e3a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:06.191966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14503fc-cfb4-48d4-902f-2ff9a04d8e3a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:06.192436 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14503fc-cfb4-48d4-902f-2ff9a04d8e3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:06.193499 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14503fc-cfb4-48d4-902f-2ff9a04d8e3a None admin] RBAC: Adding query filter params (role.id=1b8bdabcd591423d91aaf8f30f7cd6f5, scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e, user.id=3745aae7f1534a3fb431cd221c8dee48) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:06.194017 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14503fc-cfb4-48d4-902f-2ff9a04d8e3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:06.195665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14503fc-cfb4-48d4-902f-2ff9a04d8e3a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:06.202248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 158/318] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:06 2022] GET /identity/v3/role_assignments?user.id=3745aae7f1534a3fb431cd221c8dee48&scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e&role.id=1b8bdabcd591423d91aaf8f30f7cd6f5 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:06.953769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe318b19-8034-44c7-89f7-f04604f3e006 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:06.954116 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe318b19-8034-44c7-89f7-f04604f3e006 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:06.954291 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe318b19-8034-44c7-89f7-f04604f3e006 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:06.955745 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 161/319] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:06.961133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae87a9d-bf0a-47ff-b193-34166ff9d28b None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:06.961429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae87a9d-bf0a-47ff-b193-34166ff9d28b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:06.962245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae87a9d-bf0a-47ff-b193-34166ff9d28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:06.981431 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-cae87a9d-bf0a-47ff-b193-34166ff9d28b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:06.982660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-cae87a9d-bf0a-47ff-b193-34166ff9d28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:07.050901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 159/320] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:07.073055 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe318b19-8034-44c7-89f7-f04604f3e006 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:07.176799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe318b19-8034-44c7-89f7-f04604f3e006 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:07.180706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:07.216021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98943de2-6105-46d5-9b80-b4d6f274f93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:07.216597 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98943de2-6105-46d5-9b80-b4d6f274f93c None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:07.216883 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98943de2-6105-46d5-9b80-b4d6f274f93c None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:07.217164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98943de2-6105-46d5-9b80-b4d6f274f93c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:07.229264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98943de2-6105-46d5-9b80-b4d6f274f93c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:07.234233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-98943de2-6105-46d5-9b80-b4d6f274f93c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:40:07.234233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:07.234233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:07.234233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:07.234233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:07.234233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:07.234233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:07.234233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:07.234233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:07.234233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:07.234233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:07.234233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:07.234233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:07.234233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:07.234233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:07.234233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:07.235135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:07.235135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:07.235135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:07.235135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:07.235135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:07.235135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:07.235135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:07.235135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:07.235135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:07.235135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:07.235135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:07.235135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:07.235135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:07.235135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:07.235135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:07.235135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:07.235905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:07.235905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:07.235905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:07.235905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:07.235905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:07.235905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:07.235905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:07.235905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:07.235905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:07.235905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:07.235905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:40:07.235905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:07.238474 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 162/321] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:07.241499 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae87a9d-bf0a-47ff-b193-34166ff9d28b None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:07.273669 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b6426-9363-439e-87e3-8c952a88f61b None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:07.274033 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b6426-9363-439e-87e3-8c952a88f61b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:07.274287 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b6426-9363-439e-87e3-8c952a88f61b None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:07.276683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 163/322] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:40:07.285057 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc871d-13d2-44ad-b058-38efbe7c446b None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:07.285624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc871d-13d2-44ad-b058-38efbe7c446b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:07.287775 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc871d-13d2-44ad-b058-38efbe7c446b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:07.307300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-bffc871d-13d2-44ad-b058-38efbe7c446b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:07.308959 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-bffc871d-13d2-44ad-b058-38efbe7c446b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:07.370810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:07.386126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae87a9d-bf0a-47ff-b193-34166ff9d28b None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:07.389206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 164/323] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:07.389761 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac883e-efbb-4a82-9f07-5c41be362bf4 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:07.390058 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac883e-efbb-4a82-9f07-5c41be362bf4 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:07.390341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac883e-efbb-4a82-9f07-5c41be362bf4 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:07.394364 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 165/324] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:07.396751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b3247-2230-4716-9a63-116d9b4cce0d None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:07.397043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b3247-2230-4716-9a63-116d9b4cce0d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:07.397323 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b3247-2230-4716-9a63-116d9b4cce0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:07.416671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-e28b3247-2230-4716-9a63-116d9b4cce0d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:07.417856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e28b3247-2230-4716-9a63-116d9b4cce0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:07.422628 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2c48b-b390-48ad-a313-bbd5f9c8a681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:07.423255 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2c48b-b390-48ad-a313-bbd5f9c8a681 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:07.423540 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2c48b-b390-48ad-a313-bbd5f9c8a681 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:07.423814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2c48b-b390-48ad-a313-bbd5f9c8a681 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:07.424522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2c48b-b390-48ad-a313-bbd5f9c8a681 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:07.424835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2c48b-b390-48ad-a313-bbd5f9c8a681 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:07.426204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2c48b-b390-48ad-a313-bbd5f9c8a681 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:07.434646 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 160/325] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:40:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:07.435369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2c48b-b390-48ad-a313-bbd5f9c8a681 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:07.488973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 166/326] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:40:07.489601 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b3247-2230-4716-9a63-116d9b4cce0d None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:07.516640 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:07.543534 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2c48b-b390-48ad-a313-bbd5f9c8a681 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:07.577203 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b3cd1-443f-4f41-99a9-4024a1254a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:07.577852 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b3cd1-443f-4f41-99a9-4024a1254a80 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:07.578130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b3cd1-443f-4f41-99a9-4024a1254a80 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:07.578423 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b3cd1-443f-4f41-99a9-4024a1254a80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:07.589099 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b3cd1-443f-4f41-99a9-4024a1254a80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:07.592174 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b3247-2230-4716-9a63-116d9b4cce0d None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:07.594409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-6f3b3cd1-443f-4f41-99a9-4024a1254a80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:07.594409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:07.594409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:07.594409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:07.594409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:07.594409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:07.594409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:07.594409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:07.594409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:07.594409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:07.594409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:07.594409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:07.594409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:07.594409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:07.594409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:07.594409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:07.595476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:07.595476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:07.595476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:07.595476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:07.595476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:07.595476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:07.595476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:07.595476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:07.595476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:07.595476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:07.595476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:07.595476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:07.595476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:07.595476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:07.595476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:07.595476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:07.596381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:07.596381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:07.596381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:07.596381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:07.596381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:07.596381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:07.596381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:07.596381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:07.596381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:07.596381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:07.596381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:07.596381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:07.596381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 161/327] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:07.600989 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b3cd1-443f-4f41-99a9-4024a1254a80 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:07.612721 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:07.642799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a33e8-58a6-4e3d-b303-03bde1a1c788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:07.643456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a33e8-58a6-4e3d-b303-03bde1a1c788 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:07.643741 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a33e8-58a6-4e3d-b303-03bde1a1c788 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:07.644078 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a33e8-58a6-4e3d-b303-03bde1a1c788 None admin] PATH_INFO: `/v3/users/bf45b230541743ddb01d168c405ebf27` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:07.645317 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a33e8-58a6-4e3d-b303-03bde1a1c788 None admin] RBAC: Authorizing `identity:get_user(user_id=bf45b230541743ddb01d168c405ebf27)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:07.646818 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a33e8-58a6-4e3d-b303-03bde1a1c788 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:07.648430 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 167/328] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:07 2022] GET /identity/v3/users/bf45b230541743ddb01d168c405ebf27 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:07.649705 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a33e8-58a6-4e3d-b303-03bde1a1c788 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:07.731458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b3cd1-443f-4f41-99a9-4024a1254a80 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:07.747856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:07.756501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a33e8-58a6-4e3d-b303-03bde1a1c788 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:07.765342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b547d58-1712-46e6-b6a7-22f7b259c09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:07.765987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b547d58-1712-46e6-b6a7-22f7b259c09b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:07.766267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b547d58-1712-46e6-b6a7-22f7b259c09b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:07.766571 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b547d58-1712-46e6-b6a7-22f7b259c09b None admin] PATH_INFO: `/v3/domains/default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:07.767697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b547d58-1712-46e6-b6a7-22f7b259c09b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:07.769146 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b547d58-1712-46e6-b6a7-22f7b259c09b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:07.770749 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 162/329] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:07.771557 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b547d58-1712-46e6-b6a7-22f7b259c09b None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:07.792002 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa5086-0b2c-40a2-a2c7-837c1a5dc539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:07.792631 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa5086-0b2c-40a2-a2c7-837c1a5dc539 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:07.792916 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa5086-0b2c-40a2-a2c7-837c1a5dc539 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:07.793199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa5086-0b2c-40a2-a2c7-837c1a5dc539 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:07.793914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa5086-0b2c-40a2-a2c7-837c1a5dc539 None admin] RBAC: Adding query filter params (name=member) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:07.794223 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa5086-0b2c-40a2-a2c7-837c1a5dc539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:07.795666 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa5086-0b2c-40a2-a2c7-837c1a5dc539 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:07.804175 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 168/330] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:40:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:07.804934 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa5086-0b2c-40a2-a2c7-837c1a5dc539 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:07.849470 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:07.872509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b547d58-1712-46e6-b6a7-22f7b259c09b None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:07.906006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa5086-0b2c-40a2-a2c7-837c1a5dc539 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:07.907483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ccb79-fbbd-4e97-ae63-186cec2dedb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:07.908151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ccb79-fbbd-4e97-ae63-186cec2dedb2 None admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:07.908434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ccb79-fbbd-4e97-ae63-186cec2dedb2 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:07.908711 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ccb79-fbbd-4e97-ae63-186cec2dedb2 None admin] PATH_INFO: `/v3/system/users/bf45b230541743ddb01d168c405ebf27/roles/1b8bdabcd591423d91aaf8f30f7cd6f5` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:07.910218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ccb79-fbbd-4e97-ae63-186cec2dedb2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bf45b230541743ddb01d168c405ebf27, role_id=1b8bdabcd591423d91aaf8f30f7cd6f5)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:07.911613 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ccb79-fbbd-4e97-ae63-186cec2dedb2 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:07.939709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283258f-5a9d-4ff7-a786-2ac50e50ba39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:07.940329 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283258f-5a9d-4ff7-a786-2ac50e50ba39 None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:07.940618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283258f-5a9d-4ff7-a786-2ac50e50ba39 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:07.940901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283258f-5a9d-4ff7-a786-2ac50e50ba39 None admin] PATH_INFO: `/v3/groups` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:07.941566 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283258f-5a9d-4ff7-a786-2ac50e50ba39 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:07.943070 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283258f-5a9d-4ff7-a786-2ac50e50ba39 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:07.972668 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 163/331] 10.222.0.86 () {58 vars in 1334 bytes} [Tue Jul 26 14:40:07 2022] PUT /identity/v3/system/users/bf45b230541743ddb01d168c405ebf27/roles/1b8bdabcd591423d91aaf8f30f7cd6f5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:40:07.973508 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ccb79-fbbd-4e97-ae63-186cec2dedb2 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:08.034767 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 169/332] 10.222.0.86 () {60 vars in 1134 bytes} [Tue Jul 26 14:40:07 2022] POST /identity/v3/groups => generated 226 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:40:08.095777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ccb79-fbbd-4e97-ae63-186cec2dedb2 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:08.138235 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c29259-3c9f-407c-92e1-9acc2d3af522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:08.138946 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c29259-3c9f-407c-92e1-9acc2d3af522 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:08.139232 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c29259-3c9f-407c-92e1-9acc2d3af522 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:08.139509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c29259-3c9f-407c-92e1-9acc2d3af522 None admin] PATH_INFO: `/v3/users/30c3f719262544f989ac7b56b4d40794` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:08.141454 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c29259-3c9f-407c-92e1-9acc2d3af522 None admin] RBAC: Authorizing `identity:get_user(user_id=30c3f719262544f989ac7b56b4d40794)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:08.143166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c29259-3c9f-407c-92e1-9acc2d3af522 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:08.145591 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 164/333] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:07 2022] GET /identity/v3/users/30c3f719262544f989ac7b56b4d40794 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:08.151057 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283258f-5a9d-4ff7-a786-2ac50e50ba39 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:08.169836 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:08.267938 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283258f-5a9d-4ff7-a786-2ac50e50ba39 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:08.304018 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e5991-2e77-4ebb-be83-ab5c3932882b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:08.304579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e5991-2e77-4ebb-be83-ab5c3932882b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:08.304867 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e5991-2e77-4ebb-be83-ab5c3932882b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:08.305147 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e5991-2e77-4ebb-be83-ab5c3932882b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:08.306487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e5991-2e77-4ebb-be83-ab5c3932882b None admin] RBAC: Adding query filter params (role.id=8303560a3b6948379f524afad4b798d0, user.id=30c3f719262544f989ac7b56b4d40794, scope.system=all) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:08.306810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e5991-2e77-4ebb-be83-ab5c3932882b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:08.308289 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e5991-2e77-4ebb-be83-ab5c3932882b None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:08.324015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 170/334] 10.222.0.86 () {56 vars in 1308 bytes} [Tue Jul 26 14:40:08 2022] GET /identity/v3/role_assignments?user.id=30c3f719262544f989ac7b56b4d40794&scope.system=all&role.id=8303560a3b6948379f524afad4b798d0 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:10.292037 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df34c5-e3e8-43b3-a548-227b20b3239b None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:10.292945 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df34c5-e3e8-43b3-a548-227b20b3239b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:10.293403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df34c5-e3e8-43b3-a548-227b20b3239b None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:10.295261 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 165/335] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:10.300325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d69e4f-ee8f-4676-b5a7-23365e817dab None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:10.300738 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d69e4f-ee8f-4676-b5a7-23365e817dab None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:10.300894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d69e4f-ee8f-4676-b5a7-23365e817dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:10.327397 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-a6d69e4f-ee8f-4676-b5a7-23365e817dab None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:10.328618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a6d69e4f-ee8f-4676-b5a7-23365e817dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:10.424871 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 171/336] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:40:10.468051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df34c5-e3e8-43b3-a548-227b20b3239b None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:10.480304 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:10.603182 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df34c5-e3e8-43b3-a548-227b20b3239b None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:10.643282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe2747-8b10-46fa-8b4f-ff30848b132d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:10.643941 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe2747-8b10-46fa-8b4f-ff30848b132d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:10.644229 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe2747-8b10-46fa-8b4f-ff30848b132d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:10.644510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe2747-8b10-46fa-8b4f-ff30848b132d None admin] PATH_INFO: `/v3/roles/member` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:10.660036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe2747-8b10-46fa-8b4f-ff30848b132d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:10.665084 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3599cd6-07d4-4720-9194-070f727e9a4d None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:10.665610 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3599cd6-07d4-4720-9194-070f727e9a4d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:10.665808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-96fe2747-8b10-46fa-8b4f-ff30848b132d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:10.665808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:10.665808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:10.665808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:10.665808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:10.665808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:10.665808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:10.665808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:10.665808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:10.665808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:10.665808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:10.665808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:10.665808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:10.665808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:10.665808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:10.665808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:10.667009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:10.667009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:10.667009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:10.667009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:10.667009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:10.667009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:10.667009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:10.667009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:10.667009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:10.667009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:10.667009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:10.667009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:10.667009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:10.667009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:10.667009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:10.667009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:10.667802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:10.667802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:10.667802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:10.667802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:10.667802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:10.667802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:10.667802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:10.667802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:10.667802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:10.667802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:10.667802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:10.667802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:10.667802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 166/337] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:10.690413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3599cd6-07d4-4720-9194-070f727e9a4d None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:10.691942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe2747-8b10-46fa-8b4f-ff30848b132d None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:10.693184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 172/338] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:10 2022] GET /identity => generated 270 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:10.699014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf46b6-a7d3-47a6-9597-d8f6a2622f63 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:10.699568 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf46b6-a7d3-47a6-9597-d8f6a2622f63 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:10.700113 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf46b6-a7d3-47a6-9597-d8f6a2622f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:10.707779 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:10.726604 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-eaaf46b6-a7d3-47a6-9597-d8f6a2622f63 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:10.728878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-eaaf46b6-a7d3-47a6-9597-d8f6a2622f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:10.782538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:10.825369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe2747-8b10-46fa-8b4f-ff30848b132d None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:10.857483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 173/339] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:10.887149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aad5ff-4608-4257-a168-38af5cb0e032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:10.887793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aad5ff-4608-4257-a168-38af5cb0e032 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:10.888085 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aad5ff-4608-4257-a168-38af5cb0e032 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:10.888366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aad5ff-4608-4257-a168-38af5cb0e032 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:10.889197 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aad5ff-4608-4257-a168-38af5cb0e032 None admin] RBAC: Adding query filter params (name=member) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:10.889510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aad5ff-4608-4257-a168-38af5cb0e032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:10.890944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aad5ff-4608-4257-a168-38af5cb0e032 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:10.898516 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf46b6-a7d3-47a6-9597-d8f6a2622f63 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:10.903013 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 167/340] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:40:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:10.911203 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aad5ff-4608-4257-a168-38af5cb0e032 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:11.045280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf46b6-a7d3-47a6-9597-d8f6a2622f63 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:11.045625 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aad5ff-4608-4257-a168-38af5cb0e032 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:11.080972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:11.088015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf712c8-2f99-4fef-a0f8-341e39f31f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:11.088916 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf712c8-2f99-4fef-a0f8-341e39f31f0f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:11.089301 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf712c8-2f99-4fef-a0f8-341e39f31f0f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:11.089680 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf712c8-2f99-4fef-a0f8-341e39f31f0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:11.094747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:11.107084 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfc5ce-d1e3-4a0a-8cdc-cd2e7fadcbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:11.108079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfc5ce-d1e3-4a0a-8cdc-cd2e7fadcbc4 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:11.108525 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfc5ce-d1e3-4a0a-8cdc-cd2e7fadcbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:11.108974 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfc5ce-d1e3-4a0a-8cdc-cd2e7fadcbc4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:11.143285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfc5ce-d1e3-4a0a-8cdc-cd2e7fadcbc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:11.148816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-41cfc5ce-d1e3-4a0a-8cdc-cd2e7fadcbc4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:40:11.148816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:11.148816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:11.148816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:11.148816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:11.148816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:11.148816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:11.148816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:11.148816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:11.148816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:11.148816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:11.148816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:11.148816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:11.148816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:11.148816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:11.148816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:11.150259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:11.150259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:11.150259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:11.150259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:11.150259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:11.150259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:11.150259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:11.150259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:11.150259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:11.150259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:11.150259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:11.150259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:11.150259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:11.150259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:11.150259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:11.150259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:11.151103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:11.151103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:11.151103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:11.151103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:11.151103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:11.151103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:11.151103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:11.151103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:11.151103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:11.151103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:11.151103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:40:11.151103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:11.153861 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 174/341] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:40:11.155849 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd6b65-ec7d-4573-874d-5b2994e7bee8 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:11.156384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd6b65-ec7d-4573-874d-5b2994e7bee8 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:11.156872 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd6b65-ec7d-4573-874d-5b2994e7bee8 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:11.161764 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 175/342] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:11.166701 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be991093-80e8-4d0d-99ea-0437f93a4f36 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:11.166701 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be991093-80e8-4d0d-99ea-0437f93a4f36 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:11.166701 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be991093-80e8-4d0d-99ea-0437f93a4f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:11.167661 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf712c8-2f99-4fef-a0f8-341e39f31f0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:11.174470 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf712c8-2f99-4fef-a0f8-341e39f31f0f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:11.197441 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-be991093-80e8-4d0d-99ea-0437f93a4f36 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:11.199001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-be991093-80e8-4d0d-99ea-0437f93a4f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:11.288431 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 168/343] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:40:11.289300 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf712c8-2f99-4fef-a0f8-341e39f31f0f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:11.326778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:11.350168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 176/344] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:11.351676 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be991093-80e8-4d0d-99ea-0437f93a4f36 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:11.411131 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf712c8-2f99-4fef-a0f8-341e39f31f0f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:11.482800 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87085a90-a8cc-4f2e-9fa6-220d9973888c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:11.483439 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87085a90-a8cc-4f2e-9fa6-220d9973888c None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:11.483723 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87085a90-a8cc-4f2e-9fa6-220d9973888c None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:11.484003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87085a90-a8cc-4f2e-9fa6-220d9973888c None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:11.484734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87085a90-a8cc-4f2e-9fa6-220d9973888c None admin] RBAC: Adding query filter params (name=reader) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:11.485045 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87085a90-a8cc-4f2e-9fa6-220d9973888c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:11.486433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87085a90-a8cc-4f2e-9fa6-220d9973888c None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:11.504661 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 169/345] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:40:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:11.505520 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87085a90-a8cc-4f2e-9fa6-220d9973888c None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:11.542906 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be991093-80e8-4d0d-99ea-0437f93a4f36 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:11.584167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:11.595957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e77f5-985f-4c3b-9407-ebf60ae79838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:11.596621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e77f5-985f-4c3b-9407-ebf60ae79838 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:11.597792 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e77f5-985f-4c3b-9407-ebf60ae79838 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:11.597792 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e77f5-985f-4c3b-9407-ebf60ae79838 None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:11.598340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e77f5-985f-4c3b-9407-ebf60ae79838 None admin] RBAC: Authorizing `identity:get_project(project_id=4fab63748076484db8b585b850783e19)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:11.599832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e77f5-985f-4c3b-9407-ebf60ae79838 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:11.601517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 177/346] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:11 2022] GET /identity/v3/projects/4fab63748076484db8b585b850783e19 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:11.602323 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e77f5-985f-4c3b-9407-ebf60ae79838 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:11.642082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:11.653017 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87085a90-a8cc-4f2e-9fa6-220d9973888c None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:11.691868 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b6bc4-a7c1-43f9-aa53-f79bff9cb2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:11.692529 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b6bc4-a7c1-43f9-aa53-f79bff9cb2a0 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:11.692902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b6bc4-a7c1-43f9-aa53-f79bff9cb2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:11.693090 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b6bc4-a7c1-43f9-aa53-f79bff9cb2a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:11.706003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b6bc4-a7c1-43f9-aa53-f79bff9cb2a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:11.711032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-4b1b6bc4-a7c1-43f9-aa53-f79bff9cb2a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:40:11.711032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:11.711032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:11.711032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:11.711032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:11.711032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:11.711032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:11.711032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:11.711032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:11.711032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:11.711032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:11.711032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:11.711032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:11.711032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:11.711032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:11.711032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:11.712750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:11.712750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:11.712750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:11.712750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:11.712750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:11.712750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:11.712750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:11.712750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:11.712750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:11.712750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:11.712750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:11.712750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:11.712750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:11.712750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:11.712750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:11.712750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:11.713607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:11.713607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:11.713607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:11.713607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:11.713607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:11.713607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:11.713607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:11.713607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:11.713607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:11.713607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:11.713607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:40:11.713607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:11.713607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 170/347] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:40:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:11.715733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f4724-1f85-40a8-bd4e-23deba2b604e None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:11.715733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f4724-1f85-40a8-bd4e-23deba2b604e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:11.715733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f4724-1f85-40a8-bd4e-23deba2b604e None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:11.717097 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 171/348] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:11.717811 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f4724-1f85-40a8-bd4e-23deba2b604e None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:11.736564 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e77f5-985f-4c3b-9407-ebf60ae79838 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:11.778507 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21bc08-e843-4a96-9b30-dca5c01fc6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:11.779157 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21bc08-e843-4a96-9b30-dca5c01fc6d4 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:11.779454 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21bc08-e843-4a96-9b30-dca5c01fc6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:11.779747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21bc08-e843-4a96-9b30-dca5c01fc6d4 None admin] PATH_INFO: `/v3/users/bf45b230541743ddb01d168c405ebf27` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:11.781845 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21bc08-e843-4a96-9b30-dca5c01fc6d4 None admin] RBAC: Authorizing `identity:get_user(user_id=bf45b230541743ddb01d168c405ebf27)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:11.783424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21bc08-e843-4a96-9b30-dca5c01fc6d4 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:11.785150 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 178/349] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:11 2022] GET /identity/v3/users/bf45b230541743ddb01d168c405ebf27 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:11.786412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa985ff8-b9fe-47e5-8d51-f80d4a3a3f34 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:11.786711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa985ff8-b9fe-47e5-8d51-f80d4a3a3f34 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:11.787000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa985ff8-b9fe-47e5-8d51-f80d4a3a3f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:11.809793 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-fa985ff8-b9fe-47e5-8d51-f80d4a3a3f34 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:11.811207 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-fa985ff8-b9fe-47e5-8d51-f80d4a3a3f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:11.872246 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f4724-1f85-40a8-bd4e-23deba2b604e None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:11.888964 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:11.907734 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 179/350] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:11.908871 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa985ff8-b9fe-47e5-8d51-f80d4a3a3f34 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:11.910940 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ed710-bce4-4534-87ae-591ee38ce740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:11.911859 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ed710-bce4-4534-87ae-591ee38ce740 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:11.912085 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ed710-bce4-4534-87ae-591ee38ce740 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:11.912372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ed710-bce4-4534-87ae-591ee38ce740 None admin] PATH_INFO: `/v3/groups/02afb7aea2524d71b9ea18c6e6f88714` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:11.919180 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ed710-bce4-4534-87ae-591ee38ce740 None admin] RBAC: Authorizing `identity:get_group(group_id=02afb7aea2524d71b9ea18c6e6f88714)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:11.920770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ed710-bce4-4534-87ae-591ee38ce740 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:11.922490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 172/351] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jul 26 14:40:11 2022] GET /identity/v3/groups/02afb7aea2524d71b9ea18c6e6f88714 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:11.923326 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ed710-bce4-4534-87ae-591ee38ce740 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:11.955060 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:12.034186 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa985ff8-b9fe-47e5-8d51-f80d4a3a3f34 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:12.047989 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ed710-bce4-4534-87ae-591ee38ce740 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:12.080812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de95fed-8793-4cfb-93f9-cb38bc02ccbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:12.081446 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de95fed-8793-4cfb-93f9-cb38bc02ccbb None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:12.081736 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de95fed-8793-4cfb-93f9-cb38bc02ccbb None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:12.082017 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de95fed-8793-4cfb-93f9-cb38bc02ccbb None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:12.083950 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de95fed-8793-4cfb-93f9-cb38bc02ccbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:12.084264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de95fed-8793-4cfb-93f9-cb38bc02ccbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:12.085905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de95fed-8793-4cfb-93f9-cb38bc02ccbb None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:12.093205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c173ec6-0476-4d70-81ba-f2172c394bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:12.094310 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c173ec6-0476-4d70-81ba-f2172c394bd8 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:12.094783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c173ec6-0476-4d70-81ba-f2172c394bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:12.095073 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c173ec6-0476-4d70-81ba-f2172c394bd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:12.095845 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 180/352] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:12.096021 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c173ec6-0476-4d70-81ba-f2172c394bd8 None admin] RBAC: Adding query filter params (role.id=1b8bdabcd591423d91aaf8f30f7cd6f5, user.id=bf45b230541743ddb01d168c405ebf27, scope.system=all) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:12.096304 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c173ec6-0476-4d70-81ba-f2172c394bd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:12.096498 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de95fed-8793-4cfb-93f9-cb38bc02ccbb None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:12.097853 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c173ec6-0476-4d70-81ba-f2172c394bd8 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:12.122584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 173/353] 10.222.0.86 () {56 vars in 1308 bytes} [Tue Jul 26 14:40:11 2022] GET /identity/v3/role_assignments?user.id=bf45b230541743ddb01d168c405ebf27&scope.system=all&role.id=1b8bdabcd591423d91aaf8f30f7cd6f5 => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:12.124984 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c173ec6-0476-4d70-81ba-f2172c394bd8 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:12.159704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:12.235746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de95fed-8793-4cfb-93f9-cb38bc02ccbb None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:12.240616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:12.276234 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c173ec6-0476-4d70-81ba-f2172c394bd8 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:12.297149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0ec45-9b28-4d48-a8de-4708eb7fc0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:12.297795 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0ec45-9b28-4d48-a8de-4708eb7fc0e6 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:12.298079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0ec45-9b28-4d48-a8de-4708eb7fc0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:12.298354 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0ec45-9b28-4d48-a8de-4708eb7fc0e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:12.300061 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0ec45-9b28-4d48-a8de-4708eb7fc0e6 None admin] RBAC: Adding query filter params (group.id=02afb7aea2524d71b9ea18c6e6f88714, role.id=8303560a3b6948379f524afad4b798d0, scope.project.id=4fab63748076484db8b585b850783e19) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:12.300327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0ec45-9b28-4d48-a8de-4708eb7fc0e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:12.301777 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0ec45-9b28-4d48-a8de-4708eb7fc0e6 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:12.313881 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 181/354] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jul 26 14:40:12 2022] GET /identity/v3/role_assignments?group.id=02afb7aea2524d71b9ea18c6e6f88714&scope.project.id=4fab63748076484db8b585b850783e19&role.id=8303560a3b6948379f524afad4b798d0 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:12.313881 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754cd96-017e-49ad-a1a9-7bd3e3d93711 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:12.313881 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754cd96-017e-49ad-a1a9-7bd3e3d93711 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:12.313881 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754cd96-017e-49ad-a1a9-7bd3e3d93711 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:12.316206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 182/355] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:12.317014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754cd96-017e-49ad-a1a9-7bd3e3d93711 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:12.351284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3ea94-690f-4611-be0e-908fd3359647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:12.352494 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3ea94-690f-4611-be0e-908fd3359647 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:12.354142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3ea94-690f-4611-be0e-908fd3359647 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:12.354448 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3ea94-690f-4611-be0e-908fd3359647 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:12.372027 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3ea94-690f-4611-be0e-908fd3359647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:12.379657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-26c3ea94-690f-4611-be0e-908fd3359647 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:12.379657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:12.379657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:12.379657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:12.379657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:12.379657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:12.379657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:12.379657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:12.379657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:12.379657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:12.379657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:12.379657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:12.379657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:12.379657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:12.379657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:12.379657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:12.380736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:12.380736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:12.380736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:12.380736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:12.380736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:12.380736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:12.380736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:12.380736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:12.380736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:12.380736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:12.380736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:12.380736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:12.380736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:12.380736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:12.380736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:12.380736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:12.386595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:12.386595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:12.386595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:12.386595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:12.386595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:12.386595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:12.386595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:12.386595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:12.386595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:12.386595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:12.386595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:12.386595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:12.386595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 174/356] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:12.386595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73f6c8-406d-4d81-b22e-1c8dd0bab116 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:12.387799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73f6c8-406d-4d81-b22e-1c8dd0bab116 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:12.387799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73f6c8-406d-4d81-b22e-1c8dd0bab116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:12.410222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-4a73f6c8-406d-4d81-b22e-1c8dd0bab116 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:12.411817 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4a73f6c8-406d-4d81-b22e-1c8dd0bab116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:12.475424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754cd96-017e-49ad-a1a9-7bd3e3d93711 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:12.497855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:12.503939 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 175/357] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:12.504875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73f6c8-406d-4d81-b22e-1c8dd0bab116 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:12.526142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e527fbb-3f37-4b03-b8c4-4244e9e1861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:12.526811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e527fbb-3f37-4b03-b8c4-4244e9e1861a None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:12.527308 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e527fbb-3f37-4b03-b8c4-4244e9e1861a None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:12.527586 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e527fbb-3f37-4b03-b8c4-4244e9e1861a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:12.579114 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:12.619532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e527fbb-3f37-4b03-b8c4-4244e9e1861a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:12.621752 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e527fbb-3f37-4b03-b8c4-4244e9e1861a None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:12.623332 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73f6c8-406d-4d81-b22e-1c8dd0bab116 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:12.668138 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67513609-c77e-4127-a61c-87ea2377890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:12.668774 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67513609-c77e-4127-a61c-87ea2377890a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:12.669055 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67513609-c77e-4127-a61c-87ea2377890a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:12.669374 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67513609-c77e-4127-a61c-87ea2377890a None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:12.670105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67513609-c77e-4127-a61c-87ea2377890a None admin] RBAC: Adding query filter params (name=member) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:12.670430 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67513609-c77e-4127-a61c-87ea2377890a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:12.675998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67513609-c77e-4127-a61c-87ea2377890a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:12.684133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 176/358] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:40:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:12.686735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca63b1f-df59-48f5-8130-0684f1cf53fc None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:12.687025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca63b1f-df59-48f5-8130-0684f1cf53fc None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:12.687304 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca63b1f-df59-48f5-8130-0684f1cf53fc None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:12.688853 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 177/359] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:12.690087 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca63b1f-df59-48f5-8130-0684f1cf53fc None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:12.769124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 183/360] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:12.770586 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e527fbb-3f37-4b03-b8c4-4244e9e1861a None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:12.787799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:12.835204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca63b1f-df59-48f5-8130-0684f1cf53fc None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:12.871802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:12.882367 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14f1ad-9d34-49cd-ad78-a68e60a0df5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:12.885597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14f1ad-9d34-49cd-ad78-a68e60a0df5a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:12.885597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14f1ad-9d34-49cd-ad78-a68e60a0df5a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:12.885597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14f1ad-9d34-49cd-ad78-a68e60a0df5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:12.902518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14f1ad-9d34-49cd-ad78-a68e60a0df5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:12.907576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-0f14f1ad-9d34-49cd-ad78-a68e60a0df5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:40:12.907576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:12.907576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:12.907576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:12.907576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:12.907576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:12.907576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:12.907576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:12.907576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:12.907576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:12.907576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:12.907576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:12.907576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:12.907576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:12.907576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:12.907576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:12.908458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:12.908458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:12.908458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:12.908458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:12.908458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:12.908458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:12.908458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:12.908458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:12.908458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:12.908458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:12.908458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:12.908458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:12.908458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:12.908458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:12.908458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:12.908458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:12.909231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:12.909231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:12.909231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:12.909231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:12.909231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:12.909231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:12.909231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:12.909231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:12.909231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:12.909231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:12.909231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:40:12.909231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:12.909231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 178/361] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:40:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:12.911105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821873f-0ef6-4dfa-a01e-d618cdda737b None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:12.911396 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821873f-0ef6-4dfa-a01e-d618cdda737b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:12.911674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821873f-0ef6-4dfa-a01e-d618cdda737b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:12.913882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e527fbb-3f37-4b03-b8c4-4244e9e1861a None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:12.936640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-b821873f-0ef6-4dfa-a01e-d618cdda737b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:12.938267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b821873f-0ef6-4dfa-a01e-d618cdda737b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:12.952220 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05139879-95b8-400c-87cc-05f30f53b4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:12.952846 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05139879-95b8-400c-87cc-05f30f53b4c1 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:12.953132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05139879-95b8-400c-87cc-05f30f53b4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:12.953407 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05139879-95b8-400c-87cc-05f30f53b4c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:13.025770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 179/362] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:13.026657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821873f-0ef6-4dfa-a01e-d618cdda737b None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:13.038625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05139879-95b8-400c-87cc-05f30f53b4c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:13.040405 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05139879-95b8-400c-87cc-05f30f53b4c1 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:13.065183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:13.168457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821873f-0ef6-4dfa-a01e-d618cdda737b None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:13.170493 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 184/363] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:13.171287 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05139879-95b8-400c-87cc-05f30f53b4c1 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:13.189656 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:13.215132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7c87d-5436-49ea-97f6-cf8d0772ae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:13.215806 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7c87d-5436-49ea-97f6-cf8d0772ae3a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:13.216096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7c87d-5436-49ea-97f6-cf8d0772ae3a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:13.216380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7c87d-5436-49ea-97f6-cf8d0772ae3a None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:13.218165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7c87d-5436-49ea-97f6-cf8d0772ae3a None admin] RBAC: Authorizing `identity:get_project(project_id=4fab63748076484db8b585b850783e19)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:13.219681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7c87d-5436-49ea-97f6-cf8d0772ae3a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:13.221518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 180/364] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:13 2022] GET /identity/v3/projects/4fab63748076484db8b585b850783e19 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:13.222433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7c87d-5436-49ea-97f6-cf8d0772ae3a None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:13.312199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05139879-95b8-400c-87cc-05f30f53b4c1 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:13.332725 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:13.348453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7c87d-5436-49ea-97f6-cf8d0772ae3a None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:13.365430 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52545b7-579a-4d63-bf8d-68da1e1cd836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:13.366061 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52545b7-579a-4d63-bf8d-68da1e1cd836 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:13.366350 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52545b7-579a-4d63-bf8d-68da1e1cd836 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:13.366662 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52545b7-579a-4d63-bf8d-68da1e1cd836 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:13.367396 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52545b7-579a-4d63-bf8d-68da1e1cd836 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:13.368239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52545b7-579a-4d63-bf8d-68da1e1cd836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:13.369630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52545b7-579a-4d63-bf8d-68da1e1cd836 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:13.380940 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 185/365] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:13.385251 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52545b7-579a-4d63-bf8d-68da1e1cd836 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:13.394361 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a8288-2a12-4b29-83f9-f77fb7323b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:13.395051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a8288-2a12-4b29-83f9-f77fb7323b8c None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:13.395335 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a8288-2a12-4b29-83f9-f77fb7323b8c None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:13.395609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a8288-2a12-4b29-83f9-f77fb7323b8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:13.409388 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a8288-2a12-4b29-83f9-f77fb7323b8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:13.414409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-4c2a8288-2a12-4b29-83f9-f77fb7323b8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:13.414409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:13.414409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:13.414409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:13.414409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:13.414409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:13.414409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:13.414409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:13.414409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:13.414409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:13.414409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:13.414409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:13.414409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:13.414409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:13.414409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:13.414409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:13.415354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:13.415354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:13.415354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:13.415354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:13.415354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:13.415354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:13.415354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:13.415354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:13.415354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:13.415354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:13.415354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:13.415354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:13.415354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:13.415354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:13.415354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:13.415354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:13.416178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:13.416178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:13.416178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:13.416178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:13.416178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:13.416178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:13.416178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:13.416178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:13.416178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:13.416178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:13.416178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:13.416178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:13.416178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 181/366] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:40:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:13.416862 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a8288-2a12-4b29-83f9-f77fb7323b8c None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:13.475544 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:13.534967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52545b7-579a-4d63-bf8d-68da1e1cd836 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:13.555831 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a8288-2a12-4b29-83f9-f77fb7323b8c None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:13.577013 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd93ba-ba25-4693-86d8-b5cf720e3aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:13.577591 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd93ba-ba25-4693-86d8-b5cf720e3aaa None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:13.577876 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd93ba-ba25-4693-86d8-b5cf720e3aaa None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:13.578155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd93ba-ba25-4693-86d8-b5cf720e3aaa None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:13.580342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd93ba-ba25-4693-86d8-b5cf720e3aaa None admin] RBAC: Authorizing `identity:get_project(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:13.581793 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd93ba-ba25-4693-86d8-b5cf720e3aaa None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:13.583534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 186/367] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:13 2022] GET /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:13.584408 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd93ba-ba25-4693-86d8-b5cf720e3aaa None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:13.598104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f19f0-8e55-4e0c-9da0-4849be1f1dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:13.598863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f19f0-8e55-4e0c-9da0-4849be1f1dd1 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:13.599094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f19f0-8e55-4e0c-9da0-4849be1f1dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:13.599375 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f19f0-8e55-4e0c-9da0-4849be1f1dd1 None admin] PATH_INFO: `/v3/groups/02afb7aea2524d71b9ea18c6e6f88714` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:13.601482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f19f0-8e55-4e0c-9da0-4849be1f1dd1 None admin] RBAC: Authorizing `identity:get_group(group_id=02afb7aea2524d71b9ea18c6e6f88714)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:13.603004 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f19f0-8e55-4e0c-9da0-4849be1f1dd1 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:13.604633 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 182/368] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jul 26 14:40:13 2022] GET /identity/v3/groups/02afb7aea2524d71b9ea18c6e6f88714 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:13.605393 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f19f0-8e55-4e0c-9da0-4849be1f1dd1 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:13.647232 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:13.739810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd93ba-ba25-4693-86d8-b5cf720e3aaa None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:13.744868 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f19f0-8e55-4e0c-9da0-4849be1f1dd1 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:13.762194 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:13.787571 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f4073-4c65-48a2-b342-c06d65c76b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:13.788892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f4073-4c65-48a2-b342-c06d65c76b9f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:13.788999 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8385f-8fd1-4946-8878-d1aafbfe8849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:13.789095 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f4073-4c65-48a2-b342-c06d65c76b9f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:13.789095 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f4073-4c65-48a2-b342-c06d65c76b9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:13.789236 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8385f-8fd1-4946-8878-d1aafbfe8849 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:13.789482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8385f-8fd1-4946-8878-d1aafbfe8849 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:13.789732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8385f-8fd1-4946-8878-d1aafbfe8849 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:13.791385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8385f-8fd1-4946-8878-d1aafbfe8849 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:13.791385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8385f-8fd1-4946-8878-d1aafbfe8849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:13.792237 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8385f-8fd1-4946-8878-d1aafbfe8849 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:13.802000 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 183/369] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:13.803673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8385f-8fd1-4946-8878-d1aafbfe8849 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:13.876242 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f4073-4c65-48a2-b342-c06d65c76b9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:13.877831 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f4073-4c65-48a2-b342-c06d65c76b9f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:13.934012 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:13.937717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8385f-8fd1-4946-8878-d1aafbfe8849 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:13.981570 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e5cff-ff5c-4227-896f-8fba7446ae23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:13.982229 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e5cff-ff5c-4227-896f-8fba7446ae23 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:13.982549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e5cff-ff5c-4227-896f-8fba7446ae23 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:13.982831 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e5cff-ff5c-4227-896f-8fba7446ae23 None admin] PATH_INFO: `/v3/groups/02afb7aea2524d71b9ea18c6e6f88714` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:13.984001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e5cff-ff5c-4227-896f-8fba7446ae23 None admin] RBAC: Authorizing `identity:get_group(group_id=02afb7aea2524d71b9ea18c6e6f88714)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:13.985695 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e5cff-ff5c-4227-896f-8fba7446ae23 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:13.987735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 184/370] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jul 26 14:40:13 2022] GET /identity/v3/groups/02afb7aea2524d71b9ea18c6e6f88714 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:13.988530 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e5cff-ff5c-4227-896f-8fba7446ae23 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:14.014650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 187/371] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:14.015931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f4073-4c65-48a2-b342-c06d65c76b9f None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:14.043907 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:14.126562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e5cff-ff5c-4227-896f-8fba7446ae23 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:14.146073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f4073-4c65-48a2-b342-c06d65c76b9f None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:14.171000 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88f825-da1c-45ce-bc8a-84679f88193b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:14.171630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88f825-da1c-45ce-bc8a-84679f88193b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:14.171918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88f825-da1c-45ce-bc8a-84679f88193b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:14.172197 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88f825-da1c-45ce-bc8a-84679f88193b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:14.173001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88f825-da1c-45ce-bc8a-84679f88193b None admin] RBAC: Adding query filter params (group.id=02afb7aea2524d71b9ea18c6e6f88714, role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846, scope.project.id=4fab63748076484db8b585b850783e19) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:14.173315 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88f825-da1c-45ce-bc8a-84679f88193b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:14.174923 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88f825-da1c-45ce-bc8a-84679f88193b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:14.184218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 185/372] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jul 26 14:40:13 2022] GET /identity/v3/role_assignments?group.id=02afb7aea2524d71b9ea18c6e6f88714&scope.project.id=4fab63748076484db8b585b850783e19&role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:14.185304 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88f825-da1c-45ce-bc8a-84679f88193b None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:14.197084 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856f8c2-d097-4363-9229-46ba2a62e97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:14.197738 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856f8c2-d097-4363-9229-46ba2a62e97f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:14.198022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856f8c2-d097-4363-9229-46ba2a62e97f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:14.198715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856f8c2-d097-4363-9229-46ba2a62e97f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:14.219105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:14.289013 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856f8c2-d097-4363-9229-46ba2a62e97f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:14.292277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856f8c2-d097-4363-9229-46ba2a62e97f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:14.320415 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88f825-da1c-45ce-bc8a-84679f88193b None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:14.329399 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:14.365344 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340664f6-53c5-40da-bbd8-648149678a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:14.365975 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340664f6-53c5-40da-bbd8-648149678a62 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:14.366259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340664f6-53c5-40da-bbd8-648149678a62 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:14.366572 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340664f6-53c5-40da-bbd8-648149678a62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:14.367380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340664f6-53c5-40da-bbd8-648149678a62 None admin] RBAC: Adding query filter params (group.id=02afb7aea2524d71b9ea18c6e6f88714, role.id=8303560a3b6948379f524afad4b798d0, scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:14.367731 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340664f6-53c5-40da-bbd8-648149678a62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:14.369194 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340664f6-53c5-40da-bbd8-648149678a62 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:14.376909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 186/373] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jul 26 14:40:14 2022] GET /identity/v3/role_assignments?group.id=02afb7aea2524d71b9ea18c6e6f88714&scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e&role.id=8303560a3b6948379f524afad4b798d0 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:14.377936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340664f6-53c5-40da-bbd8-648149678a62 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:14.474237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 188/374] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:14.476743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfc13b-3233-48d9-9c25-fe2d25d6e5ee None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:14.477869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfc13b-3233-48d9-9c25-fe2d25d6e5ee None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:14.478420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfc13b-3233-48d9-9c25-fe2d25d6e5ee None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:14.480406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 189/375] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:14.488834 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab00e6-9e83-4ea8-87e0-a923987bd077 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:14.489449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab00e6-9e83-4ea8-87e0-a923987bd077 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:14.489947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab00e6-9e83-4ea8-87e0-a923987bd077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:14.515054 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-00ab00e6-9e83-4ea8-87e0-a923987bd077 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:14.516711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-00ab00e6-9e83-4ea8-87e0-a923987bd077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:14.526187 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340664f6-53c5-40da-bbd8-648149678a62 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:14.565540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:14.580319 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47a996-b927-403b-bead-7660c986719e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:14.581793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47a996-b927-403b-bead-7660c986719e None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:14.581793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47a996-b927-403b-bead-7660c986719e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:14.581793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47a996-b927-403b-bead-7660c986719e None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:14.588148 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47a996-b927-403b-bead-7660c986719e None admin] RBAC: Authorizing `identity:get_project(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:14.588148 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47a996-b927-403b-bead-7660c986719e None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:14.588148 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 187/376] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:14 2022] GET /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:14.588455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47a996-b927-403b-bead-7660c986719e None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:14.620680 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 190/377] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:40:14.623389 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab00e6-9e83-4ea8-87e0-a923987bd077 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:14.664533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:14.753461 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47a996-b927-403b-bead-7660c986719e None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:14.774816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab00e6-9e83-4ea8-87e0-a923987bd077 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:14.799095 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bce061-78ad-47cc-bc9a-a3771c78c569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:14.800372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bce061-78ad-47cc-bc9a-a3771c78c569 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:14.800838 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bce061-78ad-47cc-bc9a-a3771c78c569 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:14.801291 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bce061-78ad-47cc-bc9a-a3771c78c569 None admin] PATH_INFO: `/v3/projects/6185d6162c124385aebcf03e8b422158` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:14.803484 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bce061-78ad-47cc-bc9a-a3771c78c569 None admin] RBAC: Authorizing `identity:get_project(project_id=6185d6162c124385aebcf03e8b422158)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:14.806835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bce061-78ad-47cc-bc9a-a3771c78c569 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:14.809105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 188/378] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:14 2022] GET /identity/v3/projects/6185d6162c124385aebcf03e8b422158 => generated 344 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:14.810757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bce061-78ad-47cc-bc9a-a3771c78c569 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:14.825775 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b0640-9264-41e1-adaa-79abebaab536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:14.826453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b0640-9264-41e1-adaa-79abebaab536 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:14.826738 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b0640-9264-41e1-adaa-79abebaab536 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:14.827015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b0640-9264-41e1-adaa-79abebaab536 None admin] PATH_INFO: `/v3/groups/02afb7aea2524d71b9ea18c6e6f88714` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:14.829450 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b0640-9264-41e1-adaa-79abebaab536 None admin] RBAC: Authorizing `identity:get_group(group_id=02afb7aea2524d71b9ea18c6e6f88714)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:14.831436 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b0640-9264-41e1-adaa-79abebaab536 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:14.834062 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 191/379] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jul 26 14:40:14 2022] GET /identity/v3/groups/02afb7aea2524d71b9ea18c6e6f88714 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:14.839463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b0640-9264-41e1-adaa-79abebaab536 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:14.909800 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:14.977336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bce061-78ad-47cc-bc9a-a3771c78c569 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:14.985354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:14.990161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b0640-9264-41e1-adaa-79abebaab536 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:15.021212 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e880e3b-166b-4ffd-a1c2-0ffff1e45104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:15.021874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e880e3b-166b-4ffd-a1c2-0ffff1e45104 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:15.022160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e880e3b-166b-4ffd-a1c2-0ffff1e45104 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:15.022490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e880e3b-166b-4ffd-a1c2-0ffff1e45104 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:15.033909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e880e3b-166b-4ffd-a1c2-0ffff1e45104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:15.034963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38053884-48f7-4730-9cc2-1f019728b755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:15.035848 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38053884-48f7-4730-9cc2-1f019728b755 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:15.036487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38053884-48f7-4730-9cc2-1f019728b755 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:15.036956 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38053884-48f7-4730-9cc2-1f019728b755 None admin] PATH_INFO: `/v3/groups/902a6ae998c24666b2ed604895f7eb14` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:15.038987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-7e880e3b-166b-4ffd-a1c2-0ffff1e45104 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:15.038987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:15.038987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:15.038987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:15.038987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:15.038987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:15.038987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:15.038987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:15.038987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:15.038987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:15.038987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:15.038987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:15.038987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:15.038987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:15.038987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:15.038987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:15.039870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:15.039870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:15.039870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:15.039870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:15.039870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:15.039870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:15.039870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:15.039870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:15.039870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:15.039870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:15.039870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:15.039870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:15.039870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:15.039870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:15.039870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:15.039870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:15.040669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:15.040669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:15.040669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:15.040669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:15.040669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:15.040669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:15.040669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:15.040669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:15.040669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:15.040669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:15.040669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:15.040669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:15.040669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 189/380] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:15.041310 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e880e3b-166b-4ffd-a1c2-0ffff1e45104 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:15.047398 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38053884-48f7-4730-9cc2-1f019728b755 None admin] RBAC: Authorizing `identity:get_group(group_id=902a6ae998c24666b2ed604895f7eb14)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:15.049301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38053884-48f7-4730-9cc2-1f019728b755 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:15.051325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 192/381] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jul 26 14:40:14 2022] GET /identity/v3/groups/902a6ae998c24666b2ed604895f7eb14 => generated 229 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:15.058312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38053884-48f7-4730-9cc2-1f019728b755 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:15.162252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e880e3b-166b-4ffd-a1c2-0ffff1e45104 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:15.176638 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38053884-48f7-4730-9cc2-1f019728b755 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:15.186590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:15.207376 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85885f-25d8-44b2-9cc1-e4534bd33156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:15.208470 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85885f-25d8-44b2-9cc1-e4534bd33156 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:15.209251 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85885f-25d8-44b2-9cc1-e4534bd33156 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:15.209980 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85885f-25d8-44b2-9cc1-e4534bd33156 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:15.213131 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85885f-25d8-44b2-9cc1-e4534bd33156 None admin] RBAC: Adding query filter params (group.id=02afb7aea2524d71b9ea18c6e6f88714, role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846, scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:15.213652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85885f-25d8-44b2-9cc1-e4534bd33156 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:15.215877 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85885f-25d8-44b2-9cc1-e4534bd33156 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:15.221903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fb0db-196b-4f08-9ef2-16eceade9c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:15.222565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fb0db-196b-4f08-9ef2-16eceade9c9b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:15.222853 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fb0db-196b-4f08-9ef2-16eceade9c9b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:15.223134 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fb0db-196b-4f08-9ef2-16eceade9c9b None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:15.223975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fb0db-196b-4f08-9ef2-16eceade9c9b None admin] RBAC: Adding query filter params (name=member) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:15.224215 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fb0db-196b-4f08-9ef2-16eceade9c9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:15.224582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 190/382] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jul 26 14:40:15 2022] GET /identity/v3/role_assignments?group.id=02afb7aea2524d71b9ea18c6e6f88714&scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e&role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:15.225580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85885f-25d8-44b2-9cc1-e4534bd33156 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:15.231402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fb0db-196b-4f08-9ef2-16eceade9c9b None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:15.249672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 193/383] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:40:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:15.256703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fb0db-196b-4f08-9ef2-16eceade9c9b None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:15.301305 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:15.422888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fb0db-196b-4f08-9ef2-16eceade9c9b None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:15.458847 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85885f-25d8-44b2-9cc1-e4534bd33156 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:15.464745 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78313dc-daa5-4cb8-8b5c-6f34a7c32297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:15.465403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78313dc-daa5-4cb8-8b5c-6f34a7c32297 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:15.465692 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78313dc-daa5-4cb8-8b5c-6f34a7c32297 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:15.466013 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78313dc-daa5-4cb8-8b5c-6f34a7c32297 None admin] PATH_INFO: `/v3/groups/02afb7aea2524d71b9ea18c6e6f88714` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:15.467253 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78313dc-daa5-4cb8-8b5c-6f34a7c32297 None admin] RBAC: Authorizing `identity:get_group(group_id=02afb7aea2524d71b9ea18c6e6f88714)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:15.468721 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78313dc-daa5-4cb8-8b5c-6f34a7c32297 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:15.470863 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 194/384] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jul 26 14:40:15 2022] GET /identity/v3/groups/02afb7aea2524d71b9ea18c6e6f88714 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:15.477855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78313dc-daa5-4cb8-8b5c-6f34a7c32297 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:15.508027 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b5b42-f5ac-4fc7-9b27-9331d6ac5453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:15.510382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b5b42-f5ac-4fc7-9b27-9331d6ac5453 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:15.510907 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b5b42-f5ac-4fc7-9b27-9331d6ac5453 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:15.511485 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b5b42-f5ac-4fc7-9b27-9331d6ac5453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:15.513026 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b5b42-f5ac-4fc7-9b27-9331d6ac5453 None admin] RBAC: Adding query filter params (group.id=902a6ae998c24666b2ed604895f7eb14, role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.project.id=6185d6162c124385aebcf03e8b422158) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:15.515382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b5b42-f5ac-4fc7-9b27-9331d6ac5453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:15.517493 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b5b42-f5ac-4fc7-9b27-9331d6ac5453 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:15.531465 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 191/385] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jul 26 14:40:15 2022] GET /identity/v3/role_assignments?group.id=902a6ae998c24666b2ed604895f7eb14&scope.project.id=6185d6162c124385aebcf03e8b422158&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 260 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:15.561741 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:15.663381 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78313dc-daa5-4cb8-8b5c-6f34a7c32297 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:15.722835 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cc45b-64ae-462a-b2c0-e529421b077c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:15.723502 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cc45b-64ae-462a-b2c0-e529421b077c None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:15.723890 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cc45b-64ae-462a-b2c0-e529421b077c None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:15.724061 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cc45b-64ae-462a-b2c0-e529421b077c None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:15.731324 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646cc45b-64ae-462a-b2c0-e529421b077c None admin] RBAC: Authorizing `identity:get_project(project_id=4fab63748076484db8b585b850783e19)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:15.732823 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646cc45b-64ae-462a-b2c0-e529421b077c None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:15.735170 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 195/386] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:15 2022] GET /identity/v3/projects/4fab63748076484db8b585b850783e19 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:15.740570 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b5b42-f5ac-4fc7-9b27-9331d6ac5453 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:15.863916 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:15.871628 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b5b42-f5ac-4fc7-9b27-9331d6ac5453 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:15.913786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fbefc-208b-4893-bfc9-8ba289c27677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:15.914796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fbefc-208b-4893-bfc9-8ba289c27677 None admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:15.915219 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fbefc-208b-4893-bfc9-8ba289c27677 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:15.915634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fbefc-208b-4893-bfc9-8ba289c27677 None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19/groups/02afb7aea2524d71b9ea18c6e6f88714/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:15.917756 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fbefc-208b-4893-bfc9-8ba289c27677 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fab63748076484db8b585b850783e19, group_id=02afb7aea2524d71b9ea18c6e6f88714, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:15.919508 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fbefc-208b-4893-bfc9-8ba289c27677 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:15.983962 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 192/387] 10.222.0.86 () {58 vars in 1442 bytes} [Tue Jul 26 14:40:15 2022] PUT /identity/v3/projects/4fab63748076484db8b585b850783e19/groups/02afb7aea2524d71b9ea18c6e6f88714/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:40:16.639328 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997db53-48ec-4bca-b3f6-798b6f3ec2df None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:16.639705 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997db53-48ec-4bca-b3f6-798b6f3ec2df None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:16.639896 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997db53-48ec-4bca-b3f6-798b6f3ec2df None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:16.641584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 196/388] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:16.646853 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088e157-0cd8-4e43-9e00-fceadfcc7f32 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:16.647299 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088e157-0cd8-4e43-9e00-fceadfcc7f32 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:16.647466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088e157-0cd8-4e43-9e00-fceadfcc7f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:16.664367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489b96c-ebd4-4803-afb8-fe6644e22d5b None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:16.664880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489b96c-ebd4-4803-afb8-fe6644e22d5b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:16.664955 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489b96c-ebd4-4803-afb8-fe6644e22d5b None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:16.666793 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 197/389] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:16.671578 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f30a45-ab9f-4e60-881c-6824be800b97 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:16.671864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f30a45-ab9f-4e60-881c-6824be800b97 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:16.672141 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f30a45-ab9f-4e60-881c-6824be800b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:16.676323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-d088e157-0cd8-4e43-9e00-fceadfcc7f32 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:16.677519 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d088e157-0cd8-4e43-9e00-fceadfcc7f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:16.715412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-b8f30a45-ab9f-4e60-881c-6824be800b97 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:16.719199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-b8f30a45-ab9f-4e60-881c-6824be800b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:16.795039 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 193/390] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:40:16.834454 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 198/391] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:40:16.836008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088e157-0cd8-4e43-9e00-fceadfcc7f32 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:16.866508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f30a45-ab9f-4e60-881c-6824be800b97 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:16.920805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:16.982766 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:17.008034 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088e157-0cd8-4e43-9e00-fceadfcc7f32 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:17.030260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f30a45-ab9f-4e60-881c-6824be800b97 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:17.074708 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4031055-717b-4042-872a-2fb44d617dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:17.075377 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4031055-717b-4042-872a-2fb44d617dc6 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:17.075662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4031055-717b-4042-872a-2fb44d617dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:17.075938 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4031055-717b-4042-872a-2fb44d617dc6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:17.092524 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4031055-717b-4042-872a-2fb44d617dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:17.097452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-b4031055-717b-4042-872a-2fb44d617dc6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:40:17.097452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:17.097452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:17.097452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:17.097452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:17.097452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:17.097452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:17.097452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:17.097452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:17.097452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:17.097452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:17.097452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:17.097452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:17.097452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:17.097452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:17.097452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:17.098307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:17.098307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:17.098307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:17.098307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:17.098307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:17.098307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:17.098307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:17.098307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:17.098307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:17.098307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:17.098307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:17.098307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:17.098307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:17.098307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:17.098307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:17.098307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:17.099216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:17.099216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:17.099216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:17.099216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:17.099216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:17.099216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:17.099216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:17.099216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:17.099216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:17.099216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:17.099216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:40:17.099216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:17.104978 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ff969-47ba-49aa-af8a-3f38eed4f76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:17.105653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ff969-47ba-49aa-af8a-3f38eed4f76c None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:17.105946 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ff969-47ba-49aa-af8a-3f38eed4f76c None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:17.106233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ff969-47ba-49aa-af8a-3f38eed4f76c None admin] PATH_INFO: `/v3/roles/member` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:17.106758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 194/392] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:40:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:40:17.112065 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4031055-717b-4042-872a-2fb44d617dc6 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:17.126308 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ff969-47ba-49aa-af8a-3f38eed4f76c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:17.131336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-414ff969-47ba-49aa-af8a-3f38eed4f76c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:17.131336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:17.131336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:17.131336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:17.131336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:17.131336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:17.131336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:17.131336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:17.131336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:17.131336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:17.131336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:17.131336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:17.131336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:17.131336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:17.131336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:17.131336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:17.132344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:17.132344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:17.132344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:17.132344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:17.132344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:17.132344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:17.132344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:17.132344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:17.132344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:17.132344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:17.132344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:17.132344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:17.132344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:17.132344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:17.132344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:17.132344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:17.133183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:17.133183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:17.133183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:17.133183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:17.133183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:17.133183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:17.133183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:17.133183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:17.133183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:17.133183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:17.133183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:17.133183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:17.138414 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 199/393] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:17.139956 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ff969-47ba-49aa-af8a-3f38eed4f76c None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:17.261142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:17.268077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ff969-47ba-49aa-af8a-3f38eed4f76c None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:17.304858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d384d73-703e-4776-91fc-10e39deb4a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:17.305521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d384d73-703e-4776-91fc-10e39deb4a0e None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:17.305809 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d384d73-703e-4776-91fc-10e39deb4a0e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:17.306092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d384d73-703e-4776-91fc-10e39deb4a0e None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:17.306845 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d384d73-703e-4776-91fc-10e39deb4a0e None admin] RBAC: Adding query filter params (name=member) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:17.307435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d384d73-703e-4776-91fc-10e39deb4a0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:17.309041 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d384d73-703e-4776-91fc-10e39deb4a0e None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:17.316569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4031055-717b-4042-872a-2fb44d617dc6 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:17.318885 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 200/394] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:40:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:17.325000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d384d73-703e-4776-91fc-10e39deb4a0e None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:17.388196 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbfa06-b4c1-4877-999b-29ba7eab1ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:17.388841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbfa06-b4c1-4877-999b-29ba7eab1ae4 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:17.389128 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbfa06-b4c1-4877-999b-29ba7eab1ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:17.389409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbfa06-b4c1-4877-999b-29ba7eab1ae4 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:17.390139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbfa06-b4c1-4877-999b-29ba7eab1ae4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:17.390471 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbfa06-b4c1-4877-999b-29ba7eab1ae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:17.391871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbfa06-b4c1-4877-999b-29ba7eab1ae4 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:17.416856 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 195/395] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:17.432902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbfa06-b4c1-4877-999b-29ba7eab1ae4 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:17.454415 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:17.482023 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d384d73-703e-4776-91fc-10e39deb4a0e None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:17.534830 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5830697-80e9-4ce8-8728-f9ed39b3bf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:17.535420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5830697-80e9-4ce8-8728-f9ed39b3bf94 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:17.535710 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5830697-80e9-4ce8-8728-f9ed39b3bf94 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:17.535996 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5830697-80e9-4ce8-8728-f9ed39b3bf94 None admin] PATH_INFO: `/v3/groups/02afb7aea2524d71b9ea18c6e6f88714` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:17.537987 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5830697-80e9-4ce8-8728-f9ed39b3bf94 None admin] RBAC: Authorizing `identity:get_group(group_id=02afb7aea2524d71b9ea18c6e6f88714)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:17.539539 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5830697-80e9-4ce8-8728-f9ed39b3bf94 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:17.541661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 201/396] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jul 26 14:40:17 2022] GET /identity/v3/groups/02afb7aea2524d71b9ea18c6e6f88714 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:17.548124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5830697-80e9-4ce8-8728-f9ed39b3bf94 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:17.613769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:17.637021 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbfa06-b4c1-4877-999b-29ba7eab1ae4 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:17.675571 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97be4dc-cf2e-4d78-a16c-8619b4b4110c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:17.677466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97be4dc-cf2e-4d78-a16c-8619b4b4110c None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:17.677956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97be4dc-cf2e-4d78-a16c-8619b4b4110c None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:17.678448 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97be4dc-cf2e-4d78-a16c-8619b4b4110c None admin] PATH_INFO: `/v3/groups/02afb7aea2524d71b9ea18c6e6f88714` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:17.679877 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97be4dc-cf2e-4d78-a16c-8619b4b4110c None admin] RBAC: Authorizing `identity:get_group(group_id=02afb7aea2524d71b9ea18c6e6f88714)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:17.681583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97be4dc-cf2e-4d78-a16c-8619b4b4110c None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:17.686476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 196/397] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jul 26 14:40:17 2022] GET /identity/v3/groups/02afb7aea2524d71b9ea18c6e6f88714 => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:17.687979 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eeba27-1694-49e7-8908-15872cba1c25 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:17.688485 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eeba27-1694-49e7-8908-15872cba1c25 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:17.689014 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eeba27-1694-49e7-8908-15872cba1c25 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:17.694992 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 197/398] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:17.696641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eeba27-1694-49e7-8908-15872cba1c25 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:17.706862 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5830697-80e9-4ce8-8728-f9ed39b3bf94 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:17.744831 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134ce88-0a3b-4fa8-9911-1069e77669d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:17.745487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134ce88-0a3b-4fa8-9911-1069e77669d8 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:17.745774 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134ce88-0a3b-4fa8-9911-1069e77669d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:17.746054 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134ce88-0a3b-4fa8-9911-1069e77669d8 None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:17.747371 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134ce88-0a3b-4fa8-9911-1069e77669d8 None admin] RBAC: Authorizing `identity:get_project(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:17.749199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134ce88-0a3b-4fa8-9911-1069e77669d8 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:17.755760 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 202/399] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:17 2022] GET /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:17.755760 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe22cf8-7dc1-436f-b67b-bf4d6da89119 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:17.755760 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe22cf8-7dc1-436f-b67b-bf4d6da89119 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:17.755760 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe22cf8-7dc1-436f-b67b-bf4d6da89119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:17.773790 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-3fe22cf8-7dc1-436f-b67b-bf4d6da89119 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:17.775427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3fe22cf8-7dc1-436f-b67b-bf4d6da89119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:17.798268 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:17.825052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eeba27-1694-49e7-8908-15872cba1c25 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:17.857787 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 203/400] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:17.857787 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe22cf8-7dc1-436f-b67b-bf4d6da89119 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:17.874502 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac68e4a-77da-4f74-8dda-4b0e6eb709a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:17.875523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac68e4a-77da-4f74-8dda-4b0e6eb709a4 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:17.876000 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac68e4a-77da-4f74-8dda-4b0e6eb709a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:17.876468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac68e4a-77da-4f74-8dda-4b0e6eb709a4 None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:17.880310 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac68e4a-77da-4f74-8dda-4b0e6eb709a4 None admin] RBAC: Authorizing `identity:get_project(project_id=4fab63748076484db8b585b850783e19)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:17.882043 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac68e4a-77da-4f74-8dda-4b0e6eb709a4 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:17.883910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:17.885543 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 198/401] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:17 2022] GET /identity/v3/projects/4fab63748076484db8b585b850783e19 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:17.890958 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac68e4a-77da-4f74-8dda-4b0e6eb709a4 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:17.972844 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe22cf8-7dc1-436f-b67b-bf4d6da89119 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:18.012369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf5d3c-5968-4816-af36-4b961520a9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:18.013632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf5d3c-5968-4816-af36-4b961520a9c7 None admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:18.013632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf5d3c-5968-4816-af36-4b961520a9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:18.013809 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf5d3c-5968-4816-af36-4b961520a9c7 None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e/groups/02afb7aea2524d71b9ea18c6e6f88714/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:18.015938 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf5d3c-5968-4816-af36-4b961520a9c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e, group_id=02afb7aea2524d71b9ea18c6e6f88714, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:18.018064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf5d3c-5968-4816-af36-4b961520a9c7 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:18.029018 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac68e4a-77da-4f74-8dda-4b0e6eb709a4 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:18.063962 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a8868-d1e0-429b-9f09-edc052983569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:18.064560 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8868-d1e0-429b-9f09-edc052983569 None admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:18.064850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8868-d1e0-429b-9f09-edc052983569 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:18.065130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8868-d1e0-429b-9f09-edc052983569 None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19/groups/02afb7aea2524d71b9ea18c6e6f88714/roles/9cc7bf3bc6aa4b33ab6dee0dd67e1846` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:18.067648 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a8868-d1e0-429b-9f09-edc052983569 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fab63748076484db8b585b850783e19, group_id=02afb7aea2524d71b9ea18c6e6f88714, role_id=9cc7bf3bc6aa4b33ab6dee0dd67e1846)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:18.069090 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a8868-d1e0-429b-9f09-edc052983569 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:18.092122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 204/402] 10.222.0.86 () {58 vars in 1442 bytes} [Tue Jul 26 14:40:17 2022] PUT /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e/groups/02afb7aea2524d71b9ea18c6e6f88714/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:40:18.092973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf5d3c-5968-4816-af36-4b961520a9c7 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:18.147997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 199/403] 10.222.0.86 () {58 vars in 1442 bytes} [Tue Jul 26 14:40:17 2022] PUT /identity/v3/projects/4fab63748076484db8b585b850783e19/groups/02afb7aea2524d71b9ea18c6e6f88714/roles/9cc7bf3bc6aa4b33ab6dee0dd67e1846 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 14:40:18.147997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f95dc-42ca-413b-afc3-2f1d0db8ea98 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:18.147997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f95dc-42ca-413b-afc3-2f1d0db8ea98 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:18.147997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f95dc-42ca-413b-afc3-2f1d0db8ea98 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:18.147997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 200/404] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:18.168440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d3641-663d-47fa-982b-9e9e16beed03 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:18.168829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d3641-663d-47fa-982b-9e9e16beed03 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:18.169050 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d3641-663d-47fa-982b-9e9e16beed03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:18.177005 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:18.199388 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-1f4d3641-663d-47fa-982b-9e9e16beed03 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:18.201710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-1f4d3641-663d-47fa-982b-9e9e16beed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:18.250723 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:18.279631 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf5d3c-5968-4816-af36-4b961520a9c7 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:18.314114 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 201/405] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:40:18.331832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89e5b7-ab22-4cf1-8045-49a1d6115242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:18.332521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89e5b7-ab22-4cf1-8045-49a1d6115242 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:18.332807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89e5b7-ab22-4cf1-8045-49a1d6115242 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:18.333090 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89e5b7-ab22-4cf1-8045-49a1d6115242 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:18.340980 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d3641-663d-47fa-982b-9e9e16beed03 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:18.362654 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89e5b7-ab22-4cf1-8045-49a1d6115242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:18.368120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-bd89e5b7-ab22-4cf1-8045-49a1d6115242 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:40:18.368120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:18.368120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:18.368120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:18.368120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:18.368120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:18.368120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:18.368120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:18.368120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:18.368120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:18.368120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:18.368120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:18.368120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:18.368120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:18.368120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:18.368120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:18.369007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:18.369007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:18.369007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:18.369007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:18.369007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:18.369007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:18.369007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:18.369007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:18.369007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:18.369007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:18.369007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:18.369007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:18.369007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:18.369007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:18.369007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:18.369007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:18.369796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:18.369796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:18.369796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:18.369796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:18.369796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:18.369796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:18.369796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:18.369796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:18.369796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:18.369796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:18.369796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:40:18.369796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:18.369796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 205/406] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:40:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:18.375709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89e5b7-ab22-4cf1-8045-49a1d6115242 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:18.491692 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d3641-663d-47fa-982b-9e9e16beed03 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:18.504365 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89e5b7-ab22-4cf1-8045-49a1d6115242 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:18.534596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:18.540984 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c772bac-b93f-405e-807b-aa77fca13967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:18.541886 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c772bac-b93f-405e-807b-aa77fca13967 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:18.542506 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c772bac-b93f-405e-807b-aa77fca13967 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:18.542611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9378b3-7675-45dc-b651-6dacff3e067e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:18.543130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c772bac-b93f-405e-807b-aa77fca13967 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:18.543323 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9378b3-7675-45dc-b651-6dacff3e067e None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:18.556987 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9378b3-7675-45dc-b651-6dacff3e067e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:18.556987 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9378b3-7675-45dc-b651-6dacff3e067e None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:18.556987 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9378b3-7675-45dc-b651-6dacff3e067e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:18.556987 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9378b3-7675-45dc-b651-6dacff3e067e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:18.556987 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9378b3-7675-45dc-b651-6dacff3e067e None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:18.556987 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 206/407] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:18.557460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c772bac-b93f-405e-807b-aa77fca13967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:18.557532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f94e19-22a3-49fa-8999-ff729d621327 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:18.557532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f94e19-22a3-49fa-8999-ff729d621327 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:18.557532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f94e19-22a3-49fa-8999-ff729d621327 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:18.559141 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 207/408] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:18.562996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-0c772bac-b93f-405e-807b-aa77fca13967 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:18.562996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:18.562996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:18.562996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:18.562996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:18.562996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:18.562996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:18.562996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:18.562996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:18.562996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:18.562996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:18.562996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:18.562996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:18.562996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:18.562996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:18.562996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:18.563834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:18.563834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:18.563834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:18.563834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:18.563834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:18.563834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:18.563834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:18.563834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:18.563834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:18.563834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:18.563834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:18.563834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:18.563834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:18.563834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:18.563834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:18.563834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:18.564696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:18.564696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:18.564696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:18.564696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:18.564696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:18.564696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:18.564696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:18.564696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:18.564696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:18.564696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:18.564696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:18.564696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:18.570525 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 202/409] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:40:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:40:18.570525 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69364dae-5e1a-4ea2-b616-007ed15879e7 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:18.570525 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69364dae-5e1a-4ea2-b616-007ed15879e7 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:18.570525 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69364dae-5e1a-4ea2-b616-007ed15879e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:18.572015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f94e19-22a3-49fa-8999-ff729d621327 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:18.576328 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:18.590179 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-69364dae-5e1a-4ea2-b616-007ed15879e7 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:18.591483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-69364dae-5e1a-4ea2-b616-007ed15879e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:18.671528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 203/410] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:18.672901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69364dae-5e1a-4ea2-b616-007ed15879e7 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:18.727749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f94e19-22a3-49fa-8999-ff729d621327 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:18.773095 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41bb76-930a-4fcd-b74b-28caddd10f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:18.773783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41bb76-930a-4fcd-b74b-28caddd10f17 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:18.774069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41bb76-930a-4fcd-b74b-28caddd10f17 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:18.774351 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41bb76-930a-4fcd-b74b-28caddd10f17 None admin] PATH_INFO: `/v3/groups/02afb7aea2524d71b9ea18c6e6f88714` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:18.775988 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41bb76-930a-4fcd-b74b-28caddd10f17 None admin] RBAC: Authorizing `identity:get_group(group_id=02afb7aea2524d71b9ea18c6e6f88714)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:18.777774 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41bb76-930a-4fcd-b74b-28caddd10f17 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:18.784371 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 208/411] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jul 26 14:40:18 2022] GET /identity/v3/groups/02afb7aea2524d71b9ea18c6e6f88714 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:18.785217 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41bb76-930a-4fcd-b74b-28caddd10f17 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:18.804605 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69364dae-5e1a-4ea2-b616-007ed15879e7 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:18.835010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:18.848770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49518b43-8cef-4aa9-b42c-cc784bd024e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:18.849745 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49518b43-8cef-4aa9-b42c-cc784bd024e7 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:18.854579 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49518b43-8cef-4aa9-b42c-cc784bd024e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:18.854579 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49518b43-8cef-4aa9-b42c-cc784bd024e7 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:18.854579 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49518b43-8cef-4aa9-b42c-cc784bd024e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:18.854579 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49518b43-8cef-4aa9-b42c-cc784bd024e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:18.854579 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49518b43-8cef-4aa9-b42c-cc784bd024e7 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:18.867354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 204/412] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:18.868515 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49518b43-8cef-4aa9-b42c-cc784bd024e7 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:18.876695 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:18.916561 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41bb76-930a-4fcd-b74b-28caddd10f17 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:18.964156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be69b4-08a3-4da6-afc5-0b5b25c53b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:18.964811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be69b4-08a3-4da6-afc5-0b5b25c53b56 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:18.965098 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be69b4-08a3-4da6-afc5-0b5b25c53b56 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:18.965377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be69b4-08a3-4da6-afc5-0b5b25c53b56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:18.979682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be69b4-08a3-4da6-afc5-0b5b25c53b56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:18.983376 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49518b43-8cef-4aa9-b42c-cc784bd024e7 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:18.986449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-10be69b4-08a3-4da6-afc5-0b5b25c53b56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:18.986449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:18.986449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:18.986449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:18.986449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:18.986449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:18.986449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:18.986449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:18.986449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:18.986449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:18.986449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:18.986449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:18.986449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:18.986449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:18.986449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:18.986449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:18.987462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:18.987462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:18.987462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:18.987462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:18.987462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:18.987462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:18.987462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:18.987462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:18.987462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:18.987462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:18.987462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:18.987462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:18.987462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:18.987462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:18.987462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:18.987462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:18.988438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:18.988438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:18.988438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:18.988438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:18.988438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:18.988438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:18.988438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:18.988438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:18.988438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:18.988438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:18.988438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:18.988438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:18.990745 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 209/413] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:18.991726 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be69b4-08a3-4da6-afc5-0b5b25c53b56 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:19.026633 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25c86e-a2af-4b78-90ae-a6c074d87430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:19.027562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25c86e-a2af-4b78-90ae-a6c074d87430 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:19.028021 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25c86e-a2af-4b78-90ae-a6c074d87430 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:19.028437 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25c86e-a2af-4b78-90ae-a6c074d87430 None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:19.029736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25c86e-a2af-4b78-90ae-a6c074d87430 None admin] RBAC: Authorizing `identity:get_project(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:19.031407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25c86e-a2af-4b78-90ae-a6c074d87430 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:19.033290 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 205/414] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:18 2022] GET /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:19.034237 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25c86e-a2af-4b78-90ae-a6c074d87430 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:19.105419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:19.114732 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be69b4-08a3-4da6-afc5-0b5b25c53b56 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:19.152696 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:19.158962 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25c86e-a2af-4b78-90ae-a6c074d87430 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:19.159128 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6eafd4-fcf7-4476-bb6f-fc7fa9d2601c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:19.159808 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6eafd4-fcf7-4476-bb6f-fc7fa9d2601c None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:19.160172 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6eafd4-fcf7-4476-bb6f-fc7fa9d2601c None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:19.160534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6eafd4-fcf7-4476-bb6f-fc7fa9d2601c None admin] PATH_INFO: `/v3/groups/902a6ae998c24666b2ed604895f7eb14` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:19.162069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6eafd4-fcf7-4476-bb6f-fc7fa9d2601c None admin] RBAC: Authorizing `identity:get_group(group_id=902a6ae998c24666b2ed604895f7eb14)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:19.164972 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6eafd4-fcf7-4476-bb6f-fc7fa9d2601c None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:19.170420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 210/415] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jul 26 14:40:18 2022] GET /identity/v3/groups/902a6ae998c24666b2ed604895f7eb14 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:19.170420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6eafd4-fcf7-4476-bb6f-fc7fa9d2601c None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:19.203902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d835ed9-6bb8-47e8-96eb-1ced9a7a8e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:19.204772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d835ed9-6bb8-47e8-96eb-1ced9a7a8e7a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:19.205262 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d835ed9-6bb8-47e8-96eb-1ced9a7a8e7a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:19.205782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d835ed9-6bb8-47e8-96eb-1ced9a7a8e7a None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:19.206814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d835ed9-6bb8-47e8-96eb-1ced9a7a8e7a None admin] RBAC: Adding query filter params (name=member) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:19.207260 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d835ed9-6bb8-47e8-96eb-1ced9a7a8e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:19.208811 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d835ed9-6bb8-47e8-96eb-1ced9a7a8e7a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:19.218079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 206/416] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:40:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:19.219104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d835ed9-6bb8-47e8-96eb-1ced9a7a8e7a None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:19.299102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6eafd4-fcf7-4476-bb6f-fc7fa9d2601c None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:19.345189 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d835ed9-6bb8-47e8-96eb-1ced9a7a8e7a None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:19.349095 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b12bf-b23f-4c22-a079-0d93b1f6b9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:19.349986 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b12bf-b23f-4c22-a079-0d93b1f6b9fc None admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:19.350444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b12bf-b23f-4c22-a079-0d93b1f6b9fc None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:19.350869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b12bf-b23f-4c22-a079-0d93b1f6b9fc None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e/groups/02afb7aea2524d71b9ea18c6e6f88714/roles/9cc7bf3bc6aa4b33ab6dee0dd67e1846` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:19.353827 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b12bf-b23f-4c22-a079-0d93b1f6b9fc None admin] RBAC: Authorizing `identity:create_grant(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e, group_id=02afb7aea2524d71b9ea18c6e6f88714, role_id=9cc7bf3bc6aa4b33ab6dee0dd67e1846)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:19.355847 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b12bf-b23f-4c22-a079-0d93b1f6b9fc None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:19.364893 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:19.385614 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4599a7f-ff47-4fab-83cc-fc3ff12ef7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:19.386278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4599a7f-ff47-4fab-83cc-fc3ff12ef7a2 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:19.386602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4599a7f-ff47-4fab-83cc-fc3ff12ef7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:19.386889 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4599a7f-ff47-4fab-83cc-fc3ff12ef7a2 None admin] PATH_INFO: `/v3/projects/6185d6162c124385aebcf03e8b422158` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:19.388044 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4599a7f-ff47-4fab-83cc-fc3ff12ef7a2 None admin] RBAC: Authorizing `identity:get_project(project_id=6185d6162c124385aebcf03e8b422158)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:19.389493 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4599a7f-ff47-4fab-83cc-fc3ff12ef7a2 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:19.391921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 207/417] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:19 2022] GET /identity/v3/projects/6185d6162c124385aebcf03e8b422158 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:19.392533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4599a7f-ff47-4fab-83cc-fc3ff12ef7a2 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:19.447601 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 211/418] 10.222.0.86 () {58 vars in 1442 bytes} [Tue Jul 26 14:40:19 2022] PUT /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e/groups/02afb7aea2524d71b9ea18c6e6f88714/roles/9cc7bf3bc6aa4b33ab6dee0dd67e1846 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:40:19.449052 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b12bf-b23f-4c22-a079-0d93b1f6b9fc None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:19.524593 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4599a7f-ff47-4fab-83cc-fc3ff12ef7a2 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:19.534420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:19.591006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b30d8-c688-43ff-a722-4ceb390fd775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:19.592247 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b30d8-c688-43ff-a722-4ceb390fd775 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:19.594134 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b30d8-c688-43ff-a722-4ceb390fd775 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:19.595389 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b30d8-c688-43ff-a722-4ceb390fd775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:19.618880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b12bf-b23f-4c22-a079-0d93b1f6b9fc None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:19.660139 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964615f-6c35-4901-84f2-c4d9874510dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:19.661371 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964615f-6c35-4901-84f2-c4d9874510dc None admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:19.661884 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964615f-6c35-4901-84f2-c4d9874510dc None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:19.662364 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964615f-6c35-4901-84f2-c4d9874510dc None admin] PATH_INFO: `/v3/projects/6185d6162c124385aebcf03e8b422158/groups/902a6ae998c24666b2ed604895f7eb14/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:19.665296 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964615f-6c35-4901-84f2-c4d9874510dc None admin] RBAC: Authorizing `identity:create_grant(project_id=6185d6162c124385aebcf03e8b422158, group_id=902a6ae998c24666b2ed604895f7eb14, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:19.668674 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964615f-6c35-4901-84f2-c4d9874510dc None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:19.697065 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:19.724840 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b30d8-c688-43ff-a722-4ceb390fd775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:19.726568 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b30d8-c688-43ff-a722-4ceb390fd775 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:19.759802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 212/419] 10.222.0.86 () {58 vars in 1442 bytes} [Tue Jul 26 14:40:19 2022] PUT /identity/v3/projects/6185d6162c124385aebcf03e8b422158/groups/902a6ae998c24666b2ed604895f7eb14/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:40:19.846319 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 208/420] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:19.852960 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964615f-6c35-4901-84f2-c4d9874510dc None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:19.991123 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964615f-6c35-4901-84f2-c4d9874510dc None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:20.016611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:20.032736 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd713fc-7bd7-412a-8257-84505bd73450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:20.033405 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd713fc-7bd7-412a-8257-84505bd73450 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:20.033695 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd713fc-7bd7-412a-8257-84505bd73450 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:20.033979 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd713fc-7bd7-412a-8257-84505bd73450 None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:20.035455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd713fc-7bd7-412a-8257-84505bd73450 None admin] RBAC: Authorizing `identity:get_project(project_id=4fab63748076484db8b585b850783e19)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:20.037249 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd713fc-7bd7-412a-8257-84505bd73450 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:20.039888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 213/421] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:19 2022] GET /identity/v3/projects/4fab63748076484db8b585b850783e19 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:20.055445 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b30d8-c688-43ff-a722-4ceb390fd775 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:20.147480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:20.163836 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b30d8-c688-43ff-a722-4ceb390fd775 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:20.201361 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a167f8-bbc2-4e53-b1ad-c790a512014b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:20.202021 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a167f8-bbc2-4e53-b1ad-c790a512014b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:20.202306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a167f8-bbc2-4e53-b1ad-c790a512014b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:20.202608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a167f8-bbc2-4e53-b1ad-c790a512014b None admin] PATH_INFO: `/v3/groups/02afb7aea2524d71b9ea18c6e6f88714` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:20.203809 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a167f8-bbc2-4e53-b1ad-c790a512014b None admin] RBAC: Authorizing `identity:get_group(group_id=02afb7aea2524d71b9ea18c6e6f88714)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:20.205248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a167f8-bbc2-4e53-b1ad-c790a512014b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:20.207178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 209/422] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jul 26 14:40:20 2022] GET /identity/v3/groups/02afb7aea2524d71b9ea18c6e6f88714 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:20.213642 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd713fc-7bd7-412a-8257-84505bd73450 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:20.326517 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81daab-f77c-4ce1-b8ee-4e821e7d4565 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:20.326803 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81daab-f77c-4ce1-b8ee-4e821e7d4565 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:20.327086 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81daab-f77c-4ce1-b8ee-4e821e7d4565 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:20.328428 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 210/423] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:40:20.344131 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca142d-ccf0-4324-8fe8-1f746c645757 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:20.344418 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca142d-ccf0-4324-8fe8-1f746c645757 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:20.344692 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca142d-ccf0-4324-8fe8-1f746c645757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:20.359372 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd713fc-7bd7-412a-8257-84505bd73450 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:20.372024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-cdca142d-ccf0-4324-8fe8-1f746c645757 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:20.373223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-cdca142d-ccf0-4324-8fe8-1f746c645757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:20.415049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2905d7-6b1c-4670-bf7e-a2e78905fc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:20.416093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2905d7-6b1c-4670-bf7e-a2e78905fc32 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:20.416381 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2905d7-6b1c-4670-bf7e-a2e78905fc32 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:20.416661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2905d7-6b1c-4670-bf7e-a2e78905fc32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:20.417466 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2905d7-6b1c-4670-bf7e-a2e78905fc32 None admin] RBAC: Adding query filter params (group.id=02afb7aea2524d71b9ea18c6e6f88714, role.id=8303560a3b6948379f524afad4b798d0, scope.project.id=4fab63748076484db8b585b850783e19) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:20.417782 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2905d7-6b1c-4670-bf7e-a2e78905fc32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:20.419271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2905d7-6b1c-4670-bf7e-a2e78905fc32 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:20.426309 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 214/424] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jul 26 14:40:20 2022] GET /identity/v3/role_assignments?group.id=02afb7aea2524d71b9ea18c6e6f88714&scope.project.id=4fab63748076484db8b585b850783e19&role.id=8303560a3b6948379f524afad4b798d0 => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:20.510489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 211/425] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:20.546268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2905d7-6b1c-4670-bf7e-a2e78905fc32 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:20.622699 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:20.644799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ae2ca-0fd1-4c0e-bd89-170f21f79e0d None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:20.651090 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ae2ca-0fd1-4c0e-bd89-170f21f79e0d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:20.651090 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ae2ca-0fd1-4c0e-bd89-170f21f79e0d None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:20.651090 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 212/426] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:40:20.654363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cab113-2c27-476c-afc7-9767423a56d1 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:20.655037 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cab113-2c27-476c-afc7-9767423a56d1 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:20.655864 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cab113-2c27-476c-afc7-9767423a56d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:20.681527 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2905d7-6b1c-4670-bf7e-a2e78905fc32 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:20.691859 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-58cab113-2c27-476c-afc7-9767423a56d1 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:20.693452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-58cab113-2c27-476c-afc7-9767423a56d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:20.718379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6da516-84ac-445b-8682-98c7f2f3d47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:20.719054 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6da516-84ac-445b-8682-98c7f2f3d47b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:20.719422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6da516-84ac-445b-8682-98c7f2f3d47b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:20.719594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6da516-84ac-445b-8682-98c7f2f3d47b None admin] PATH_INFO: `/v3/roles/member` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:20.730779 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6da516-84ac-445b-8682-98c7f2f3d47b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:20.736100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-de6da516-84ac-445b-8682-98c7f2f3d47b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:20.736100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:20.736100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:20.736100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:20.736100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:20.736100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:20.736100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:20.736100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:20.736100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:20.736100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:20.736100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:20.736100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:20.736100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:20.736100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:20.736100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:20.736100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:20.736995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:20.736995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:20.736995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:20.736995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:20.736995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:20.736995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:20.736995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:20.736995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:20.736995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:20.736995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:20.736995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:20.736995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:20.736995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:20.736995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:20.736995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:20.736995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:20.737781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:20.737781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:20.737781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:20.737781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:20.737781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:20.737781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:20.737781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:20.737781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:20.737781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:20.737781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:20.737781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:40:20.737781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:20.737781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 215/427] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:20.746243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6da516-84ac-445b-8682-98c7f2f3d47b None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:20.786094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 213/428] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:40:20.807495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cab113-2c27-476c-afc7-9767423a56d1 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:20.822923 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:20.890808 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6da516-84ac-445b-8682-98c7f2f3d47b None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:20.903834 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:20.928679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0176b94-4b37-46fb-b451-a8bbda73ac75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:20.929313 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0176b94-4b37-46fb-b451-a8bbda73ac75 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:20.929598 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0176b94-4b37-46fb-b451-a8bbda73ac75 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:20.929879 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0176b94-4b37-46fb-b451-a8bbda73ac75 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:20.930648 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0176b94-4b37-46fb-b451-a8bbda73ac75 None admin] RBAC: Adding query filter params (name=member) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:20.931028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0176b94-4b37-46fb-b451-a8bbda73ac75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:20.932960 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0176b94-4b37-46fb-b451-a8bbda73ac75 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:20.942301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 216/429] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:40:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:20.943116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cab113-2c27-476c-afc7-9767423a56d1 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:20.947405 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0176b94-4b37-46fb-b451-a8bbda73ac75 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:20.982058 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68b099-64f2-4a88-a557-d308218f1d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:20.983111 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68b099-64f2-4a88-a557-d308218f1d5c None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:20.983625 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68b099-64f2-4a88-a557-d308218f1d5c None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:20.984140 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68b099-64f2-4a88-a557-d308218f1d5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:20.996642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68b099-64f2-4a88-a557-d308218f1d5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:21.002491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-5c68b099-64f2-4a88-a557-d308218f1d5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:40:21.002491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:21.002491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:21.002491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:21.002491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:21.002491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:21.002491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:21.002491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:21.002491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:21.002491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:21.002491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:21.002491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:21.002491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:21.002491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:21.002491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:21.002491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:21.003379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:21.003379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:21.003379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:21.003379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:21.003379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:21.003379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:21.003379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:21.003379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:21.003379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:21.003379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:21.003379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:21.003379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:21.003379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:21.003379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:21.003379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:21.003379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:21.004168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:21.004168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:21.004168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:21.004168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:21.004168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:21.004168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:21.004168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:21.004168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:21.004168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:21.004168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:21.004168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:40:21.004168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:21.006631 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 214/430] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:40:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:21.013474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68b099-64f2-4a88-a557-d308218f1d5c None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:21.070574 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0176b94-4b37-46fb-b451-a8bbda73ac75 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:21.109971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:21.115125 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9634451-b985-422e-bd0d-ad4c403897db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:21.115765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9634451-b985-422e-bd0d-ad4c403897db None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:21.116053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9634451-b985-422e-bd0d-ad4c403897db None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:21.116399 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9634451-b985-422e-bd0d-ad4c403897db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:21.147284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68b099-64f2-4a88-a557-d308218f1d5c None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:21.168611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:21.187127 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ece5f-120a-4b63-a25d-7efb51544727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:21.187750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ece5f-120a-4b63-a25d-7efb51544727 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:21.188037 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ece5f-120a-4b63-a25d-7efb51544727 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:21.188333 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ece5f-120a-4b63-a25d-7efb51544727 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:21.189035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ece5f-120a-4b63-a25d-7efb51544727 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:21.189407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ece5f-120a-4b63-a25d-7efb51544727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:21.191079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ece5f-120a-4b63-a25d-7efb51544727 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:21.199242 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9634451-b985-422e-bd0d-ad4c403897db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:21.201053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9634451-b985-422e-bd0d-ad4c403897db None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:21.201263 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 215/431] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:21.206668 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ece5f-120a-4b63-a25d-7efb51544727 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:21.331334 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 217/432] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:21.338413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9634451-b985-422e-bd0d-ad4c403897db None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:21.355674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ece5f-120a-4b63-a25d-7efb51544727 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:21.389644 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:21.395358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75ee51-fb04-4e82-a7d3-ff7ff22cd72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:21.396026 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75ee51-fb04-4e82-a7d3-ff7ff22cd72e None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:21.396287 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75ee51-fb04-4e82-a7d3-ff7ff22cd72e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:21.396564 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75ee51-fb04-4e82-a7d3-ff7ff22cd72e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:21.438898 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:21.476447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9634451-b985-422e-bd0d-ad4c403897db None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:21.488048 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75ee51-fb04-4e82-a7d3-ff7ff22cd72e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:21.490352 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75ee51-fb04-4e82-a7d3-ff7ff22cd72e None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:21.526139 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facb5d5-d2bc-4b9f-97d1-eb8d6417adb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:21.527355 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facb5d5-d2bc-4b9f-97d1-eb8d6417adb0 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:21.528224 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facb5d5-d2bc-4b9f-97d1-eb8d6417adb0 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:21.528917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facb5d5-d2bc-4b9f-97d1-eb8d6417adb0 None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:21.530236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facb5d5-d2bc-4b9f-97d1-eb8d6417adb0 None admin] RBAC: Authorizing `identity:get_project(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:21.533005 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facb5d5-d2bc-4b9f-97d1-eb8d6417adb0 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:21.538881 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 218/433] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:21 2022] GET /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:21.541768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facb5d5-d2bc-4b9f-97d1-eb8d6417adb0 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:21.614444 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 216/434] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:21.620508 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75ee51-fb04-4e82-a7d3-ff7ff22cd72e None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:21.661749 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:21.675026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facb5d5-d2bc-4b9f-97d1-eb8d6417adb0 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:21.712659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0120d9-051a-4691-8716-b6dc7198c38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:21.713652 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0120d9-051a-4691-8716-b6dc7198c38f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:21.714126 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0120d9-051a-4691-8716-b6dc7198c38f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:21.714627 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0120d9-051a-4691-8716-b6dc7198c38f None admin] PATH_INFO: `/v3/groups/02afb7aea2524d71b9ea18c6e6f88714` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:21.715974 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0120d9-051a-4691-8716-b6dc7198c38f None admin] RBAC: Authorizing `identity:get_group(group_id=02afb7aea2524d71b9ea18c6e6f88714)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:21.717619 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0120d9-051a-4691-8716-b6dc7198c38f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:21.719737 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 219/435] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jul 26 14:40:21 2022] GET /identity/v3/groups/02afb7aea2524d71b9ea18c6e6f88714 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:21.725212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0120d9-051a-4691-8716-b6dc7198c38f None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:21.738864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:21.764749 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75ee51-fb04-4e82-a7d3-ff7ff22cd72e None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:21.797940 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7affb47-2f26-44b9-81cc-bae9d76d9490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:21.798621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7affb47-2f26-44b9-81cc-bae9d76d9490 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:21.798904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7affb47-2f26-44b9-81cc-bae9d76d9490 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:21.799176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7affb47-2f26-44b9-81cc-bae9d76d9490 None admin] PATH_INFO: `/v3/projects/4fab63748076484db8b585b850783e19` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:21.800360 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7affb47-2f26-44b9-81cc-bae9d76d9490 None admin] RBAC: Authorizing `identity:get_project(project_id=4fab63748076484db8b585b850783e19)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:21.801784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7affb47-2f26-44b9-81cc-bae9d76d9490 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:21.803464 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 217/436] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:21 2022] GET /identity/v3/projects/4fab63748076484db8b585b850783e19 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:21.804578 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f60bbf-af10-4636-97dc-0abef0810646 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:21.805382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f60bbf-af10-4636-97dc-0abef0810646 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:21.805659 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f60bbf-af10-4636-97dc-0abef0810646 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:21.810968 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 218/437] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:21.810968 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f60bbf-af10-4636-97dc-0abef0810646 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:21.844509 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0120d9-051a-4691-8716-b6dc7198c38f None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:21.882527 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60e411-bb44-404b-aa99-508bdf554ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:21.883724 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60e411-bb44-404b-aa99-508bdf554ce5 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:21.883999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60e411-bb44-404b-aa99-508bdf554ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:21.884390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60e411-bb44-404b-aa99-508bdf554ce5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:21.885298 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60e411-bb44-404b-aa99-508bdf554ce5 None admin] RBAC: Adding query filter params (group.id=02afb7aea2524d71b9ea18c6e6f88714, role.id=8303560a3b6948379f524afad4b798d0, scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:21.885608 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60e411-bb44-404b-aa99-508bdf554ce5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:21.887187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60e411-bb44-404b-aa99-508bdf554ce5 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:21.893884 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 220/438] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jul 26 14:40:21 2022] GET /identity/v3/role_assignments?group.id=02afb7aea2524d71b9ea18c6e6f88714&scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e&role.id=8303560a3b6948379f524afad4b798d0 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:21.895379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404b9bb-e935-4249-8ad9-fed1a2d81e0f None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:21.895677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404b9bb-e935-4249-8ad9-fed1a2d81e0f None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:21.895953 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404b9bb-e935-4249-8ad9-fed1a2d81e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:21.916094 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-5404b9bb-e935-4249-8ad9-fed1a2d81e0f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:21.917330 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5404b9bb-e935-4249-8ad9-fed1a2d81e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:21.939661 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:21.944742 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f60bbf-af10-4636-97dc-0abef0810646 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:21.985908 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c0373-07a0-498a-8adf-8548ed67a71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:21.986674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c0373-07a0-498a-8adf-8548ed67a71e None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:21.987096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c0373-07a0-498a-8adf-8548ed67a71e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:21.987453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c0373-07a0-498a-8adf-8548ed67a71e None admin] PATH_INFO: `/v3/groups/02afb7aea2524d71b9ea18c6e6f88714` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:21.988773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c0373-07a0-498a-8adf-8548ed67a71e None admin] RBAC: Authorizing `identity:get_group(group_id=02afb7aea2524d71b9ea18c6e6f88714)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:21.990513 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c0373-07a0-498a-8adf-8548ed67a71e None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:21.997562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 219/439] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jul 26 14:40:21 2022] GET /identity/v3/groups/02afb7aea2524d71b9ea18c6e6f88714 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:21.999092 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c0373-07a0-498a-8adf-8548ed67a71e None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:22.008749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 221/440] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:22.031149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404b9bb-e935-4249-8ad9-fed1a2d81e0f None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:22.035210 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:22.122968 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c0373-07a0-498a-8adf-8548ed67a71e None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:22.159088 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404b9bb-e935-4249-8ad9-fed1a2d81e0f None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:22.169700 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac7611-c0a1-4a12-848d-163bc05e91d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:22.170614 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac7611-c0a1-4a12-848d-163bc05e91d8 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:22.170989 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac7611-c0a1-4a12-848d-163bc05e91d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:22.171272 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac7611-c0a1-4a12-848d-163bc05e91d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:22.172122 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac7611-c0a1-4a12-848d-163bc05e91d8 None admin] RBAC: Adding query filter params (group.id=02afb7aea2524d71b9ea18c6e6f88714, role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846, scope.project.id=4fab63748076484db8b585b850783e19) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:22.172439 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac7611-c0a1-4a12-848d-163bc05e91d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:22.173862 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac7611-c0a1-4a12-848d-163bc05e91d8 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:22.186602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 220/441] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jul 26 14:40:21 2022] GET /identity/v3/role_assignments?group.id=02afb7aea2524d71b9ea18c6e6f88714&scope.project.id=4fab63748076484db8b585b850783e19&role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:22.195006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa885cf0-0109-4f2f-983a-8451d1eb5b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:22.196254 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa885cf0-0109-4f2f-983a-8451d1eb5b3b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:22.196537 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa885cf0-0109-4f2f-983a-8451d1eb5b3b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:22.196813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa885cf0-0109-4f2f-983a-8451d1eb5b3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:22.209717 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa885cf0-0109-4f2f-983a-8451d1eb5b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:22.215496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-fa885cf0-0109-4f2f-983a-8451d1eb5b3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:40:22.215496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:22.215496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:22.215496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:22.215496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:22.215496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:22.215496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:22.215496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:22.215496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:22.215496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:22.215496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:22.215496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:22.215496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:22.215496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:22.215496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:22.215496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:22.216416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:22.216416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:22.216416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:22.216416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:22.216416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:22.216416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:22.216416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:22.216416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:22.216416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:22.216416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:22.216416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:22.216416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:22.216416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:22.216416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:22.216416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:22.216416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:22.217171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:22.217171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:22.217171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:22.217171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:22.217171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:22.217171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:22.217171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:22.217171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:22.217171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:22.217171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:22.217171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:40:22.217171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:22.217171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 222/442] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:40:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:40:22.222900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac7611-c0a1-4a12-848d-163bc05e91d8 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:22.259294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:22.339691 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac7611-c0a1-4a12-848d-163bc05e91d8 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:22.362635 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaef2b7-6da2-4f86-a7ad-2026b164b1ca None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:22.362926 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaef2b7-6da2-4f86-a7ad-2026b164b1ca None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:22.363204 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaef2b7-6da2-4f86-a7ad-2026b164b1ca None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:22.364698 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 223/443] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:22.370190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4216e7-5605-4137-b2e2-86cff85600f1 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:22.370643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4216e7-5605-4137-b2e2-86cff85600f1 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:22.370955 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4216e7-5605-4137-b2e2-86cff85600f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:22.376982 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c4f39-d830-4325-8422-97aaf0ee97b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:22.377611 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c4f39-d830-4325-8422-97aaf0ee97b1 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:22.377901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c4f39-d830-4325-8422-97aaf0ee97b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:22.378184 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c4f39-d830-4325-8422-97aaf0ee97b1 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:22.378947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c4f39-d830-4325-8422-97aaf0ee97b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:22.379258 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c4f39-d830-4325-8422-97aaf0ee97b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:22.380640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c4f39-d830-4325-8422-97aaf0ee97b1 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:22.389727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 221/444] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:22.396167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-4d4216e7-5605-4137-b2e2-86cff85600f1 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:22.396325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c4f39-d830-4325-8422-97aaf0ee97b1 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:22.397404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4d4216e7-5605-4137-b2e2-86cff85600f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:22.467773 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:22.478817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 224/445] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:40:22.502379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4216e7-5605-4137-b2e2-86cff85600f1 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:22.522537 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:22.530284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c4f39-d830-4325-8422-97aaf0ee97b1 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:22.570309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94d10c-71f2-4ebe-bb1a-f2fe6e9430bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:22.571577 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94d10c-71f2-4ebe-bb1a-f2fe6e9430bc None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:22.571865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94d10c-71f2-4ebe-bb1a-f2fe6e9430bc None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:22.572160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94d10c-71f2-4ebe-bb1a-f2fe6e9430bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:22.622784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4216e7-5605-4137-b2e2-86cff85600f1 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:22.660200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94d10c-71f2-4ebe-bb1a-f2fe6e9430bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:22.661745 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94d10c-71f2-4ebe-bb1a-f2fe6e9430bc None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:22.667037 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766f55c-1c26-4b7e-9f11-74f3654866cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:22.667713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766f55c-1c26-4b7e-9f11-74f3654866cb None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:22.668004 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766f55c-1c26-4b7e-9f11-74f3654866cb None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:22.668284 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766f55c-1c26-4b7e-9f11-74f3654866cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:22.681570 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766f55c-1c26-4b7e-9f11-74f3654866cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:22.687275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-6766f55c-1c26-4b7e-9f11-74f3654866cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:22.687275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:22.687275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:22.687275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:22.687275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:22.687275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:22.687275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:22.687275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:22.687275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:22.687275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:22.687275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:22.687275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:22.687275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:22.687275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:22.687275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:22.687275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:22.688183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:22.688183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:22.688183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:22.688183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:22.688183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:22.688183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:22.688183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:22.688183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:22.688183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:22.688183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:22.688183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:22.688183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:22.688183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:22.688183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:22.688183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:22.688183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:22.688967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:22.688967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:22.688967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:22.688967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:22.688967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:22.688967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:22.688967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:22.688967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:22.688967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:22.688967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:22.688967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:22.688967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:22.688967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 225/446] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:40:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:22.694416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766f55c-1c26-4b7e-9f11-74f3654866cb None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:22.756998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:22.774420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:22.789154 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 222/447] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:40:22.790547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94d10c-71f2-4ebe-bb1a-f2fe6e9430bc None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:22.802168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766f55c-1c26-4b7e-9f11-74f3654866cb None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:22.842094 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376f785-72e1-455c-9c52-b370c6499aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:22.842747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376f785-72e1-455c-9c52-b370c6499aaf None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:22.843026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376f785-72e1-455c-9c52-b370c6499aaf None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:22.843309 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376f785-72e1-455c-9c52-b370c6499aaf None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:22.844037 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376f785-72e1-455c-9c52-b370c6499aaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:22.844346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376f785-72e1-455c-9c52-b370c6499aaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:22.845759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376f785-72e1-455c-9c52-b370c6499aaf None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:22.854741 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 226/448] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:22.860070 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376f785-72e1-455c-9c52-b370c6499aaf None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:22.895732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94d10c-71f2-4ebe-bb1a-f2fe6e9430bc None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:22.933462 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164eeaea-43c0-40d3-80cf-e391fd2c8a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:22.934215 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164eeaea-43c0-40d3-80cf-e391fd2c8a2f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:22.934591 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164eeaea-43c0-40d3-80cf-e391fd2c8a2f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:22.934868 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164eeaea-43c0-40d3-80cf-e391fd2c8a2f None admin] PATH_INFO: `/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:22.936036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164eeaea-43c0-40d3-80cf-e391fd2c8a2f None admin] RBAC: Authorizing `identity:get_project(project_id=5aa24b1d6a9841a6b7ab0c3718bbaf6e)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:22.937478 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164eeaea-43c0-40d3-80cf-e391fd2c8a2f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:22.939154 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 223/449] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:22 2022] GET /identity/v3/projects/5aa24b1d6a9841a6b7ab0c3718bbaf6e => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:22.944538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164eeaea-43c0-40d3-80cf-e391fd2c8a2f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:22.965662 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376f785-72e1-455c-9c52-b370c6499aaf None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:22.982086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:22.999950 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d03cad-eab4-491c-8be8-db71baecfeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:23.000564 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d03cad-eab4-491c-8be8-db71baecfeb5 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:23.000846 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d03cad-eab4-491c-8be8-db71baecfeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:23.001120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d03cad-eab4-491c-8be8-db71baecfeb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:23.005643 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:23.042331 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164eeaea-43c0-40d3-80cf-e391fd2c8a2f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:23.068974 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d03cad-eab4-491c-8be8-db71baecfeb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:23.070504 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d03cad-eab4-491c-8be8-db71baecfeb5 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:23.075194 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ad013-9b87-44d9-ab80-98b8c4967522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:23.075832 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ad013-9b87-44d9-ab80-98b8c4967522 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:23.076115 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ad013-9b87-44d9-ab80-98b8c4967522 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:23.076393 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ad013-9b87-44d9-ab80-98b8c4967522 None admin] PATH_INFO: `/v3/groups/02afb7aea2524d71b9ea18c6e6f88714` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:23.077547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ad013-9b87-44d9-ab80-98b8c4967522 None admin] RBAC: Authorizing `identity:get_group(group_id=02afb7aea2524d71b9ea18c6e6f88714)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:23.079018 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ad013-9b87-44d9-ab80-98b8c4967522 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:23.080604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 224/450] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jul 26 14:40:22 2022] GET /identity/v3/groups/02afb7aea2524d71b9ea18c6e6f88714 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:23.086258 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ad013-9b87-44d9-ab80-98b8c4967522 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:23.170058 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 227/451] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:40:23.175745 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d03cad-eab4-491c-8be8-db71baecfeb5 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:23.192744 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ad013-9b87-44d9-ab80-98b8c4967522 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:23.195510 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:23.229759 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:23.235645 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3ef23-8fe1-4c48-b9aa-0f6a3aab30bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:23.236273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3ef23-8fe1-4c48-b9aa-0f6a3aab30bc None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:23.236557 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3ef23-8fe1-4c48-b9aa-0f6a3aab30bc None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:23.236834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3ef23-8fe1-4c48-b9aa-0f6a3aab30bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:23.237618 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3ef23-8fe1-4c48-b9aa-0f6a3aab30bc None admin] RBAC: Adding query filter params (group.id=02afb7aea2524d71b9ea18c6e6f88714, role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846, scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:23.237931 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3ef23-8fe1-4c48-b9aa-0f6a3aab30bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:23.239399 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3ef23-8fe1-4c48-b9aa-0f6a3aab30bc None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:23.245696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 225/452] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jul 26 14:40:23 2022] GET /identity/v3/role_assignments?group.id=02afb7aea2524d71b9ea18c6e6f88714&scope.project.id=5aa24b1d6a9841a6b7ab0c3718bbaf6e&role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:23.293612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d03cad-eab4-491c-8be8-db71baecfeb5 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:23.330970 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9829f-1c16-45c4-9ccd-d7d2934e2dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:23.331623 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9829f-1c16-45c4-9ccd-d7d2934e2dac None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:23.331907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9829f-1c16-45c4-9ccd-d7d2934e2dac None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:23.332184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9829f-1c16-45c4-9ccd-d7d2934e2dac None admin] PATH_INFO: `/v3/projects/6185d6162c124385aebcf03e8b422158` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:23.333378 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9829f-1c16-45c4-9ccd-d7d2934e2dac None admin] RBAC: Authorizing `identity:get_project(project_id=6185d6162c124385aebcf03e8b422158)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:23.334887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9829f-1c16-45c4-9ccd-d7d2934e2dac None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:23.336591 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 228/453] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:23 2022] GET /identity/v3/projects/6185d6162c124385aebcf03e8b422158 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:23.342377 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3ef23-8fe1-4c48-b9aa-0f6a3aab30bc None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:23.446785 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3ef23-8fe1-4c48-b9aa-0f6a3aab30bc None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:23.481741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b514939-fa57-42c8-a0e6-8d99df59f255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:23.482504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b514939-fa57-42c8-a0e6-8d99df59f255 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:23.482719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b514939-fa57-42c8-a0e6-8d99df59f255 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:23.482999 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b514939-fa57-42c8-a0e6-8d99df59f255 None admin] PATH_INFO: `/v3/groups/902a6ae998c24666b2ed604895f7eb14` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:23.484134 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b514939-fa57-42c8-a0e6-8d99df59f255 None admin] RBAC: Authorizing `identity:get_group(group_id=902a6ae998c24666b2ed604895f7eb14)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:23.485567 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b514939-fa57-42c8-a0e6-8d99df59f255 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:23.487195 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 226/454] 10.222.0.86 () {56 vars in 1180 bytes} [Tue Jul 26 14:40:23 2022] GET /identity/v3/groups/902a6ae998c24666b2ed604895f7eb14 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:23.493848 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9829f-1c16-45c4-9ccd-d7d2934e2dac None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:23.581321 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:23.600498 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9829f-1c16-45c4-9ccd-d7d2934e2dac None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:23.636381 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00877f-ecfb-4cd8-8be8-eeb927a0f50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:23.636991 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00877f-ecfb-4cd8-8be8-eeb927a0f50c None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:23.637275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00877f-ecfb-4cd8-8be8-eeb927a0f50c None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:23.637549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00877f-ecfb-4cd8-8be8-eeb927a0f50c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:23.638333 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00877f-ecfb-4cd8-8be8-eeb927a0f50c None admin] RBAC: Adding query filter params (group.id=902a6ae998c24666b2ed604895f7eb14, role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.project.id=6185d6162c124385aebcf03e8b422158) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:23.638678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00877f-ecfb-4cd8-8be8-eeb927a0f50c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:23.640710 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00877f-ecfb-4cd8-8be8-eeb927a0f50c None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:23.646608 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 229/455] 10.222.0.86 () {56 vars in 1376 bytes} [Tue Jul 26 14:40:23 2022] GET /identity/v3/role_assignments?group.id=902a6ae998c24666b2ed604895f7eb14&scope.project.id=6185d6162c124385aebcf03e8b422158&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:26.107109 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477a009-3aa7-4ece-98b5-b693d3fb7dd4 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:26.107604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477a009-3aa7-4ece-98b5-b693d3fb7dd4 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:26.107679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477a009-3aa7-4ece-98b5-b693d3fb7dd4 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:26.109264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 227/456] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:26.114918 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956a6d1-8a90-4ee3-9c4f-a118c49f38ed None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:26.115347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956a6d1-8a90-4ee3-9c4f-a118c49f38ed None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:26.115476 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956a6d1-8a90-4ee3-9c4f-a118c49f38ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:26.143795 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-7956a6d1-8a90-4ee3-9c4f-a118c49f38ed None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:26.145225 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-7956a6d1-8a90-4ee3-9c4f-a118c49f38ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:26.244889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 230/457] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:26.287930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477a009-3aa7-4ece-98b5-b693d3fb7dd4 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:26.306617 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369637dd-c69f-4a29-bf8e-49114bfde63f None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:26.307014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369637dd-c69f-4a29-bf8e-49114bfde63f None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:26.307530 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369637dd-c69f-4a29-bf8e-49114bfde63f None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:26.309462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 231/458] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:26.315286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825cdd6-c8ec-4474-b490-863b3fd8c251 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:26.315818 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825cdd6-c8ec-4474-b490-863b3fd8c251 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:26.316299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825cdd6-c8ec-4474-b490-863b3fd8c251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:26.341614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-f825cdd6-c8ec-4474-b490-863b3fd8c251 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:26.344233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-f825cdd6-c8ec-4474-b490-863b3fd8c251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:26.396621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:26.476903 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477a009-3aa7-4ece-98b5-b693d3fb7dd4 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:26.517894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 232/459] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:26.544567 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfa370-73ff-4ea1-bca1-3362471f2b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:26.545232 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfa370-73ff-4ea1-bca1-3362471f2b7f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:26.545518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfa370-73ff-4ea1-bca1-3362471f2b7f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:26.545801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfa370-73ff-4ea1-bca1-3362471f2b7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:26.558750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825cdd6-c8ec-4474-b490-863b3fd8c251 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:26.567336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cfa370-73ff-4ea1-bca1-3362471f2b7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:26.569060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:26.569193 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cfa370-73ff-4ea1-bca1-3362471f2b7f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:26.600801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-36cfa370-73ff-4ea1-bca1-3362471f2b7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:26.600801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:26.600801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:26.600801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:26.600801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:26.600801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:26.600801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:26.600801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:26.600801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:26.600801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:26.600801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:26.600801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:26.600801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:26.600801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:26.600801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:26.601726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:26.601726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:26.601726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:26.601726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:26.601726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:26.601726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:26.601726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:26.601726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:26.601726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:26.601726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:26.601726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:26.601726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:26.601726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:26.601726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:26.601726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:26.601726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:26.601726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:26.602596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:26.602596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:26.602596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:26.602596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:26.606554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 228/460] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:26.612163 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfa370-73ff-4ea1-bca1-3362471f2b7f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:26.717108 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825cdd6-c8ec-4474-b490-863b3fd8c251 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:26.743968 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfa370-73ff-4ea1-bca1-3362471f2b7f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:26.757845 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be7e6f-f163-455a-abee-2872ff3da537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:26.758556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7e6f-f163-455a-abee-2872ff3da537 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:26.758894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7e6f-f163-455a-abee-2872ff3da537 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:26.759212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7e6f-f163-455a-abee-2872ff3da537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:26.760484 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:26.771251 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be7e6f-f163-455a-abee-2872ff3da537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:26.772858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be7e6f-f163-455a-abee-2872ff3da537 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:26.781475 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce166a-3b17-4036-be0a-079a7edafe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:26.782106 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce166a-3b17-4036-be0a-079a7edafe8c None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:26.782415 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce166a-3b17-4036-be0a-079a7edafe8c None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:26.782714 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce166a-3b17-4036-be0a-079a7edafe8c None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:26.783804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce166a-3b17-4036-be0a-079a7edafe8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:26.784126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce166a-3b17-4036-be0a-079a7edafe8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:26.785521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce166a-3b17-4036-be0a-079a7edafe8c None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:26.791523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-33be7e6f-f163-455a-abee-2872ff3da537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:26.791523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:26.791523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:26.791523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:26.791523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:26.791523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:26.791523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:26.791523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:26.791523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:26.791523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:26.791523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:26.791523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:26.791523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:26.791523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:26.791523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:26.792433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:26.792433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:26.792433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:26.792433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:26.792433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:26.792433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:26.792433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:26.792433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:26.792433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:26.792433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:26.792433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:26.792433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:26.792433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:26.792433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:26.792433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:26.792433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:26.792433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:26.793514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:26.793514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:26.793514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:26.793514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:26.795485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 233/461] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:26.796990 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b8f60-6bc5-46c1-929c-ecdcaf308135 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:26.797296 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b8f60-6bc5-46c1-929c-ecdcaf308135 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:26.797586 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b8f60-6bc5-46c1-929c-ecdcaf308135 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:26.798914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 234/462] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:26.800283 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c4bc7-cdd2-41fc-9b0f-b2485357bcdf None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:26.800747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c4bc7-cdd2-41fc-9b0f-b2485357bcdf None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:26.801154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c4bc7-cdd2-41fc-9b0f-b2485357bcdf None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:26.803027 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 235/463] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:26.804024 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c4bc7-cdd2-41fc-9b0f-b2485357bcdf None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:26.812802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 229/464] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:26.814361 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcbfb6-ecbb-47ef-a4a6-0d252d3dc59c None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:26.815229 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcbfb6-ecbb-47ef-a4a6-0d252d3dc59c None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:26.815655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcbfb6-ecbb-47ef-a4a6-0d252d3dc59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:26.837558 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-addcbfb6-ecbb-47ef-a4a6-0d252d3dc59c None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:26.838997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-addcbfb6-ecbb-47ef-a4a6-0d252d3dc59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:26.871349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:26.917401 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c4bc7-cdd2-41fc-9b0f-b2485357bcdf None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:26.918582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 230/465] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:26.919796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bfd4c-1ddc-4daf-aba1-d7e7431f0a16 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:26.920133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bfd4c-1ddc-4daf-aba1-d7e7431f0a16 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:26.920458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bfd4c-1ddc-4daf-aba1-d7e7431f0a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:26.940904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-c94bfd4c-1ddc-4daf-aba1-d7e7431f0a16 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:26.942276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-c94bfd4c-1ddc-4daf-aba1-d7e7431f0a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:26.979850 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b9ad8-5cde-47fa-806c-b2b7dd6bb358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:26.980479 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b9ad8-5cde-47fa-806c-b2b7dd6bb358 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:26.980767 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b9ad8-5cde-47fa-806c-b2b7dd6bb358 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:26.981049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b9ad8-5cde-47fa-806c-b2b7dd6bb358 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:26.981744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b9ad8-5cde-47fa-806c-b2b7dd6bb358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:26.982058 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b9ad8-5cde-47fa-806c-b2b7dd6bb358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:26.983570 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b9ad8-5cde-47fa-806c-b2b7dd6bb358 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:27.001946 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 236/466] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:27.001946 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b9ad8-5cde-47fa-806c-b2b7dd6bb358 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:27.034754 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 231/467] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:27.034754 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bfd4c-1ddc-4daf-aba1-d7e7431f0a16 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:27.074371 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:27.119330 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b9ad8-5cde-47fa-806c-b2b7dd6bb358 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:27.142940 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:27.146782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bfd4c-1ddc-4daf-aba1-d7e7431f0a16 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:27.157332 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f29df1-8f4f-4992-8b09-9d2b21792da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:27.158193 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f29df1-8f4f-4992-8b09-9d2b21792da4 None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:27.158654 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f29df1-8f4f-4992-8b09-9d2b21792da4 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:27.159082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f29df1-8f4f-4992-8b09-9d2b21792da4 None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:27.170055 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f29df1-8f4f-4992-8b09-9d2b21792da4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:27.170055 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f29df1-8f4f-4992-8b09-9d2b21792da4 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:27.183241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61691cf0-66a6-453d-bcdc-699345192deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:27.183923 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61691cf0-66a6-453d-bcdc-699345192deb None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:27.184212 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61691cf0-66a6-453d-bcdc-699345192deb None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:27.184491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61691cf0-66a6-453d-bcdc-699345192deb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:27.195029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61691cf0-66a6-453d-bcdc-699345192deb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:27.196977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61691cf0-66a6-453d-bcdc-699345192deb None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:27.212902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-61691cf0-66a6-453d-bcdc-699345192deb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:27.212902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:27.212902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:27.212902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:27.212902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:27.212902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:27.212902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:27.212902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:27.212902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:27.212902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:27.212902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:27.212902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:27.212902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:27.212902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:27.212902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:27.213972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:27.213972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:27.213972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:27.213972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:27.213972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:27.213972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:27.213972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:27.213972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:27.213972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:27.213972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:27.213972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:27.213972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:27.213972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:27.213972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:27.213972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:27.213972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:27.213972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:27.215199 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:27.215199 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:27.215199 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:27.215199 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:27.218528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 232/468] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:27.219565 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61691cf0-66a6-453d-bcdc-699345192deb None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:27.291633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 237/469] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jul 26 14:40:26 2022] POST /identity/v3/users => generated 246 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:40:27.303612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f29df1-8f4f-4992-8b09-9d2b21792da4 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:27.308468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:27.328457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61691cf0-66a6-453d-bcdc-699345192deb None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:27.374072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29422a21-e055-49cc-9763-c9fc4e0e2673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:27.375060 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29422a21-e055-49cc-9763-c9fc4e0e2673 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:27.375667 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29422a21-e055-49cc-9763-c9fc4e0e2673 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:27.376560 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29422a21-e055-49cc-9763-c9fc4e0e2673 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:27.378129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29422a21-e055-49cc-9763-c9fc4e0e2673 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:27.380005 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29422a21-e055-49cc-9763-c9fc4e0e2673 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:27.441662 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f29df1-8f4f-4992-8b09-9d2b21792da4 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:27.462536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 233/470] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jul 26 14:40:27 2022] POST /identity/v3/users => generated 248 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:40:27.463305 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29422a21-e055-49cc-9763-c9fc4e0e2673 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:27.491058 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbb38d-ae22-4e89-84be-eeebc9471004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:27.493498 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbb38d-ae22-4e89-84be-eeebc9471004 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:27.493985 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbb38d-ae22-4e89-84be-eeebc9471004 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:27.494632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbb38d-ae22-4e89-84be-eeebc9471004 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:27.511667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbb38d-ae22-4e89-84be-eeebc9471004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:27.514345 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbb38d-ae22-4e89-84be-eeebc9471004 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:27.533901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-0acbb38d-ae22-4e89-84be-eeebc9471004 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:27.533901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:27.533901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:27.533901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:27.533901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:27.533901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:27.533901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:27.533901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:27.533901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:27.533901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:27.533901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:27.533901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:27.533901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:27.533901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:27.533901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:27.534878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:27.534878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:27.534878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:27.534878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:27.534878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:27.534878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:27.534878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:27.534878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:27.534878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:27.534878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:27.534878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:27.534878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:27.534878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:27.534878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:27.534878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:27.534878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:27.534878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:27.535719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:27.535719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:27.535719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:27.535719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:27.538892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 238/471] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:27.538892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15f724-1d40-4b3f-872f-2894d93a03ea None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:27.538892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15f724-1d40-4b3f-872f-2894d93a03ea None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:27.538892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15f724-1d40-4b3f-872f-2894d93a03ea None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:27.540631 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 239/472] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:27.543557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15f724-1d40-4b3f-872f-2894d93a03ea None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:27.584706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:27.604878 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29422a21-e055-49cc-9763-c9fc4e0e2673 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:27.647491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e2ab8-46c2-40bc-b903-ff1f7bebd820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:27.648733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e2ab8-46c2-40bc-b903-ff1f7bebd820 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:27.649062 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e2ab8-46c2-40bc-b903-ff1f7bebd820 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:27.649416 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e2ab8-46c2-40bc-b903-ff1f7bebd820 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:27.650516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e2ab8-46c2-40bc-b903-ff1f7bebd820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:27.650821 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e2ab8-46c2-40bc-b903-ff1f7bebd820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:27.652422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e2ab8-46c2-40bc-b903-ff1f7bebd820 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:27.668669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 234/473] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:27.669816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824f8c4-bd2c-43fa-b302-508769130077 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:27.670103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824f8c4-bd2c-43fa-b302-508769130077 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:27.671337 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824f8c4-bd2c-43fa-b302-508769130077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:27.683225 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:27.695529 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-3824f8c4-bd2c-43fa-b302-508769130077 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:27.696953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-3824f8c4-bd2c-43fa-b302-508769130077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:27.697708 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15f724-1d40-4b3f-872f-2894d93a03ea None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:27.746241 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe8ac3-bb0d-4d7a-a34f-b7357003ee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:27.746839 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe8ac3-bb0d-4d7a-a34f-b7357003ee29 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:27.747127 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe8ac3-bb0d-4d7a-a34f-b7357003ee29 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:27.747412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe8ac3-bb0d-4d7a-a34f-b7357003ee29 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:27.748581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe8ac3-bb0d-4d7a-a34f-b7357003ee29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:27.749155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe8ac3-bb0d-4d7a-a34f-b7357003ee29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:27.750945 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe8ac3-bb0d-4d7a-a34f-b7357003ee29 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:27.767873 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 240/474] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:27.769320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe8ac3-bb0d-4d7a-a34f-b7357003ee29 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:27.776706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 235/475] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:27.777538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824f8c4-bd2c-43fa-b302-508769130077 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:27.896135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:27.912902 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe8ac3-bb0d-4d7a-a34f-b7357003ee29 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:27.921877 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824f8c4-bd2c-43fa-b302-508769130077 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:27.965058 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad97e6-f63d-49ae-86d5-dcfff6f4dad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:27.966447 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:27.966600 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad97e6-f63d-49ae-86d5-dcfff6f4dad0 None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:27.966816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad97e6-f63d-49ae-86d5-dcfff6f4dad0 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:27.967106 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad97e6-f63d-49ae-86d5-dcfff6f4dad0 None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:27.967815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad97e6-f63d-49ae-86d5-dcfff6f4dad0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:27.969266 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad97e6-f63d-49ae-86d5-dcfff6f4dad0 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:27.975146 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8098ff-b740-4e73-a181-605782ac0c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:27.976006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8098ff-b740-4e73-a181-605782ac0c0d None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:27.978786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8098ff-b740-4e73-a181-605782ac0c0d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:27.978786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8098ff-b740-4e73-a181-605782ac0c0d None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:27.978786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8098ff-b740-4e73-a181-605782ac0c0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:27.979969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8098ff-b740-4e73-a181-605782ac0c0d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:28.074826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 241/476] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jul 26 14:40:27 2022] POST /identity/v3/users => generated 249 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:40:28.075945 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad97e6-f63d-49ae-86d5-dcfff6f4dad0 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:28.109794 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 236/477] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jul 26 14:40:27 2022] POST /identity/v3/users => generated 248 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:40:28.200691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad97e6-f63d-49ae-86d5-dcfff6f4dad0 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:28.242080 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3aabd-6466-4f15-816f-17951f56f48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:28.243087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3aabd-6466-4f15-816f-17951f56f48e None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:28.243589 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3aabd-6466-4f15-816f-17951f56f48e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:28.244045 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3aabd-6466-4f15-816f-17951f56f48e None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:28.244975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3aabd-6466-4f15-816f-17951f56f48e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:28.246705 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3aabd-6466-4f15-816f-17951f56f48e None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:28.279815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.sql.core [None req-19c3aabd-6466-4f15-816f-17951f56f48e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 14:40:28.279815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 14:40:28.279815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [parameters: {'id': '7cf37e87b70544e9951dae7e26d7ee24', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 14:40:28.279815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92029) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 14:40:28.303776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-19c3aabd-6466-4f15-816f-17951f56f48e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 14:40:28.303776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:28.303776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:40:28.303776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 14:40:28.303776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:40:28.303776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 14:40:28.303776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:40:28.303776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 14:40:28.303776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:40:28.303776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application conn.query(q) Jul 26 14:40:28.303776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:40:28.303776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:40:28.303776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:40:28.303776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application result.read() Jul 26 14:40:28.303776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:40:28.304744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 14:40:28.304744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:40:28.304744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 14:40:28.304744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:40:28.304744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 14:40:28.304744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:40:28.304744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 14:40:28.304744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 14:40:28.304744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:28.304744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 14:40:28.304744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:28.304744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:28.304744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 14:40:28.304744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 14:40:28.304744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 26 14:40:28.304744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return ref.to_dict() Jul 26 14:40:28.304744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 14:40:28.304744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application next(self.gen) Jul 26 14:40:28.305679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 14:40:28.305679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application yield resource Jul 26 14:40:28.305679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 14:40:28.305679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application next(self.gen) Jul 26 14:40:28.305679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 14:40:28.305679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 14:40:28.305679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:40:28.305679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 14:40:28.305679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:40:28.305679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise self.value Jul 26 14:40:28.305679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 14:40:28.305679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 14:40:28.305679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 14:40:28.305679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application session.commit() Jul 26 14:40:28.305679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 14:40:28.305679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 14:40:28.305679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 14:40:28.306580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 14:40:28.306580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 14:40:28.306580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self.session.flush() Jul 26 14:40:28.306580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 14:40:28.306580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 14:40:28.306580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 14:40:28.306580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 14:40:28.306580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 14:40:28.306580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application compat.raise_( Jul 26 14:40:28.306580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:40:28.306580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception Jul 26 14:40:28.306580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 14:40:28.306580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 14:40:28.306580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 14:40:28.306580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 14:40:28.306580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 14:40:28.306580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 14:40:28.307432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 14:40:28.307432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 14:40:28.307432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 14:40:28.307432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 14:40:28.307432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 14:40:28.307432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 14:40:28.307432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 14:40:28.307432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 14:40:28.307432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 14:40:28.307432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 14:40:28.307432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 14:40:28.307432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 14:40:28.307432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 14:40:28.307432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 14:40:28.307432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:40:28.307432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception Jul 26 14:40:28.308234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:40:28.308234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 14:40:28.308234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:40:28.308234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 14:40:28.308234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:40:28.308234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 14:40:28.308234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:40:28.308234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application conn.query(q) Jul 26 14:40:28.308234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:40:28.308234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:40:28.308234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:40:28.308234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application result.read() Jul 26 14:40:28.308234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:40:28.308234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 14:40:28.308234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:40:28.308234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 14:40:28.309008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:40:28.309008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 14:40:28.309008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:40:28.309008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 14:40:28.309008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 14:40:28.309008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 14:40:28.309008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [parameters: {'id': '7cf37e87b70544e9951dae7e26d7ee24', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 14:40:28.309008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 14:40:28.309008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:28.309008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:40:28.309008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:28.309008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:28.309008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:28.309008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:28.309008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:28.309008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:28.309788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:28.309788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:28.309788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:28.309788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:28.309788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:28.309788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:28.309788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 26 14:40:28.309788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 26 14:40:28.309788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:28.309788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:28.309788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 26 14:40:28.309788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 26 14:40:28.309788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 14:40:28.309788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 14:40:28.309788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 14:40:28.309788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:28.312984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 242/478] 10.222.0.86 () {60 vars in 1131 bytes} [Tue Jul 26 14:40:28 2022] POST /identity/v3/roles => generated 144 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:28.319779 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8098ff-b740-4e73-a181-605782ac0c0d None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:28.447594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8098ff-b740-4e73-a181-605782ac0c0d None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:28.489118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7664449-7db9-4ed6-ab0d-f26800f44227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:28.489858 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7664449-7db9-4ed6-ab0d-f26800f44227 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:28.490184 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7664449-7db9-4ed6-ab0d-f26800f44227 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:28.490517 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7664449-7db9-4ed6-ab0d-f26800f44227 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:28.502896 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7664449-7db9-4ed6-ab0d-f26800f44227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:28.509965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-d7664449-7db9-4ed6-ab0d-f26800f44227 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:40:28.509965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:28.509965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:28.509965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:28.509965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:28.509965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:28.509965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:28.509965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:28.509965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:28.509965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:28.509965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:28.509965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:28.509965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:28.509965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:28.509965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:28.509965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:28.510900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:28.510900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:28.510900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:28.510900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:28.510900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:28.510900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:28.510900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:28.510900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:28.510900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:28.510900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:28.510900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:28.510900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:28.510900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:28.510900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:28.510900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:28.510900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:28.511658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:28.511658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:28.511658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:28.511658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:28.511658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:28.511658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:28.511658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:28.511658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:28.511658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:28.511658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:28.511658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:40:28.511658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:28.512235 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 237/479] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:40:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:28.517649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3aabd-6466-4f15-816f-17951f56f48e None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:28.534271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:28.659079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3aabd-6466-4f15-816f-17951f56f48e None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:28.721292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23bf94a-8bdb-4104-89cc-d397ca800f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:28.721940 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bf94a-8bdb-4104-89cc-d397ca800f11 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:28.722258 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bf94a-8bdb-4104-89cc-d397ca800f11 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:28.722612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bf94a-8bdb-4104-89cc-d397ca800f11 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:28.723644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23bf94a-8bdb-4104-89cc-d397ca800f11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:28.724005 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23bf94a-8bdb-4104-89cc-d397ca800f11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:28.725582 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23bf94a-8bdb-4104-89cc-d397ca800f11 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:28.742628 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 243/480] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:29.714550 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2544725-b3c2-497f-902c-102942cb2492 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:29.715048 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2544725-b3c2-497f-902c-102942cb2492 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:29.715048 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2544725-b3c2-497f-902c-102942cb2492 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:29.716561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 238/481] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:29.731068 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2902d7-929c-4030-83c2-d2cd3d5b546a None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:29.731558 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2902d7-929c-4030-83c2-d2cd3d5b546a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:29.731759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2902d7-929c-4030-83c2-d2cd3d5b546a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:29.782431 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-bf2902d7-929c-4030-83c2-d2cd3d5b546a None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:29.782431 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-bf2902d7-929c-4030-83c2-d2cd3d5b546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:29.952487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:29.967956 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 244/482] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:30.016212 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2544725-b3c2-497f-902c-102942cb2492 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:30.036533 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016d990-3570-4ade-9e14-e16a2a8479e5 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:30.037216 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016d990-3570-4ade-9e14-e16a2a8479e5 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:30.037840 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016d990-3570-4ade-9e14-e16a2a8479e5 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:30.040039 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 245/483] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:30.047958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558076e-11bb-4531-908e-00a19938cdab None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:30.048475 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558076e-11bb-4531-908e-00a19938cdab None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:30.048946 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558076e-11bb-4531-908e-00a19938cdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:30.084344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-c558076e-11bb-4531-908e-00a19938cdab None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:30.085544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c558076e-11bb-4531-908e-00a19938cdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:30.126582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:30.254673 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 246/484] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:30.260880 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2544725-b3c2-497f-902c-102942cb2492 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:30.302809 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984ae7b-7a93-43a4-a3d3-38ab9a0d8d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:30.303469 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984ae7b-7a93-43a4-a3d3-38ab9a0d8d64 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:30.303758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984ae7b-7a93-43a4-a3d3-38ab9a0d8d64 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:30.304034 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984ae7b-7a93-43a4-a3d3-38ab9a0d8d64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:30.319664 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558076e-11bb-4531-908e-00a19938cdab None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:30.344123 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984ae7b-7a93-43a4-a3d3-38ab9a0d8d64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:30.353503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-a984ae7b-7a93-43a4-a3d3-38ab9a0d8d64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:30.353503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:30.353503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:30.353503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:30.353503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:30.353503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:30.353503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:30.353503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:30.353503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:30.353503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:30.353503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:30.353503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:30.353503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:30.353503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:30.353503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:30.353503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:30.354637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:30.354637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:30.354637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:30.354637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:30.354637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:30.354637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:30.354637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:30.354637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:30.354637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:30.354637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:30.354637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:30.354637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:30.354637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:30.354637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:30.354637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:30.354637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:30.355617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:30.355617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:30.355617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:30.355617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:30.355617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:30.355617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:30.355617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:30.355617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:30.355617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:30.355617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:30.355617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:30.355617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:30.366254 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 239/485] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:30.368199 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984ae7b-7a93-43a4-a3d3-38ab9a0d8d64 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:30.497614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558076e-11bb-4531-908e-00a19938cdab None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:30.548838 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:30.559074 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff7861-2690-4d0a-8136-45fd555f669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:30.559756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff7861-2690-4d0a-8136-45fd555f669a None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:30.560046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff7861-2690-4d0a-8136-45fd555f669a None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:30.567415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff7861-2690-4d0a-8136-45fd555f669a None admin] PATH_INFO: `/v3/roles/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:30.567538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984ae7b-7a93-43a4-a3d3-38ab9a0d8d64 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:30.581844 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:30.583037 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff7861-2690-4d0a-8136-45fd555f669a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:30.591770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-b1ff7861-2690-4d0a-8136-45fd555f669a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:30.591770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:30.591770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:30.591770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:30.591770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:30.591770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:30.591770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:30.591770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:30.591770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:30.591770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:30.591770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:30.591770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:30.591770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:30.591770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:30.591770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:30.591770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:30.596785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:30.596785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:30.596785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:30.596785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:30.596785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:30.596785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:30.596785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:30.596785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:30.596785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:30.596785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:30.596785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:30.596785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:30.596785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:30.596785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:30.596785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:30.596785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:30.597749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:30.597749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:30.597749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:30.597749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:30.597749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:30.597749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:30.597749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:30.597749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:30.597749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:30.597749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:30.597749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:30.597749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:30.597749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 247/486] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:30.603144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff7861-2690-4d0a-8136-45fd555f669a None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:30.629320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcadff3-c05d-48c8-9681-d4bd291d8af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:30.630165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcadff3-c05d-48c8-9681-d4bd291d8af5 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:30.630477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcadff3-c05d-48c8-9681-d4bd291d8af5 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:30.632382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcadff3-c05d-48c8-9681-d4bd291d8af5 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:30.633172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcadff3-c05d-48c8-9681-d4bd291d8af5 None admin] RBAC: Adding query filter params (name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:30.633548 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcadff3-c05d-48c8-9681-d4bd291d8af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:30.635085 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcadff3-c05d-48c8-9681-d4bd291d8af5 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:30.653528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 240/487] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:40:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:30.657795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcadff3-c05d-48c8-9681-d4bd291d8af5 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:30.798657 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff7861-2690-4d0a-8136-45fd555f669a None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:30.859891 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcadff3-c05d-48c8-9681-d4bd291d8af5 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:30.867872 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc6bfa-f688-4b08-98b8-3dfc680c59cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:30.868619 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc6bfa-f688-4b08-98b8-3dfc680c59cb None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:30.868952 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc6bfa-f688-4b08-98b8-3dfc680c59cb None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:30.869255 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc6bfa-f688-4b08-98b8-3dfc680c59cb None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:30.870149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc6bfa-f688-4b08-98b8-3dfc680c59cb None admin] RBAC: Adding query filter params (name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:30.870533 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc6bfa-f688-4b08-98b8-3dfc680c59cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:30.872186 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc6bfa-f688-4b08-98b8-3dfc680c59cb None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:30.892699 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 248/488] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:40:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:30.903528 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc6bfa-f688-4b08-98b8-3dfc680c59cb None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:30.904488 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a655f-dce6-4fb7-8362-33566761ea5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:30.905143 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a655f-dce6-4fb7-8362-33566761ea5b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:30.905522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a655f-dce6-4fb7-8362-33566761ea5b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:30.905806 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a655f-dce6-4fb7-8362-33566761ea5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:30.917168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a655f-dce6-4fb7-8362-33566761ea5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:30.918764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a655f-dce6-4fb7-8362-33566761ea5b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:30.933727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-473a655f-dce6-4fb7-8362-33566761ea5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:30.933727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:30.933727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:30.933727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:30.933727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:30.933727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:30.933727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:30.933727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:30.933727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:30.933727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:30.933727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:30.933727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:30.933727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:30.933727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:30.933727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:30.934612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:30.934612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:30.934612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:30.934612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:30.934612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:30.934612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:30.934612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:30.934612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:30.934612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:30.934612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:30.934612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:30.934612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:30.934612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:30.934612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:30.934612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:30.934612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:30.934612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:30.935539 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:30.935539 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:30.935539 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:30.935539 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:30.935539 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 241/489] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:30.936566 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06940da7-74b1-4b58-8531-58ccd6c97de7 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:30.936865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06940da7-74b1-4b58-8531-58ccd6c97de7 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:30.937146 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06940da7-74b1-4b58-8531-58ccd6c97de7 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:30.938584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 242/490] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:30.939620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9289b-4eb7-4bfd-a2f0-f90872dfa8b1 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:30.940094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9289b-4eb7-4bfd-a2f0-f90872dfa8b1 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:30.940273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9289b-4eb7-4bfd-a2f0-f90872dfa8b1 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:30.941661 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 243/491] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:30.945848 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9289b-4eb7-4bfd-a2f0-f90872dfa8b1 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:30.968975 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:30.971715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:31.034122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc6bfa-f688-4b08-98b8-3dfc680c59cb None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:31.072085 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9289b-4eb7-4bfd-a2f0-f90872dfa8b1 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:31.072548 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44528e93-6ccb-4e82-8016-e07552307579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:31.073282 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44528e93-6ccb-4e82-8016-e07552307579 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:31.073567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44528e93-6ccb-4e82-8016-e07552307579 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:31.073871 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44528e93-6ccb-4e82-8016-e07552307579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:31.085671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44528e93-6ccb-4e82-8016-e07552307579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:31.087286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44528e93-6ccb-4e82-8016-e07552307579 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:31.103277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-44528e93-6ccb-4e82-8016-e07552307579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:31.103277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:31.103277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:31.103277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:31.103277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:31.103277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:31.103277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:31.103277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:31.103277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:31.103277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:31.103277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:31.103277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:31.103277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:31.103277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:31.103277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:31.104120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:31.104120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:31.104120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:31.104120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:31.104120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:31.104120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:31.104120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:31.104120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:31.104120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:31.104120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:31.104120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:31.104120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:31.104120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:31.104120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:31.104120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:31.104120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:31.104120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:31.104955 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:31.104955 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:31.104955 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:31.104955 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:31.104955 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 249/492] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:31.106120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b99e09-e9fc-492e-ab79-02bbe9a3790e None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:31.106492 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b99e09-e9fc-492e-ab79-02bbe9a3790e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:31.106718 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b99e09-e9fc-492e-ab79-02bbe9a3790e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:31.111057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e13c8-b268-4ead-a166-a29a8c2d0ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:31.111628 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e13c8-b268-4ead-a166-a29a8c2d0ab6 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:31.111916 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e13c8-b268-4ead-a166-a29a8c2d0ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:31.112251 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e13c8-b268-4ead-a166-a29a8c2d0ab6 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:31.112956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e13c8-b268-4ead-a166-a29a8c2d0ab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:31.113511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e13c8-b268-4ead-a166-a29a8c2d0ab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:31.115839 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e13c8-b268-4ead-a166-a29a8c2d0ab6 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:31.125218 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-49b99e09-e9fc-492e-ab79-02bbe9a3790e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:31.126421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-49b99e09-e9fc-492e-ab79-02bbe9a3790e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:31.133124 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 244/493] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:31.133124 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c0c42-48e0-4b81-afa1-ad039c6e5a3e None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:31.133124 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c0c42-48e0-4b81-afa1-ad039c6e5a3e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:31.133124 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c0c42-48e0-4b81-afa1-ad039c6e5a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:31.150243 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-5f6c0c42-48e0-4b81-afa1-ad039c6e5a3e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:31.151514 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-5f6c0c42-48e0-4b81-afa1-ad039c6e5a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:31.216957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 250/494] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:31.217895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b99e09-e9fc-492e-ab79-02bbe9a3790e None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:31.239350 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 245/495] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:31.241589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c0c42-48e0-4b81-afa1-ad039c6e5a3e None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:31.254429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:31.255866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:31.329929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b99e09-e9fc-492e-ab79-02bbe9a3790e None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:31.346596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c0c42-48e0-4b81-afa1-ad039c6e5a3e None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:31.373551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f962bd-4244-4078-ba0f-2397fc2d9678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:31.374758 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f962bd-4244-4078-ba0f-2397fc2d9678 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:31.375188 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f962bd-4244-4078-ba0f-2397fc2d9678 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:31.375493 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f962bd-4244-4078-ba0f-2397fc2d9678 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:31.376115 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f962bd-4244-4078-ba0f-2397fc2d9678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:31.376425 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f962bd-4244-4078-ba0f-2397fc2d9678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:31.377903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f962bd-4244-4078-ba0f-2397fc2d9678 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:31.383029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a99729-6232-40d0-9148-c86038549370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:31.384257 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a99729-6232-40d0-9148-c86038549370 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:31.384527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a99729-6232-40d0-9148-c86038549370 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:31.384862 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a99729-6232-40d0-9148-c86038549370 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:31.390171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 251/496] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:31.393336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a99729-6232-40d0-9148-c86038549370 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:31.394860 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a99729-6232-40d0-9148-c86038549370 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:31.395341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f962bd-4244-4078-ba0f-2397fc2d9678 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:31.408339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-59a99729-6232-40d0-9148-c86038549370 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:40:31.408339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:31.408339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:31.408339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:31.408339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:31.408339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:31.408339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:31.408339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:31.408339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:31.408339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:31.408339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:31.408339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:31.408339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:31.408339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:31.408339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:31.408339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:31.409266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:31.409266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:31.409266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:31.409266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:31.409266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:31.409266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:31.409266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:31.409266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:31.409266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:31.409266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:31.409266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:31.409266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:31.409266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:31.409266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:31.409266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:31.409266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:31.409266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:31.409266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:31.410125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:31.410125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:31.410125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:31.410125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:31.410125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:31.410125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:31.410125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:31.410125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:31.410125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:40:31.410125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:31.410125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 246/497] 10.222.0.86 () {56 vars in 1093 bytes} [Tue Jul 26 14:40:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:31.411486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a99729-6232-40d0-9148-c86038549370 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:31.491036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:31.510208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:31.517480 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f962bd-4244-4078-ba0f-2397fc2d9678 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:31.523176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a99729-6232-40d0-9148-c86038549370 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:31.554124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01772239-98dc-4d0d-a18d-da32504e18b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:31.554871 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01772239-98dc-4d0d-a18d-da32504e18b8 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:31.555161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01772239-98dc-4d0d-a18d-da32504e18b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:31.556026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01772239-98dc-4d0d-a18d-da32504e18b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:31.563908 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6c3ad-d6dd-4285-acaf-5ee97e09151a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:31.564542 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6c3ad-d6dd-4285-acaf-5ee97e09151a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:31.564824 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6c3ad-d6dd-4285-acaf-5ee97e09151a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:31.565095 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6c3ad-d6dd-4285-acaf-5ee97e09151a None admin] PATH_INFO: `/v3/roles/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:31.566757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01772239-98dc-4d0d-a18d-da32504e18b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:31.572161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-01772239-98dc-4d0d-a18d-da32504e18b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:31.572161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:31.572161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:31.572161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:31.572161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:31.572161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:31.572161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:31.572161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:31.572161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:31.572161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:31.572161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:31.572161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:31.572161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:31.572161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:31.572161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:31.572161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:31.573022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:31.573022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:31.573022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:31.573022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:31.573022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:31.573022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:31.573022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:31.573022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:31.573022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:31.573022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:31.573022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:31.573022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:31.573022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:31.573022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:31.573022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:31.573022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:31.573819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:31.573819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:31.573819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:31.573819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:31.573819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:31.573819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:31.573819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:31.573819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:31.573819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:31.573819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:31.573819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:31.573819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:31.573819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 252/498] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:31.574492 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01772239-98dc-4d0d-a18d-da32504e18b8 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:31.581547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6c3ad-d6dd-4285-acaf-5ee97e09151a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:31.587100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-0eb6c3ad-d6dd-4285-acaf-5ee97e09151a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:31.587100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:31.587100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:31.587100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:31.587100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:31.587100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:31.587100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:31.587100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:31.587100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:31.587100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:31.587100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:31.587100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:31.587100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:31.587100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:31.587100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:31.587100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:31.588002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:31.588002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:31.588002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:31.588002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:31.588002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:31.588002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:31.588002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:31.588002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:31.588002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:31.588002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:31.588002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:31.588002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:31.588002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:31.588002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:31.588002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:31.588002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:31.589171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:31.589171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:31.589171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:31.589171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:31.589171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:31.589171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:31.589171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:31.589171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:31.589171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:31.589171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:31.589171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:31.589171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:31.589171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 247/499] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:31.590015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6c3ad-d6dd-4285-acaf-5ee97e09151a None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:31.692087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01772239-98dc-4d0d-a18d-da32504e18b8 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:31.702309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6c3ad-d6dd-4285-acaf-5ee97e09151a None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:31.729849 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a55578-5ad7-4137-942a-f8c19f40babb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:31.730535 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a55578-5ad7-4137-942a-f8c19f40babb None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:31.730822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a55578-5ad7-4137-942a-f8c19f40babb None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:31.731100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a55578-5ad7-4137-942a-f8c19f40babb None admin] PATH_INFO: `/v3/users/glance` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:31.734788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:31.738814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a55578-5ad7-4137-942a-f8c19f40babb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:31.739607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b02e5-3c65-4011-8c98-140fa5526177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:31.740220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b02e5-3c65-4011-8c98-140fa5526177 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:31.740320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a55578-5ad7-4137-942a-f8c19f40babb None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:31.740500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b02e5-3c65-4011-8c98-140fa5526177 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:31.740771 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b02e5-3c65-4011-8c98-140fa5526177 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:31.741562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b02e5-3c65-4011-8c98-140fa5526177 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:31.741867 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b02e5-3c65-4011-8c98-140fa5526177 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:31.743872 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b02e5-3c65-4011-8c98-140fa5526177 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:31.753807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-12a55578-5ad7-4137-942a-f8c19f40babb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 14:40:31.753807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:31.753807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:31.753807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:31.753807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:31.753807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:31.753807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:31.753807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:31.753807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:31.753807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:31.753807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:31.753807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:31.753807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:31.753807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:31.753807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:31.753807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:31.754963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:31.754963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:31.754963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:31.754963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:31.754963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:31.754963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:31.754963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:31.754963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:31.754963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:31.754963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:31.754963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:31.754963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:31.754963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:31.754963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:31.754963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:31.754963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:31.754963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:31.754963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:31.755851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:31.755851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:31.755851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:31.755851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:31.755851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:31.755851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:31.755851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:31.755851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:31.755851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 14:40:31.755851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:31.755851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 253/500] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:31.756456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a55578-5ad7-4137-942a-f8c19f40babb None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:31.774642 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:31.782490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 248/501] 10.222.0.86 () {56 vars in 1133 bytes} [Tue Jul 26 14:40:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:31.783274 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b02e5-3c65-4011-8c98-140fa5526177 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:31.857838 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a55578-5ad7-4137-942a-f8c19f40babb None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:31.883843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b02e5-3c65-4011-8c98-140fa5526177 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:31.892122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51dffb-6d4a-424a-8118-edb187fb57a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:31.892748 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51dffb-6d4a-424a-8118-edb187fb57a8 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:31.893030 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51dffb-6d4a-424a-8118-edb187fb57a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:31.893308 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51dffb-6d4a-424a-8118-edb187fb57a8 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:31.894019 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51dffb-6d4a-424a-8118-edb187fb57a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:31.894330 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51dffb-6d4a-424a-8118-edb187fb57a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:31.895742 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51dffb-6d4a-424a-8118-edb187fb57a8 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:31.904463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 254/502] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:40:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:31.904885 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f680422-0435-4deb-b64d-5ce78b51f9f1 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:31.905413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f680422-0435-4deb-b64d-5ce78b51f9f1 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:31.905693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f680422-0435-4deb-b64d-5ce78b51f9f1 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:31.906928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 255/503] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:31.907612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f680422-0435-4deb-b64d-5ce78b51f9f1 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:31.922302 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22332698-7fd8-4ced-b364-2cd3f76482b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:31.922881 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22332698-7fd8-4ced-b364-2cd3f76482b1 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:31.923160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22332698-7fd8-4ced-b364-2cd3f76482b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:31.923429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22332698-7fd8-4ced-b364-2cd3f76482b1 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:31.924135 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22332698-7fd8-4ced-b364-2cd3f76482b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:31.924437 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22332698-7fd8-4ced-b364-2cd3f76482b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:31.925806 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22332698-7fd8-4ced-b364-2cd3f76482b1 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:31.934337 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 249/504] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:40:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:31.935135 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22332698-7fd8-4ced-b364-2cd3f76482b1 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:31.989669 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:31.998056 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:32.014708 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f680422-0435-4deb-b64d-5ce78b51f9f1 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:32.045079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22332698-7fd8-4ced-b364-2cd3f76482b1 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:32.049388 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964529d-0846-4353-8f9f-b81610fd8c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:32.050061 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964529d-0846-4353-8f9f-b81610fd8c41 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:32.050348 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964529d-0846-4353-8f9f-b81610fd8c41 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:32.050659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964529d-0846-4353-8f9f-b81610fd8c41 None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:32.051455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964529d-0846-4353-8f9f-b81610fd8c41 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:32.051767 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964529d-0846-4353-8f9f-b81610fd8c41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:32.053221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964529d-0846-4353-8f9f-b81610fd8c41 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:32.078949 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a342aaa-a2ea-488e-bcc9-c9453ae3a18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:32.079562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a342aaa-a2ea-488e-bcc9-c9453ae3a18f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:32.079843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a342aaa-a2ea-488e-bcc9-c9453ae3a18f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:32.080114 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a342aaa-a2ea-488e-bcc9-c9453ae3a18f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:32.093873 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 256/505] 10.222.0.86 () {56 vars in 1137 bytes} [Tue Jul 26 14:40:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:32.093873 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964529d-0846-4353-8f9f-b81610fd8c41 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:32.151462 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a342aaa-a2ea-488e-bcc9-c9453ae3a18f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:32.152921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a342aaa-a2ea-488e-bcc9-c9453ae3a18f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:32.194203 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964529d-0846-4353-8f9f-b81610fd8c41 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:32.203478 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:32.229480 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66faf699-cf86-4d3a-84ac-5aee3177abc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:32.230129 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faf699-cf86-4d3a-84ac-5aee3177abc2 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:32.230449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faf699-cf86-4d3a-84ac-5aee3177abc2 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:32.230729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faf699-cf86-4d3a-84ac-5aee3177abc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:32.232635 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:32.241082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66faf699-cf86-4d3a-84ac-5aee3177abc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:32.242587 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66faf699-cf86-4d3a-84ac-5aee3177abc2 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:32.250810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 250/506] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:32.252050 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12116a0a-95ac-493f-b2df-4a53d53b9e38 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:32.252333 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12116a0a-95ac-493f-b2df-4a53d53b9e38 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:32.252610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12116a0a-95ac-493f-b2df-4a53d53b9e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:32.257807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-66faf699-cf86-4d3a-84ac-5aee3177abc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:32.257807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:32.257807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:32.257807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:32.257807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:32.257807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:32.257807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:32.257807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:32.257807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:32.257807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:32.257807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:32.257807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:32.257807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:32.257807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:32.257807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:32.259301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:32.259301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:32.259301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:32.259301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:32.259301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:32.259301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:32.259301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:32.259301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:32.259301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:32.259301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:32.259301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:32.259301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:32.259301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:32.259301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:32.259301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:32.259301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:32.259301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:32.260420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:32.260420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:32.260420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:32.260420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:32.260420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 257/507] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:32.260420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66faf699-cf86-4d3a-84ac-5aee3177abc2 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:32.272881 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-12116a0a-95ac-493f-b2df-4a53d53b9e38 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:32.274278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-12116a0a-95ac-493f-b2df-4a53d53b9e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:32.340383 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 251/508] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:32.341214 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12116a0a-95ac-493f-b2df-4a53d53b9e38 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:32.374107 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66faf699-cf86-4d3a-84ac-5aee3177abc2 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:32.407526 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ca0de-0df8-4155-8aca-d1a2872c0aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:32.408163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca0de-0df8-4155-8aca-d1a2872c0aed None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:32.408448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca0de-0df8-4155-8aca-d1a2872c0aed None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:32.408718 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca0de-0df8-4155-8aca-d1a2872c0aed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:32.419707 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ca0de-0df8-4155-8aca-d1a2872c0aed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:32.421198 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ca0de-0df8-4155-8aca-d1a2872c0aed None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:32.421630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:32.436686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-9e2ca0de-0df8-4155-8aca-d1a2872c0aed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:32.436686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:32.436686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:32.436686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:32.436686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:32.436686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:32.436686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:32.436686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:32.436686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:32.436686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:32.436686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:32.436686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:32.436686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:32.436686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:32.436686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:32.443427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:32.443427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:32.443427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:32.443427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:32.443427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:32.443427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:32.443427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:32.443427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:32.443427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:32.443427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:32.443427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:32.443427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:32.443427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:32.443427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:32.443427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:32.443427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:32.443427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:32.444324 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:32.444324 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:32.444324 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:32.444324 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:32.444324 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 258/509] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:32.444324 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ca0de-0df8-4155-8aca-d1a2872c0aed None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:32.444653 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12116a0a-95ac-493f-b2df-4a53d53b9e38 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:32.475209 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf68d07-9641-4e51-b9c0-7fc70ee842b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:32.475832 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf68d07-9641-4e51-b9c0-7fc70ee842b0 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:32.476110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf68d07-9641-4e51-b9c0-7fc70ee842b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:32.476383 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf68d07-9641-4e51-b9c0-7fc70ee842b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:32.481296 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:32.544723 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf68d07-9641-4e51-b9c0-7fc70ee842b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:32.545874 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ca0de-0df8-4155-8aca-d1a2872c0aed None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:32.546201 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf68d07-9641-4e51-b9c0-7fc70ee842b0 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:32.581130 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7f47d-9bfc-4ab5-b0e1-354b4a69bdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:32.581768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7f47d-9bfc-4ab5-b0e1-354b4a69bdfa None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:32.582054 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7f47d-9bfc-4ab5-b0e1-354b4a69bdfa None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:32.582334 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7f47d-9bfc-4ab5-b0e1-354b4a69bdfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:32.593215 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7f47d-9bfc-4ab5-b0e1-354b4a69bdfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:32.594700 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7f47d-9bfc-4ab5-b0e1-354b4a69bdfa None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:32.609206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-f8a7f47d-9bfc-4ab5-b0e1-354b4a69bdfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:32.609206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:32.609206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:32.609206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:32.609206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:32.609206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:32.609206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:32.609206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:32.609206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:32.609206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:32.609206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:32.609206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:32.609206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:32.609206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:32.609206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:32.610047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:32.610047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:32.610047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:32.610047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:32.610047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:32.610047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:32.610047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:32.610047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:32.610047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:32.610047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:32.610047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:32.610047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:32.610047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:32.610047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:32.610047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:32.610047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:32.610047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:32.611155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:32.611155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:32.611155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:32.611155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:32.611155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 259/510] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:32.611612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7f47d-9bfc-4ab5-b0e1-354b4a69bdfa None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:32.628873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:32.647117 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 252/511] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:32.647924 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf68d07-9641-4e51-b9c0-7fc70ee842b0 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:32.705680 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:32.715982 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7f47d-9bfc-4ab5-b0e1-354b4a69bdfa None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:32.746211 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf68d07-9641-4e51-b9c0-7fc70ee842b0 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:32.749607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84375e3-d3ee-48fb-be3c-c12556bbf277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:32.750227 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84375e3-d3ee-48fb-be3c-c12556bbf277 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:32.750551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84375e3-d3ee-48fb-be3c-c12556bbf277 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:32.750833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84375e3-d3ee-48fb-be3c-c12556bbf277 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:32.751526 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84375e3-d3ee-48fb-be3c-c12556bbf277 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:32.751836 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84375e3-d3ee-48fb-be3c-c12556bbf277 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:32.753213 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84375e3-d3ee-48fb-be3c-c12556bbf277 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:32.765081 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 260/512] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:32.765893 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84375e3-d3ee-48fb-be3c-c12556bbf277 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:32.780515 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654b550-1b77-448f-b62a-692e8266585d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:32.781160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654b550-1b77-448f-b62a-692e8266585d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:32.781440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654b550-1b77-448f-b62a-692e8266585d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:32.781714 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654b550-1b77-448f-b62a-692e8266585d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:32.792647 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654b550-1b77-448f-b62a-692e8266585d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:32.794118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654b550-1b77-448f-b62a-692e8266585d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:32.808662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-6654b550-1b77-448f-b62a-692e8266585d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:32.808662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:32.808662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:32.808662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:32.808662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:32.808662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:32.808662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:32.808662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:32.808662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:32.808662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:32.808662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:32.808662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:32.808662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:32.808662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:32.808662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:32.809482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:32.809482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:32.809482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:32.809482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:32.809482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:32.809482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:32.809482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:32.809482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:32.809482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:32.809482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:32.809482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:32.809482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:32.809482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:32.809482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:32.809482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:32.809482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:32.809482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:32.810323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:32.810323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:32.810323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:32.810323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:32.810323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 253/513] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:32.810648 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654b550-1b77-448f-b62a-692e8266585d None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:32.843980 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:32.869809 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84375e3-d3ee-48fb-be3c-c12556bbf277 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:32.904419 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273bee2-b093-4757-9add-05d17d2d99bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:32.905033 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273bee2-b093-4757-9add-05d17d2d99bd None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:32.905314 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273bee2-b093-4757-9add-05d17d2d99bd None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:32.905588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273bee2-b093-4757-9add-05d17d2d99bd None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:32.906278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273bee2-b093-4757-9add-05d17d2d99bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:32.906607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273bee2-b093-4757-9add-05d17d2d99bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:32.907990 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273bee2-b093-4757-9add-05d17d2d99bd None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:32.909755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654b550-1b77-448f-b62a-692e8266585d None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:32.919348 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 261/514] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:32.920138 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273bee2-b093-4757-9add-05d17d2d99bd None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:32.989488 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:33.013948 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cd015-46c7-4729-a79c-70ca663494f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:33.014632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cd015-46c7-4729-a79c-70ca663494f5 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:33.014915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cd015-46c7-4729-a79c-70ca663494f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:33.015190 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cd015-46c7-4729-a79c-70ca663494f5 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:33.015874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cd015-46c7-4729-a79c-70ca663494f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:33.016184 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cd015-46c7-4729-a79c-70ca663494f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:33.017544 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cd015-46c7-4729-a79c-70ca663494f5 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:33.029906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 254/515] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:33.030873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cd015-46c7-4729-a79c-70ca663494f5 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:33.079828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273bee2-b093-4757-9add-05d17d2d99bd None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:33.112941 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbecc7-6bb2-42d0-b19c-7d361199689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:33.113575 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbecc7-6bb2-42d0-b19c-7d361199689e None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:33.113908 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbecc7-6bb2-42d0-b19c-7d361199689e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:33.114314 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbecc7-6bb2-42d0-b19c-7d361199689e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:33.124884 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbecc7-6bb2-42d0-b19c-7d361199689e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:33.126360 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbecc7-6bb2-42d0-b19c-7d361199689e None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:33.133124 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:33.140527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cd015-46c7-4729-a79c-70ca663494f5 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:33.140819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-37cbecc7-6bb2-42d0-b19c-7d361199689e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:33.140819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:33.140819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:33.140819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:33.140819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:33.140819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:33.140819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:33.140819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:33.140819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:33.140819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:33.140819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:33.140819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:33.140819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:33.140819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:33.140819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:33.147897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:33.147897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:33.147897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:33.147897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:33.147897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:33.147897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:33.147897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:33.147897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:33.147897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:33.147897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:33.147897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:33.147897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:33.147897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:33.147897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:33.147897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:33.147897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:33.147897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:33.148894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:33.148894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:33.148894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:33.148894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:33.148894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 262/516] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:33.148894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbecc7-6bb2-42d0-b19c-7d361199689e None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:33.175744 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e1c5c-2858-4d98-b679-00021bd4f966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:33.176389 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e1c5c-2858-4d98-b679-00021bd4f966 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:33.176655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e1c5c-2858-4d98-b679-00021bd4f966 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:33.176935 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e1c5c-2858-4d98-b679-00021bd4f966 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:33.183919 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e1c5c-2858-4d98-b679-00021bd4f966 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:33.185355 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e1c5c-2858-4d98-b679-00021bd4f966 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:33.196971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-448e1c5c-2858-4d98-b679-00021bd4f966 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:40:33.196971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:33.196971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:33.196971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:33.196971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:33.196971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:33.196971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:33.196971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:33.196971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:33.196971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:33.196971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:33.196971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:33.196971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:33.196971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:33.196971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:33.196971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:33.197998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:33.197998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:33.197998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:33.197998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:33.197998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:33.197998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:33.197998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:33.197998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:33.197998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:33.197998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:33.197998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:33.197998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:33.197998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:33.197998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:33.197998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:33.197998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:33.197998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:33.197998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:33.199165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:33.199165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:33.199165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:33.199165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:33.199165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:33.199165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:33.199165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:33.199165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:33.199165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:40:33.199165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:33.199165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 255/517] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:33.199165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e1c5c-2858-4d98-b679-00021bd4f966 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:33.208211 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:33.250941 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbecc7-6bb2-42d0-b19c-7d361199689e None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:33.286332 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022a214-52a8-4b1a-82d9-c61096e83c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:33.286979 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022a214-52a8-4b1a-82d9-c61096e83c41 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:33.287262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022a214-52a8-4b1a-82d9-c61096e83c41 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:33.287540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022a214-52a8-4b1a-82d9-c61096e83c41 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:33.288238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022a214-52a8-4b1a-82d9-c61096e83c41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:33.288549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022a214-52a8-4b1a-82d9-c61096e83c41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:33.290160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022a214-52a8-4b1a-82d9-c61096e83c41 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:33.297356 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e1c5c-2858-4d98-b679-00021bd4f966 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:33.302566 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 263/518] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:33.303423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022a214-52a8-4b1a-82d9-c61096e83c41 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:33.331964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db511c94-9149-4c12-8bb3-12da08ce4431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:33.332595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db511c94-9149-4c12-8bb3-12da08ce4431 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:33.332878 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db511c94-9149-4c12-8bb3-12da08ce4431 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:33.333157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db511c94-9149-4c12-8bb3-12da08ce4431 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:33.340513 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db511c94-9149-4c12-8bb3-12da08ce4431 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:33.341966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db511c94-9149-4c12-8bb3-12da08ce4431 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:33.353758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-db511c94-9149-4c12-8bb3-12da08ce4431 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 14:40:33.353758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:33.353758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:33.353758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:33.353758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:33.353758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:33.353758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:33.353758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:33.353758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:33.353758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:33.353758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:33.353758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:33.353758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:33.353758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:33.353758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:33.353758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:33.354834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:33.354834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:33.354834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:33.354834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:33.354834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:33.354834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:33.354834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:33.354834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:33.354834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:33.354834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:33.354834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:33.354834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:33.354834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:33.354834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:33.354834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:33.354834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:33.354834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:33.354834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:33.355947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:33.355947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:33.355947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:33.355947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:33.355947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:33.355947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:33.355947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:33.355947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:33.355947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 14:40:33.355947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:33.358588 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 256/519] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:33.360389 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db511c94-9149-4c12-8bb3-12da08ce4431 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:33.378294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:33.403379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022a214-52a8-4b1a-82d9-c61096e83c41 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:33.425660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:33.437190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e18ef-7166-4dbe-a865-7f3b8dafcfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:33.437821 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e18ef-7166-4dbe-a865-7f3b8dafcfc8 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:33.438099 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e18ef-7166-4dbe-a865-7f3b8dafcfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:33.438371 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e18ef-7166-4dbe-a865-7f3b8dafcfc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:33.447131 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e18ef-7166-4dbe-a865-7f3b8dafcfc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:33.448715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e18ef-7166-4dbe-a865-7f3b8dafcfc8 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:33.460387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-3e5e18ef-7166-4dbe-a865-7f3b8dafcfc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:33.460387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:33.460387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:33.460387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:33.460387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:33.460387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:33.460387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:33.460387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:33.460387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:33.460387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:33.460387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:33.460387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:33.460387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:33.460387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:33.460387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:33.461390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:33.461390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:33.461390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:33.461390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:33.461390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:33.461390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:33.461390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:33.461390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:33.461390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:33.461390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:33.461390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:33.461390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:33.461390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:33.461390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:33.461390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:33.461390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:33.461390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:33.462421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:33.462421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:33.462421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:33.462421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:33.462421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:33.462421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:33.462421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:33.462421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:33.462421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 264/520] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:33.462421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e18ef-7166-4dbe-a865-7f3b8dafcfc8 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:33.463052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db511c94-9149-4c12-8bb3-12da08ce4431 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:33.499109 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513aba51-0ae8-46e2-aff6-2c018a97c44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:33.499732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513aba51-0ae8-46e2-aff6-2c018a97c44d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:33.500019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513aba51-0ae8-46e2-aff6-2c018a97c44d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:33.500301 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513aba51-0ae8-46e2-aff6-2c018a97c44d None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:33.501057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513aba51-0ae8-46e2-aff6-2c018a97c44d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:33.501313 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513aba51-0ae8-46e2-aff6-2c018a97c44d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:33.502713 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513aba51-0ae8-46e2-aff6-2c018a97c44d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:33.514808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 257/521] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:33.515623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513aba51-0ae8-46e2-aff6-2c018a97c44d None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:33.561187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e18ef-7166-4dbe-a865-7f3b8dafcfc8 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:33.590345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:33.594669 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42c55a-32ea-462f-940d-266aaa8d23fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:33.595287 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42c55a-32ea-462f-940d-266aaa8d23fa None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:33.595570 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42c55a-32ea-462f-940d-266aaa8d23fa None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:33.595846 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42c55a-32ea-462f-940d-266aaa8d23fa None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:33.596672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42c55a-32ea-462f-940d-266aaa8d23fa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:33.596981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42c55a-32ea-462f-940d-266aaa8d23fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:33.598458 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42c55a-32ea-462f-940d-266aaa8d23fa None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:33.615543 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513aba51-0ae8-46e2-aff6-2c018a97c44d None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:33.615893 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 265/522] 10.222.0.86 () {56 vars in 1137 bytes} [Tue Jul 26 14:40:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:33.616711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42c55a-32ea-462f-940d-266aaa8d23fa None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:33.649673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d32e72-0eb5-4683-8f63-cdfb7c077533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:33.650287 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d32e72-0eb5-4683-8f63-cdfb7c077533 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:33.650592 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d32e72-0eb5-4683-8f63-cdfb7c077533 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:33.650867 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d32e72-0eb5-4683-8f63-cdfb7c077533 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:33.651534 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d32e72-0eb5-4683-8f63-cdfb7c077533 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:33.652962 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d32e72-0eb5-4683-8f63-cdfb7c077533 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:33.659904 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:33.717916 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42c55a-32ea-462f-940d-266aaa8d23fa None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:33.736193 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 258/523] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jul 26 14:40:33 2022] POST /identity/v3/users => generated 247 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:40:33.737406 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d32e72-0eb5-4683-8f63-cdfb7c077533 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:33.766326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e7db2-7c1f-4a4a-aaf5-0a0de5d43de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:33.766326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e7db2-7c1f-4a4a-aaf5-0a0de5d43de8 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:33.766326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e7db2-7c1f-4a4a-aaf5-0a0de5d43de8 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:33.766326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e7db2-7c1f-4a4a-aaf5-0a0de5d43de8 None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:33.766749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e7db2-7c1f-4a4a-aaf5-0a0de5d43de8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:33.766749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e7db2-7c1f-4a4a-aaf5-0a0de5d43de8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:33.766749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e7db2-7c1f-4a4a-aaf5-0a0de5d43de8 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:33.786633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 266/524] 10.222.0.86 () {56 vars in 1139 bytes} [Tue Jul 26 14:40:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:33.787517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e7db2-7c1f-4a4a-aaf5-0a0de5d43de8 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:33.860127 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d32e72-0eb5-4683-8f63-cdfb7c077533 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:33.903673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:33.904255 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:33.908818 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e7db2-7c1f-4a4a-aaf5-0a0de5d43de8 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:33.912202 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2636bd1-71ef-48e4-ba83-7a2192f185ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:33.912843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2636bd1-71ef-48e4-ba83-7a2192f185ea None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:33.913129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2636bd1-71ef-48e4-ba83-7a2192f185ea None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:33.913415 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2636bd1-71ef-48e4-ba83-7a2192f185ea None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:33.914183 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2636bd1-71ef-48e4-ba83-7a2192f185ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:33.915087 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2636bd1-71ef-48e4-ba83-7a2192f185ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:33.916551 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2636bd1-71ef-48e4-ba83-7a2192f185ea None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:33.936771 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 259/525] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:33.938110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2636bd1-71ef-48e4-ba83-7a2192f185ea None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:33.958898 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef1351-8739-47d7-baee-1e2861920a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:33.959653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef1351-8739-47d7-baee-1e2861920a94 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:33.960114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef1351-8739-47d7-baee-1e2861920a94 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:33.960229 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef1351-8739-47d7-baee-1e2861920a94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:33.967858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef1351-8739-47d7-baee-1e2861920a94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:33.969315 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef1351-8739-47d7-baee-1e2861920a94 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:33.981687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-16ef1351-8739-47d7-baee-1e2861920a94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:33.981687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:33.981687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:33.981687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:33.981687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:33.981687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:33.981687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:33.981687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:33.981687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:33.981687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:33.981687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:33.981687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:33.981687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:33.981687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:33.981687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:33.982659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:33.982659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:33.982659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:33.982659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:33.982659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:33.982659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:33.982659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:33.982659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:33.982659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:33.982659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:33.982659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:33.982659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:33.982659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:33.982659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:33.982659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:33.982659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:33.982659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:33.983802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:33.983802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:33.983802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:33.983802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:33.983802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:33.983802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:33.983802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:33.983802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:33.983802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 267/526] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:33.984263 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef1351-8739-47d7-baee-1e2861920a94 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:34.051883 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2636bd1-71ef-48e4-ba83-7a2192f185ea None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:34.090610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0ae9d-9890-4d92-bec5-32d622d1ef90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:34.091243 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0ae9d-9890-4d92-bec5-32d622d1ef90 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:34.091528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0ae9d-9890-4d92-bec5-32d622d1ef90 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:34.091913 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0ae9d-9890-4d92-bec5-32d622d1ef90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:34.095588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef1351-8739-47d7-baee-1e2861920a94 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:34.132541 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da210419-383c-4bad-b968-0cb1bca91697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:34.133169 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da210419-383c-4bad-b968-0cb1bca91697 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:34.133481 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da210419-383c-4bad-b968-0cb1bca91697 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:34.133760 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da210419-383c-4bad-b968-0cb1bca91697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:34.155909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:34.161893 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:34.168117 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0ae9d-9890-4d92-bec5-32d622d1ef90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:34.172898 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0ae9d-9890-4d92-bec5-32d622d1ef90 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:34.203523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da210419-383c-4bad-b968-0cb1bca91697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:34.204982 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da210419-383c-4bad-b968-0cb1bca91697 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:34.284038 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 260/527] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:34.284889 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0ae9d-9890-4d92-bec5-32d622d1ef90 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:34.329394 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 268/528] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:34.329998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da210419-383c-4bad-b968-0cb1bca91697 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:34.389185 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:34.396579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:34.402942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0ae9d-9890-4d92-bec5-32d622d1ef90 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:34.438693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523a882-d2d7-40dd-923d-0d22bcc85756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:34.438904 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da210419-383c-4bad-b968-0cb1bca91697 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:34.439643 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523a882-d2d7-40dd-923d-0d22bcc85756 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:34.440081 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523a882-d2d7-40dd-923d-0d22bcc85756 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:34.441229 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523a882-d2d7-40dd-923d-0d22bcc85756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:34.441229 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523a882-d2d7-40dd-923d-0d22bcc85756 None admin] RBAC: Adding query filter params (role.id=7f17a5a0295f42e793e343cff968367c, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=d12fc26e640f4337b4a4da60cc4d9adc) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:34.441507 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523a882-d2d7-40dd-923d-0d22bcc85756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:34.442992 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523a882-d2d7-40dd-923d-0d22bcc85756 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:34.449339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 261/529] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:34 2022] GET /identity/v3/role_assignments?user.id=d12fc26e640f4337b4a4da60cc4d9adc&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=7f17a5a0295f42e793e343cff968367c => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:34.450145 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523a882-d2d7-40dd-923d-0d22bcc85756 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:34.493815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39f5ae-180e-4589-971b-cff73f68f50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:34.494897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39f5ae-180e-4589-971b-cff73f68f50f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:34.495390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39f5ae-180e-4589-971b-cff73f68f50f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:34.495873 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39f5ae-180e-4589-971b-cff73f68f50f None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:34.496871 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39f5ae-180e-4589-971b-cff73f68f50f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:34.497389 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39f5ae-180e-4589-971b-cff73f68f50f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:34.500082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39f5ae-180e-4589-971b-cff73f68f50f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:34.521482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 269/530] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:34.522380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39f5ae-180e-4589-971b-cff73f68f50f None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:34.588062 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523a882-d2d7-40dd-923d-0d22bcc85756 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:34.633006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ce80e-694b-4f90-bbb9-7f1cc13db759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:34.634195 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ce80e-694b-4f90-bbb9-7f1cc13db759 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:34.634523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ce80e-694b-4f90-bbb9-7f1cc13db759 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:34.634800 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ce80e-694b-4f90-bbb9-7f1cc13db759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:34.646887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ce80e-694b-4f90-bbb9-7f1cc13db759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:34.648661 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ce80e-694b-4f90-bbb9-7f1cc13db759 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:34.650580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39f5ae-180e-4589-971b-cff73f68f50f None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:34.665944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-b28ce80e-694b-4f90-bbb9-7f1cc13db759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:34.665944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:34.665944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:34.665944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:34.665944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:34.665944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:34.665944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:34.665944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:34.665944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:34.665944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:34.665944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:34.665944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:34.665944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:34.665944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:34.665944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:34.667069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:34.667069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:34.667069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:34.667069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:34.667069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:34.667069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:34.667069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:34.667069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:34.667069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:34.667069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:34.667069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:34.667069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:34.667069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:34.667069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:34.667069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:34.667069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:34.667069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:34.668095 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:34.668095 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:34.668095 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:34.668095 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:34.674068 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 262/531] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:34.675071 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ce80e-694b-4f90-bbb9-7f1cc13db759 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:34.677166 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:34.686926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:34.705439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c36ef-2804-49e2-885c-2ddae0a57e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:34.706436 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c36ef-2804-49e2-885c-2ddae0a57e0f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:34.707053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c36ef-2804-49e2-885c-2ddae0a57e0f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:34.707506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c36ef-2804-49e2-885c-2ddae0a57e0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:34.721758 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c36ef-2804-49e2-885c-2ddae0a57e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:34.724255 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c36ef-2804-49e2-885c-2ddae0a57e0f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:34.746359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-216c36ef-2804-49e2-885c-2ddae0a57e0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:34.746359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:34.746359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:34.746359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:34.746359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:34.746359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:34.746359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:34.746359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:34.746359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:34.746359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:34.746359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:34.746359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:34.746359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:34.746359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:34.746359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:34.747424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:34.747424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:34.747424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:34.747424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:34.747424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:34.747424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:34.747424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:34.747424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:34.747424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:34.747424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:34.747424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:34.747424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:34.747424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:34.747424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:34.747424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:34.747424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:34.747424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:34.748443 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:34.748443 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:34.748443 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:34.748443 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:34.751217 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 270/532] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:34.752204 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c36ef-2804-49e2-885c-2ddae0a57e0f None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:34.790654 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ce80e-694b-4f90-bbb9-7f1cc13db759 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:34.839205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586bd9a-6871-4b8f-9f61-fcadc54ca6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:34.839917 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586bd9a-6871-4b8f-9f61-fcadc54ca6cb None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:34.840319 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586bd9a-6871-4b8f-9f61-fcadc54ca6cb None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:34.840695 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586bd9a-6871-4b8f-9f61-fcadc54ca6cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:34.841611 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586bd9a-6871-4b8f-9f61-fcadc54ca6cb None admin] RBAC: Adding query filter params (role.id=7f17a5a0295f42e793e343cff968367c, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=aa31ecab10a6499f92da49bc7abb403a) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:34.842027 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586bd9a-6871-4b8f-9f61-fcadc54ca6cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:34.844142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586bd9a-6871-4b8f-9f61-fcadc54ca6cb None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:34.852522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 263/533] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:34 2022] GET /identity/v3/role_assignments?user.id=aa31ecab10a6499f92da49bc7abb403a&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=7f17a5a0295f42e793e343cff968367c => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:34.853508 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586bd9a-6871-4b8f-9f61-fcadc54ca6cb None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:34.880293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c36ef-2804-49e2-885c-2ddae0a57e0f None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:34.928526 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4276c-b7a5-4c4c-aa59-42935dd03d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:34.929288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4276c-b7a5-4c4c-aa59-42935dd03d26 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:34.929639 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4276c-b7a5-4c4c-aa59-42935dd03d26 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:34.929989 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4276c-b7a5-4c4c-aa59-42935dd03d26 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:34.930840 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4276c-b7a5-4c4c-aa59-42935dd03d26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:34.931221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4276c-b7a5-4c4c-aa59-42935dd03d26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:34.933469 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4276c-b7a5-4c4c-aa59-42935dd03d26 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:34.938097 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:34.949931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 271/534] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:34.959498 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4276c-b7a5-4c4c-aa59-42935dd03d26 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:34.980725 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586bd9a-6871-4b8f-9f61-fcadc54ca6cb None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:35.022451 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:35.026584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaaf13-beba-45d5-947a-3aa459a0428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:35.027232 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaaf13-beba-45d5-947a-3aa459a0428f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:35.027519 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaaf13-beba-45d5-947a-3aa459a0428f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:35.027798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaaf13-beba-45d5-947a-3aa459a0428f None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:35.028508 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaaf13-beba-45d5-947a-3aa459a0428f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:35.028822 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaaf13-beba-45d5-947a-3aa459a0428f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:35.034714 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaaf13-beba-45d5-947a-3aa459a0428f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:35.063124 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 264/535] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:35.069098 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaaf13-beba-45d5-947a-3aa459a0428f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:35.132585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4276c-b7a5-4c4c-aa59-42935dd03d26 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:35.188517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12273e18-631b-43dc-81ef-f5038c227521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:35.189181 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12273e18-631b-43dc-81ef-f5038c227521 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:35.189466 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12273e18-631b-43dc-81ef-f5038c227521 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:35.189744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12273e18-631b-43dc-81ef-f5038c227521 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:35.193212 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaaf13-beba-45d5-947a-3aa459a0428f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:35.201027 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12273e18-631b-43dc-81ef-f5038c227521 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:35.202552 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12273e18-631b-43dc-81ef-f5038c227521 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:35.225276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:35.232915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-12273e18-631b-43dc-81ef-f5038c227521 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:35.232915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:35.232915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:35.232915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:35.232915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:35.232915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:35.232915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:35.232915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:35.232915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:35.232915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:35.232915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:35.232915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:35.232915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:35.232915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:35.232915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:35.233828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:35.233828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:35.233828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:35.233828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:35.233828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:35.233828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:35.233828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:35.233828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:35.233828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:35.233828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:35.233828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:35.233828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:35.233828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:35.233828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:35.233828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:35.233828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:35.233828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:35.235208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:35.235208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:35.235208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:35.235208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:35.235208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:35.235208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:35.235208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:35.235208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:35.235208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 272/536] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:35.243349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12273e18-631b-43dc-81ef-f5038c227521 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:35.244289 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda1ac2-48fa-4ebc-981a-b163b348fc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:35.245053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda1ac2-48fa-4ebc-981a-b163b348fc25 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:35.245431 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda1ac2-48fa-4ebc-981a-b163b348fc25 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:35.245897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda1ac2-48fa-4ebc-981a-b163b348fc25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:35.253752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda1ac2-48fa-4ebc-981a-b163b348fc25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:35.255525 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda1ac2-48fa-4ebc-981a-b163b348fc25 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:35.270612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-1dda1ac2-48fa-4ebc-981a-b163b348fc25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:35.270612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:35.270612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:35.270612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:35.270612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:35.270612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:35.270612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:35.270612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:35.270612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:35.270612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:35.270612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:35.270612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:35.270612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:35.270612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:35.270612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:35.272617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:35.272617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:35.272617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:35.272617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:35.272617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:35.272617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:35.272617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:35.272617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:35.272617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:35.272617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:35.272617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:35.272617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:35.272617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:35.272617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:35.272617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:35.272617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:35.272617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:35.273651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:35.273651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:35.273651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:35.273651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:35.273651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:35.273651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:35.273651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:35.273651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:35.273651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 265/537] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:35.280549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda1ac2-48fa-4ebc-981a-b163b348fc25 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:35.421707 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda1ac2-48fa-4ebc-981a-b163b348fc25 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:35.444574 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:35.468265 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12273e18-631b-43dc-81ef-f5038c227521 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:35.474024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466063ff-afa3-4df9-a608-9a2a517f54bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:35.474683 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466063ff-afa3-4df9-a608-9a2a517f54bf None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:35.474965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466063ff-afa3-4df9-a608-9a2a517f54bf None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:35.475236 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466063ff-afa3-4df9-a608-9a2a517f54bf None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:35.475992 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466063ff-afa3-4df9-a608-9a2a517f54bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:35.476296 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466063ff-afa3-4df9-a608-9a2a517f54bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:35.477860 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466063ff-afa3-4df9-a608-9a2a517f54bf None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:35.490699 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 266/538] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:35.497470 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466063ff-afa3-4df9-a608-9a2a517f54bf None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:35.520480 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60735fca-3b1e-4f97-a4a2-4fd59cf12154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:35.521250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60735fca-3b1e-4f97-a4a2-4fd59cf12154 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:35.521629 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60735fca-3b1e-4f97-a4a2-4fd59cf12154 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:35.522119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60735fca-3b1e-4f97-a4a2-4fd59cf12154 None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:35.523106 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60735fca-3b1e-4f97-a4a2-4fd59cf12154 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:35.523607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60735fca-3b1e-4f97-a4a2-4fd59cf12154 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:35.525759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60735fca-3b1e-4f97-a4a2-4fd59cf12154 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:35.540405 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 273/539] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:35.546127 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60735fca-3b1e-4f97-a4a2-4fd59cf12154 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:35.578597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:35.676544 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466063ff-afa3-4df9-a608-9a2a517f54bf None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:35.732321 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a7da6-28ec-466d-af1d-7f3dce6b748a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:35.732998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a7da6-28ec-466d-af1d-7f3dce6b748a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:35.733280 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a7da6-28ec-466d-af1d-7f3dce6b748a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:35.733559 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a7da6-28ec-466d-af1d-7f3dce6b748a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:35.734350 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a7da6-28ec-466d-af1d-7f3dce6b748a None admin] RBAC: Adding query filter params (role.id=7f17a5a0295f42e793e343cff968367c, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=e71086ec00454e26b24337e0876bfe89) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:35.734683 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a7da6-28ec-466d-af1d-7f3dce6b748a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:35.736104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a7da6-28ec-466d-af1d-7f3dce6b748a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:35.748288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 267/540] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:35 2022] GET /identity/v3/role_assignments?user.id=e71086ec00454e26b24337e0876bfe89&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=7f17a5a0295f42e793e343cff968367c => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:35.763102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60735fca-3b1e-4f97-a4a2-4fd59cf12154 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:35.802531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc13e3-7ec4-43df-960b-0eff021236dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:35.803168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc13e3-7ec4-43df-960b-0eff021236dd None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:35.803450 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc13e3-7ec4-43df-960b-0eff021236dd None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:35.803789 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc13e3-7ec4-43df-960b-0eff021236dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:35.804588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc13e3-7ec4-43df-960b-0eff021236dd None admin] RBAC: Adding query filter params (role.id=7f17a5a0295f42e793e343cff968367c, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=6f495077bafd4fd18cc682fe0a6b7f8c) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:35.804950 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc13e3-7ec4-43df-960b-0eff021236dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:35.806508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc13e3-7ec4-43df-960b-0eff021236dd None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:35.813335 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 274/541] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:35 2022] GET /identity/v3/role_assignments?user.id=6f495077bafd4fd18cc682fe0a6b7f8c&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=7f17a5a0295f42e793e343cff968367c => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:36.087696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fef90-3e11-4a07-9405-4e917f3bc7d9 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:36.088229 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fef90-3e11-4a07-9405-4e917f3bc7d9 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:36.088229 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fef90-3e11-4a07-9405-4e917f3bc7d9 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:36.089902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 268/542] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:36.095192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bb105-8c0b-4cdd-8578-0617fd0e7091 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:36.095594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bb105-8c0b-4cdd-8578-0617fd0e7091 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:36.095829 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bb105-8c0b-4cdd-8578-0617fd0e7091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:36.131453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-242bb105-8c0b-4cdd-8578-0617fd0e7091 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:36.132657 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-242bb105-8c0b-4cdd-8578-0617fd0e7091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:36.143467 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:36.220023 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 275/543] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:36.257870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fef90-3e11-4a07-9405-4e917f3bc7d9 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:36.378520 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fef90-3e11-4a07-9405-4e917f3bc7d9 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:36.393554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:36.414345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f257c68-e0d8-462e-a9ea-46a065692a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:36.415066 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f257c68-e0d8-462e-a9ea-46a065692a70 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:36.415512 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f257c68-e0d8-462e-a9ea-46a065692a70 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:36.415788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f257c68-e0d8-462e-a9ea-46a065692a70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:36.427101 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f257c68-e0d8-462e-a9ea-46a065692a70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:36.432503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-7f257c68-e0d8-462e-a9ea-46a065692a70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:36.432503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:36.432503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:36.432503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:36.432503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:36.432503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:36.432503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:36.432503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:36.432503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:36.432503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:36.432503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:36.432503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:36.432503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:36.432503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:36.432503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:36.432503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:36.433365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:36.433365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:36.433365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:36.433365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:36.433365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:36.433365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:36.433365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:36.433365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:36.433365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:36.433365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:36.433365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:36.433365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:36.433365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:36.433365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:36.433365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:36.433365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:36.434634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:36.434634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:36.434634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:36.434634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:36.434634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:36.434634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:36.434634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:36.434634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:36.434634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:36.434634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:36.434634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:36.434634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:36.434634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 269/544] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:36.441335 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bb105-8c0b-4cdd-8578-0617fd0e7091 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:36.580191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bb105-8c0b-4cdd-8578-0617fd0e7091 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:36.621797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595e860-3866-4c6f-90a2-66f3454d7f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:36.622852 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595e860-3866-4c6f-90a2-66f3454d7f60 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:36.623335 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595e860-3866-4c6f-90a2-66f3454d7f60 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:36.624072 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595e860-3866-4c6f-90a2-66f3454d7f60 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:36.624983 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595e860-3866-4c6f-90a2-66f3454d7f60 None admin] RBAC: Adding query filter params (name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:36.625490 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595e860-3866-4c6f-90a2-66f3454d7f60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:36.627091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595e860-3866-4c6f-90a2-66f3454d7f60 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:36.640677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 276/545] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:40:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:36.642361 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f257c68-e0d8-462e-a9ea-46a065692a70 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:36.777401 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f257c68-e0d8-462e-a9ea-46a065692a70 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:36.811943 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604e5d1-b7c7-4f6f-9949-d90d98774dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:36.812597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604e5d1-b7c7-4f6f-9949-d90d98774dd9 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:36.812882 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604e5d1-b7c7-4f6f-9949-d90d98774dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:36.813162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604e5d1-b7c7-4f6f-9949-d90d98774dd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:36.823926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604e5d1-b7c7-4f6f-9949-d90d98774dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:36.825402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604e5d1-b7c7-4f6f-9949-d90d98774dd9 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:36.840019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-6604e5d1-b7c7-4f6f-9949-d90d98774dd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:36.840019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:36.840019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:36.840019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:36.840019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:36.840019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:36.840019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:36.840019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:36.840019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:36.840019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:36.840019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:36.840019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:36.840019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:36.840019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:36.840019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:36.840863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:36.840863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:36.840863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:36.840863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:36.840863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:36.840863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:36.840863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:36.840863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:36.840863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:36.840863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:36.840863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:36.840863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:36.840863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:36.840863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:36.840863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:36.840863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:36.840863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:36.842169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:36.842169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:36.842169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:36.842169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:36.842169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 270/546] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:36.848230 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595e860-3866-4c6f-90a2-66f3454d7f60 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:36.870797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:36.875335 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2ef21-4818-4b49-a79e-7859a65df52c None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:36.875617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2ef21-4818-4b49-a79e-7859a65df52c None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:36.875897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2ef21-4818-4b49-a79e-7859a65df52c None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:36.877413 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 271/547] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:36.882346 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5d400-4611-409f-bcd0-c612d76e1e76 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:36.882665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5d400-4611-409f-bcd0-c612d76e1e76 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:36.890596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5d400-4611-409f-bcd0-c612d76e1e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:36.902463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-22d5d400-4611-409f-bcd0-c612d76e1e76 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:36.903634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-22d5d400-4611-409f-bcd0-c612d76e1e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:36.950119 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:37.024435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595e860-3866-4c6f-90a2-66f3454d7f60 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:37.044965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 272/548] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:40:37.067613 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5d400-4611-409f-bcd0-c612d76e1e76 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:37.081762 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71bd7a-9557-4e94-9487-819f143f89dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:37.082699 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71bd7a-9557-4e94-9487-819f143f89dc None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:37.083186 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71bd7a-9557-4e94-9487-819f143f89dc None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:37.083638 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71bd7a-9557-4e94-9487-819f143f89dc None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:37.084507 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71bd7a-9557-4e94-9487-819f143f89dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:37.084985 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71bd7a-9557-4e94-9487-819f143f89dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:37.086567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71bd7a-9557-4e94-9487-819f143f89dc None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:37.103837 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 277/549] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:37.105874 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71bd7a-9557-4e94-9487-819f143f89dc None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:37.193793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5d400-4611-409f-bcd0-c612d76e1e76 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:37.229196 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:37.251815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb8914-1cba-4ac1-8877-6f34508e347e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:37.252470 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb8914-1cba-4ac1-8877-6f34508e347e None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:37.252754 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb8914-1cba-4ac1-8877-6f34508e347e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:37.253023 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb8914-1cba-4ac1-8877-6f34508e347e None admin] PATH_INFO: `/v3/roles/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:37.273685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb8914-1cba-4ac1-8877-6f34508e347e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:37.278629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-b9cb8914-1cba-4ac1-8877-6f34508e347e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:37.278629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:37.278629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:37.278629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:37.278629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:37.278629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:37.278629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:37.278629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:37.278629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:37.278629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:37.278629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:37.278629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:37.278629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:37.278629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:37.278629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:37.278629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:37.279510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:37.279510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:37.279510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:37.279510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:37.279510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:37.279510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:37.279510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:37.279510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:37.279510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:37.279510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:37.279510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:37.279510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:37.279510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:37.279510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:37.279510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:37.279510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:37.280678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:37.280678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:37.280678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:37.280678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:37.280678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:37.280678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:37.280678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:37.280678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:37.280678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:37.280678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:37.280678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:37.280678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:37.280678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 273/550] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:40:37.287393 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb8914-1cba-4ac1-8877-6f34508e347e None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:37.292980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71bd7a-9557-4e94-9487-819f143f89dc None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:37.322258 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:37.358921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b401a-759a-4a1d-8e08-e90d02e4a48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:37.359577 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b401a-759a-4a1d-8e08-e90d02e4a48d None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:37.359863 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b401a-759a-4a1d-8e08-e90d02e4a48d None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:37.360142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b401a-759a-4a1d-8e08-e90d02e4a48d None admin] PATH_INFO: `/v3/users/swift` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:37.370919 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b401a-759a-4a1d-8e08-e90d02e4a48d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:37.379296 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b401a-759a-4a1d-8e08-e90d02e4a48d None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:37.392167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-430b401a-759a-4a1d-8e08-e90d02e4a48d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:40:37.392167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:37.392167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:37.392167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:37.392167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:37.392167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:37.392167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:37.392167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:37.392167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:37.392167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:37.392167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:37.392167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:37.392167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:37.392167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:37.392167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:37.392167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:37.393534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:37.393534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:37.393534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:37.393534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:37.393534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:37.393534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:37.393534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:37.393534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:37.393534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:37.393534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:37.393534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:37.393534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:37.393534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:37.393534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:37.393534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:37.393534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:37.393534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:37.393534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:37.394647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:37.394647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:37.394647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:37.394647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:37.394647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:37.394647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:37.394647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:37.394647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:37.394647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:40:37.394647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:37.394647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 278/551] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:40:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:37.395253 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb8309-830a-44d1-8ebc-b6628c59c27e None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:37.395253 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb8309-830a-44d1-8ebc-b6628c59c27e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:37.396149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb8309-830a-44d1-8ebc-b6628c59c27e None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:37.397862 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 279/552] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:37.401430 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb8309-830a-44d1-8ebc-b6628c59c27e None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:37.435850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb8914-1cba-4ac1-8877-6f34508e347e None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:37.491388 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f3fc1-9e91-4dbf-91ca-9546478b1a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:37.492694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f3fc1-9e91-4dbf-91ca-9546478b1a38 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:37.493557 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f3fc1-9e91-4dbf-91ca-9546478b1a38 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:37.493838 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f3fc1-9e91-4dbf-91ca-9546478b1a38 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:37.495041 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f3fc1-9e91-4dbf-91ca-9546478b1a38 None admin] RBAC: Adding query filter params (name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:37.495354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f3fc1-9e91-4dbf-91ca-9546478b1a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:37.497045 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f3fc1-9e91-4dbf-91ca-9546478b1a38 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:37.512063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 274/553] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:40:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:37.513901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f80ba-59cf-475a-8f50-55ec0d94ed7c None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:37.514052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f80ba-59cf-475a-8f50-55ec0d94ed7c None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:37.514293 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f80ba-59cf-475a-8f50-55ec0d94ed7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:37.524687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb8309-830a-44d1-8ebc-b6628c59c27e None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:37.537493 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-d14f80ba-59cf-475a-8f50-55ec0d94ed7c None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:37.538731 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d14f80ba-59cf-475a-8f50-55ec0d94ed7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:37.559502 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:37.572140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d0da3-b51d-4e84-b1c4-caebf8f908aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:37.573309 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d0da3-b51d-4e84-b1c4-caebf8f908aa None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:37.573743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d0da3-b51d-4e84-b1c4-caebf8f908aa None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:37.574251 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d0da3-b51d-4e84-b1c4-caebf8f908aa None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:37.575378 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d0da3-b51d-4e84-b1c4-caebf8f908aa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:37.575838 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d0da3-b51d-4e84-b1c4-caebf8f908aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:37.577655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d0da3-b51d-4e84-b1c4-caebf8f908aa None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:37.605693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 280/554] 10.222.0.86 () {56 vars in 1135 bytes} [Tue Jul 26 14:40:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:37.605693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d0da3-b51d-4e84-b1c4-caebf8f908aa None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:37.627412 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 275/555] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:37.628487 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f80ba-59cf-475a-8f50-55ec0d94ed7c None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:37.642444 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:37.732889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d0da3-b51d-4e84-b1c4-caebf8f908aa None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:37.770609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a562f-f4ed-4081-b37c-b3b99b4ef127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:37.771474 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a562f-f4ed-4081-b37c-b3b99b4ef127 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:37.771863 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a562f-f4ed-4081-b37c-b3b99b4ef127 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:37.772246 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a562f-f4ed-4081-b37c-b3b99b4ef127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:37.773710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f80ba-59cf-475a-8f50-55ec0d94ed7c None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:37.784043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a562f-f4ed-4081-b37c-b3b99b4ef127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:37.785938 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a562f-f4ed-4081-b37c-b3b99b4ef127 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:37.803534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-483a562f-f4ed-4081-b37c-b3b99b4ef127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:37.803534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:37.803534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:37.803534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:37.803534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:37.803534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:37.803534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:37.803534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:37.803534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:37.803534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:37.803534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:37.803534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:37.803534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:37.803534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:37.803534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:37.804625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:37.804625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:37.804625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:37.804625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:37.804625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:37.804625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:37.804625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:37.804625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:37.804625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:37.804625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:37.804625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:37.804625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:37.804625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:37.804625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:37.804625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:37.804625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:37.804625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:37.805789 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:37.805789 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:37.805789 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:37.805789 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:37.812005 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 281/556] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:37.813027 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a562f-f4ed-4081-b37c-b3b99b4ef127 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:37.816450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95aca85-dd00-44e1-ae24-6992ae405239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:37.818125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95aca85-dd00-44e1-ae24-6992ae405239 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:37.818637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95aca85-dd00-44e1-ae24-6992ae405239 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:37.819061 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95aca85-dd00-44e1-ae24-6992ae405239 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:37.851465 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:37.909304 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95aca85-dd00-44e1-ae24-6992ae405239 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:37.910812 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95aca85-dd00-44e1-ae24-6992ae405239 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:37.922897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:37.931943 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a562f-f4ed-4081-b37c-b3b99b4ef127 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:37.983137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c4ff2-36b7-4e9d-89a9-bcf25e648965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:37.983800 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c4ff2-36b7-4e9d-89a9-bcf25e648965 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:37.984082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c4ff2-36b7-4e9d-89a9-bcf25e648965 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:37.984370 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c4ff2-36b7-4e9d-89a9-bcf25e648965 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:38.004423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c4ff2-36b7-4e9d-89a9-bcf25e648965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:38.013250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-885c4ff2-36b7-4e9d-89a9-bcf25e648965 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:38.013250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:38.013250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:38.013250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:38.013250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:38.013250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:38.013250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:38.013250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:38.013250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:38.013250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:38.013250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:38.013250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:38.013250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:38.013250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:38.013250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:38.013250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:38.014653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:38.014653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:38.014653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:38.014653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:38.014653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:38.014653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:38.014653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:38.014653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:38.014653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:38.014653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:38.014653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:38.014653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:38.014653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:38.014653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:38.014653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:38.014653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:38.015445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:38.015445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:38.015445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:38.015445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:38.015445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:38.015445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:38.015445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:38.015445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:38.015445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:38.015445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:38.015445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:38.015445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:38.018026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 282/557] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:38.019076 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c4ff2-36b7-4e9d-89a9-bcf25e648965 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:38.030499 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 276/558] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:38.030499 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95aca85-dd00-44e1-ae24-6992ae405239 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:38.132825 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:38.139079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95aca85-dd00-44e1-ae24-6992ae405239 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:38.139387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c4ff2-36b7-4e9d-89a9-bcf25e648965 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:38.149112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:38.174960 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031ae62-a27a-47cd-acd3-95c49bbc0fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:38.175586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ae62-a27a-47cd-acd3-95c49bbc0fc8 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:38.175869 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ae62-a27a-47cd-acd3-95c49bbc0fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:38.176157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ae62-a27a-47cd-acd3-95c49bbc0fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:38.176879 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031ae62-a27a-47cd-acd3-95c49bbc0fc8 None admin] RBAC: Adding query filter params (name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:38.177190 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031ae62-a27a-47cd-acd3-95c49bbc0fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:38.177897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5c1be-8409-4641-a0a3-889038de236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:38.178584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031ae62-a27a-47cd-acd3-95c49bbc0fc8 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:38.181633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5c1be-8409-4641-a0a3-889038de236d None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:38.181633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5c1be-8409-4641-a0a3-889038de236d None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:38.181633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5c1be-8409-4641-a0a3-889038de236d None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:38.181633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5c1be-8409-4641-a0a3-889038de236d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:38.182088 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5c1be-8409-4641-a0a3-889038de236d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:38.183628 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5c1be-8409-4641-a0a3-889038de236d None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:38.187208 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 277/559] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:40:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:38.188011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031ae62-a27a-47cd-acd3-95c49bbc0fc8 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:38.198509 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 283/560] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:38.199997 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9f4ce-17ce-47b1-96f2-ed561d86ca07 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:38.200535 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9f4ce-17ce-47b1-96f2-ed561d86ca07 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:38.201269 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9f4ce-17ce-47b1-96f2-ed561d86ca07 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:38.205241 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 284/561] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:38.206087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9f4ce-17ce-47b1-96f2-ed561d86ca07 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:38.309882 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031ae62-a27a-47cd-acd3-95c49bbc0fc8 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:38.322895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9f4ce-17ce-47b1-96f2-ed561d86ca07 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:38.353532 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640074df-0b92-4a05-9f96-f4746ff01d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:38.354789 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640074df-0b92-4a05-9f96-f4746ff01d79 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:38.355176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640074df-0b92-4a05-9f96-f4746ff01d79 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:38.355608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640074df-0b92-4a05-9f96-f4746ff01d79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:38.359957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded55fe8-e44a-4a9b-a2ee-1850264ce696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:38.360598 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded55fe8-e44a-4a9b-a2ee-1850264ce696 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:38.360882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded55fe8-e44a-4a9b-a2ee-1850264ce696 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:38.361158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded55fe8-e44a-4a9b-a2ee-1850264ce696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:38.371426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640074df-0b92-4a05-9f96-f4746ff01d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:38.372769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded55fe8-e44a-4a9b-a2ee-1850264ce696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:38.372883 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640074df-0b92-4a05-9f96-f4746ff01d79 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:38.374595 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded55fe8-e44a-4a9b-a2ee-1850264ce696 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:38.388019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-640074df-0b92-4a05-9f96-f4746ff01d79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:38.388019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:38.388019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:38.388019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:38.388019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:38.388019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:38.388019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:38.388019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:38.388019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:38.388019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:38.388019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:38.388019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:38.388019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:38.388019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:38.388019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:38.388932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:38.388932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:38.388932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:38.388932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:38.388932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:38.388932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:38.388932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:38.388932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:38.388932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:38.388932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:38.388932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:38.388932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:38.388932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:38.388932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:38.388932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:38.388932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:38.388932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:38.389764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:38.389764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:38.389764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:38.389764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:38.392858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-ded55fe8-e44a-4a9b-a2ee-1850264ce696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:38.392858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:38.392858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:38.392858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:38.392858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:38.392858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:38.392858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:38.392858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:38.392858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:38.392858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:38.392858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:38.392858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:38.392858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:38.392858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:38.392858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:38.393719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:38.393719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:38.393719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:38.393719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:38.393719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:38.393719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:38.393719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:38.393719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:38.393719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:38.393719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:38.393719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:38.393719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:38.393719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:38.393719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:38.393719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:38.393719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:38.393719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:38.399951 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:38.399951 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:38.399951 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:38.399951 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:38.400455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 278/562] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:38.400610 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 285/563] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:38.400752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640074df-0b92-4a05-9f96-f4746ff01d79 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:38.400892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ca04f-463a-4041-9214-cba402df4621 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:38.400892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ca04f-463a-4041-9214-cba402df4621 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:38.400892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ca04f-463a-4041-9214-cba402df4621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:38.416008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-410ca04f-463a-4041-9214-cba402df4621 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:38.417198 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-410ca04f-463a-4041-9214-cba402df4621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:38.419300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:38.423773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:38.483771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 286/564] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:38.484612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ca04f-463a-4041-9214-cba402df4621 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:38.497642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640074df-0b92-4a05-9f96-f4746ff01d79 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:38.533615 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b85aa-a01f-4850-8c8f-e5de6f0037c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:38.534252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b85aa-a01f-4850-8c8f-e5de6f0037c6 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:38.534569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b85aa-a01f-4850-8c8f-e5de6f0037c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:38.534843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b85aa-a01f-4850-8c8f-e5de6f0037c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:38.542589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b85aa-a01f-4850-8c8f-e5de6f0037c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:38.544027 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b85aa-a01f-4850-8c8f-e5de6f0037c6 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:38.555582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-dd4b85aa-a01f-4850-8c8f-e5de6f0037c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:40:38.555582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:38.555582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:38.555582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:38.555582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:38.555582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:38.555582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:38.555582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:38.555582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:38.555582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:38.555582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:38.555582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:38.555582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:38.555582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:38.555582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:38.555582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:38.556761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:38.556761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:38.556761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:38.556761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:38.556761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:38.556761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:38.556761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:38.556761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:38.556761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:38.556761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:38.556761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:38.556761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:38.556761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:38.556761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:38.556761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:38.556761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:38.556761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:38.556761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:38.557887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:38.557887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:38.557887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:38.557887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:38.557887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:38.557887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:38.557887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:38.557887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:38.557887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:40:38.557887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:38.557887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 279/565] 10.222.0.86 () {56 vars in 1093 bytes} [Tue Jul 26 14:40:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:38.557887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b85aa-a01f-4850-8c8f-e5de6f0037c6 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:38.596471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ca04f-463a-4041-9214-cba402df4621 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:38.634613 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfae7b-2d5f-4ab9-a2aa-23b9713c1d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:38.635271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfae7b-2d5f-4ab9-a2aa-23b9713c1d41 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:38.635558 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfae7b-2d5f-4ab9-a2aa-23b9713c1d41 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:38.635836 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfae7b-2d5f-4ab9-a2aa-23b9713c1d41 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:38.636535 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfae7b-2d5f-4ab9-a2aa-23b9713c1d41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:38.636845 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfae7b-2d5f-4ab9-a2aa-23b9713c1d41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:38.638234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfae7b-2d5f-4ab9-a2aa-23b9713c1d41 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:38.643911 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:38.644843 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:38.650673 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 287/566] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:38.651871 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da8f7e-f401-4ee1-9172-e58da2fed78e None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:38.652157 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da8f7e-f401-4ee1-9172-e58da2fed78e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:38.652435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da8f7e-f401-4ee1-9172-e58da2fed78e None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:38.653788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 288/567] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:38.654331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da8f7e-f401-4ee1-9172-e58da2fed78e None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:38.665198 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b85aa-a01f-4850-8c8f-e5de6f0037c6 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:38.700395 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b34d58-25e6-4e80-b7f4-8f9a0e7b62db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:38.701066 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b34d58-25e6-4e80-b7f4-8f9a0e7b62db None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:38.701346 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b34d58-25e6-4e80-b7f4-8f9a0e7b62db None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:38.701622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b34d58-25e6-4e80-b7f4-8f9a0e7b62db None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:38.702333 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b34d58-25e6-4e80-b7f4-8f9a0e7b62db None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:38.702679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b34d58-25e6-4e80-b7f4-8f9a0e7b62db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:38.704073 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b34d58-25e6-4e80-b7f4-8f9a0e7b62db None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:38.718787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 280/568] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:38.720273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b34d58-25e6-4e80-b7f4-8f9a0e7b62db None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:38.771366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da8f7e-f401-4ee1-9172-e58da2fed78e None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:38.806503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa15265-c3f9-4519-8040-501d80c8890d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:38.807143 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa15265-c3f9-4519-8040-501d80c8890d None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:38.807421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa15265-c3f9-4519-8040-501d80c8890d None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:38.807696 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa15265-c3f9-4519-8040-501d80c8890d None admin] PATH_INFO: `/v3/roles/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:38.817633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa15265-c3f9-4519-8040-501d80c8890d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:38.822875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-2fa15265-c3f9-4519-8040-501d80c8890d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:38.822875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:38.822875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:38.822875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:38.822875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:38.822875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:38.822875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:38.822875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:38.822875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:38.822875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:38.822875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:38.822875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:38.822875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:38.822875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:38.822875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:38.822875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:38.823833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:38.823833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:38.823833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:38.823833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:38.823833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:38.823833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:38.823833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:38.823833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:38.823833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:38.823833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:38.823833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:38.823833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:38.823833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:38.823833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:38.823833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:38.823833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:38.824791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:38.824791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:38.824791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:38.824791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:38.824791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:38.824791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:38.824791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:38.824791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:38.824791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:38.824791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:38.824791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:38.824791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:38.824791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 289/569] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:38.824791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa15265-c3f9-4519-8040-501d80c8890d None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:38.835142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b34d58-25e6-4e80-b7f4-8f9a0e7b62db None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:38.869676 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9650c8-7fab-4bf0-9047-541ec3f60e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:38.870205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9650c8-7fab-4bf0-9047-541ec3f60e62 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:38.870522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9650c8-7fab-4bf0-9047-541ec3f60e62 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:38.870810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9650c8-7fab-4bf0-9047-541ec3f60e62 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:38.871597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9650c8-7fab-4bf0-9047-541ec3f60e62 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:38.871909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9650c8-7fab-4bf0-9047-541ec3f60e62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:38.873336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9650c8-7fab-4bf0-9047-541ec3f60e62 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:38.887143 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:38.887613 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:38.891532 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 281/570] 10.222.0.86 () {56 vars in 1133 bytes} [Tue Jul 26 14:40:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:38.892773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771898bd-8f00-4767-8ba9-07361e0c3d0a None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:38.893061 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771898bd-8f00-4767-8ba9-07361e0c3d0a None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:38.893337 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771898bd-8f00-4767-8ba9-07361e0c3d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:38.911382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-771898bd-8f00-4767-8ba9-07361e0c3d0a None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:38.912587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-771898bd-8f00-4767-8ba9-07361e0c3d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:38.927772 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa15265-c3f9-4519-8040-501d80c8890d None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:38.961315 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2199d7-e2b1-42f8-97f4-71e9a021d23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:38.962624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2199d7-e2b1-42f8-97f4-71e9a021d23c None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:38.962911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2199d7-e2b1-42f8-97f4-71e9a021d23c None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:38.963190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2199d7-e2b1-42f8-97f4-71e9a021d23c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:38.969728 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2199d7-e2b1-42f8-97f4-71e9a021d23c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:38.971198 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2199d7-e2b1-42f8-97f4-71e9a021d23c None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:38.977035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 282/571] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:38.977867 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771898bd-8f00-4767-8ba9-07361e0c3d0a None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:38.993305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-2a2199d7-e2b1-42f8-97f4-71e9a021d23c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:38.993305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:38.993305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:38.993305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:38.993305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:38.993305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:38.993305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:38.993305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:38.993305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:38.993305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:38.993305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:38.993305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:38.993305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:38.993305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:38.993305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:38.994187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:38.994187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:38.994187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:38.994187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:38.994187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:38.994187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:38.994187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:38.994187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:38.994187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:38.994187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:38.994187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:38.994187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:38.994187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:38.994187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:38.994187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:38.994187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:38.994187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:38.995121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:38.995121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:38.995121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:38.995121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:38.995121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:38.995121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:38.995121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:38.995121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:38.995121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 290/572] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:38.995585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2199d7-e2b1-42f8-97f4-71e9a021d23c None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:39.101589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771898bd-8f00-4767-8ba9-07361e0c3d0a None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:39.117423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2199d7-e2b1-42f8-97f4-71e9a021d23c None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:39.136103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:39.137025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:39.143657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ae513-097d-41d2-a592-6cd3de7c3842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:39.144311 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ae513-097d-41d2-a592-6cd3de7c3842 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:39.144597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ae513-097d-41d2-a592-6cd3de7c3842 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:39.148772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ae513-097d-41d2-a592-6cd3de7c3842 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:39.152750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ae513-097d-41d2-a592-6cd3de7c3842 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:39.154194 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ae513-097d-41d2-a592-6cd3de7c3842 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:39.156412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada7959-9e1f-4fa5-8f44-a2429d82f739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:39.157075 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada7959-9e1f-4fa5-8f44-a2429d82f739 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:39.157355 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada7959-9e1f-4fa5-8f44-a2429d82f739 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:39.157634 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada7959-9e1f-4fa5-8f44-a2429d82f739 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:39.159593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada7959-9e1f-4fa5-8f44-a2429d82f739 None admin] RBAC: Adding query filter params (name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:39.159906 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada7959-9e1f-4fa5-8f44-a2429d82f739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:39.161277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada7959-9e1f-4fa5-8f44-a2429d82f739 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:39.166474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-200ae513-097d-41d2-a592-6cd3de7c3842 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 14:40:39.166474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:39.166474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:39.166474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:39.166474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:39.166474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:39.166474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:39.166474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:39.166474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:39.166474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:39.166474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:39.166474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:39.166474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:39.166474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:39.166474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:39.166474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:39.167587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:39.167587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:39.167587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:39.167587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:39.167587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:39.167587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:39.167587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:39.167587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:39.167587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:39.167587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:39.167587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:39.167587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:39.167587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:39.167587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:39.167587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:39.167587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:39.167587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:39.167587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:39.168768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:39.168768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:39.168768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:39.168768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:39.168768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:39.168768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:39.168768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:39.168768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:39.168768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 14:40:39.168768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:39.168768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 283/573] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:39.169526 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ae513-097d-41d2-a592-6cd3de7c3842 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:39.172585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 291/574] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:40:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:39.176324 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada7959-9e1f-4fa5-8f44-a2429d82f739 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:39.272757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ae513-097d-41d2-a592-6cd3de7c3842 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:39.273147 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada7959-9e1f-4fa5-8f44-a2429d82f739 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:39.304626 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b37b0-8de5-4512-bda4-8d158eb7c9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:39.305780 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b37b0-8de5-4512-bda4-8d158eb7c9f3 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:39.306062 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b37b0-8de5-4512-bda4-8d158eb7c9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:39.306336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b37b0-8de5-4512-bda4-8d158eb7c9f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:39.307332 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018a0a7-c4bf-4402-8d80-227466f46430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:39.307970 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018a0a7-c4bf-4402-8d80-227466f46430 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:39.308256 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018a0a7-c4bf-4402-8d80-227466f46430 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:39.308537 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018a0a7-c4bf-4402-8d80-227466f46430 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:39.317502 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b37b0-8de5-4512-bda4-8d158eb7c9f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:39.318555 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018a0a7-c4bf-4402-8d80-227466f46430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:39.319079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b37b0-8de5-4512-bda4-8d158eb7c9f3 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:39.324423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-9018a0a7-c4bf-4402-8d80-227466f46430 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:39.324423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:39.324423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:39.324423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:39.324423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:39.324423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:39.324423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:39.324423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:39.324423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:39.324423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:39.324423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:39.324423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:39.324423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:39.324423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:39.324423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:39.324423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:39.325322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:39.325322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:39.325322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:39.325322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:39.325322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:39.325322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:39.325322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:39.325322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:39.325322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:39.325322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:39.325322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:39.325322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:39.325322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:39.325322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:39.325322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:39.325322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:39.326140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:39.326140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:39.326140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:39.326140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:39.326140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:39.326140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:39.326140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:39.326140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:39.326140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:39.326140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:39.326140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:39.326140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:39.326140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 292/575] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:39.327004 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018a0a7-c4bf-4402-8d80-227466f46430 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:39.339407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-d84b37b0-8de5-4512-bda4-8d158eb7c9f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:39.339407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:39.339407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:39.339407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:39.339407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:39.339407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:39.339407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:39.339407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:39.339407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:39.339407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:39.339407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:39.339407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:39.339407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:39.339407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:39.339407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:39.340282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:39.340282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:39.340282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:39.340282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:39.340282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:39.340282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:39.340282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:39.340282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:39.340282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:39.340282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:39.340282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:39.340282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:39.340282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:39.340282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:39.340282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:39.340282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:39.340282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:39.341116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:39.341116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:39.341116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:39.341116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:39.341116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 284/576] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:39.341397 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b37b0-8de5-4512-bda4-8d158eb7c9f3 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:39.369055 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:39.387139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:39.427100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018a0a7-c4bf-4402-8d80-227466f46430 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:39.443297 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b37b0-8de5-4512-bda4-8d158eb7c9f3 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:39.461812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab1307-d324-4939-8ae8-386c49a5ce85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:39.462479 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab1307-d324-4939-8ae8-386c49a5ce85 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:39.462766 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab1307-d324-4939-8ae8-386c49a5ce85 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:39.463040 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab1307-d324-4939-8ae8-386c49a5ce85 None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:39.463792 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab1307-d324-4939-8ae8-386c49a5ce85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:39.464097 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab1307-d324-4939-8ae8-386c49a5ce85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:39.465531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab1307-d324-4939-8ae8-386c49a5ce85 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:39.478474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d0f8f-4b3d-418b-95f8-542548385887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:39.478931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 293/577] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:39.479099 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d0f8f-4b3d-418b-95f8-542548385887 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:39.479385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d0f8f-4b3d-418b-95f8-542548385887 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:39.479663 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d0f8f-4b3d-418b-95f8-542548385887 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:39.479941 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab1307-d324-4939-8ae8-386c49a5ce85 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:39.480554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d0f8f-4b3d-418b-95f8-542548385887 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:39.480871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d0f8f-4b3d-418b-95f8-542548385887 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:39.482360 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d0f8f-4b3d-418b-95f8-542548385887 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:39.505166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 285/578] 10.222.0.86 () {56 vars in 1137 bytes} [Tue Jul 26 14:40:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:39.506003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d0f8f-4b3d-418b-95f8-542548385887 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:39.581402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:39.584192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab1307-d324-4939-8ae8-386c49a5ce85 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:39.605718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:39.608594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d0f8f-4b3d-418b-95f8-542548385887 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:39.618759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1affd-e285-4e3b-9cc9-ac518f9b180e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:39.619405 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1affd-e285-4e3b-9cc9-ac518f9b180e None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:39.619698 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1affd-e285-4e3b-9cc9-ac518f9b180e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:39.619972 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1affd-e285-4e3b-9cc9-ac518f9b180e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:39.630608 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1affd-e285-4e3b-9cc9-ac518f9b180e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:39.632067 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1affd-e285-4e3b-9cc9-ac518f9b180e None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:39.641873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256b997-d10b-4787-ba09-a28a0e81245f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:39.642440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256b997-d10b-4787-ba09-a28a0e81245f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:39.642725 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256b997-d10b-4787-ba09-a28a0e81245f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:39.642999 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256b997-d10b-4787-ba09-a28a0e81245f None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:39.643702 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256b997-d10b-4787-ba09-a28a0e81245f None admin] RBAC: Adding query filter params (name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:39.644019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256b997-d10b-4787-ba09-a28a0e81245f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:39.645731 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256b997-d10b-4787-ba09-a28a0e81245f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:39.646757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-66c1affd-e285-4e3b-9cc9-ac518f9b180e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:39.646757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:39.646757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:39.646757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:39.646757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:39.646757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:39.646757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:39.646757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:39.646757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:39.646757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:39.646757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:39.646757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:39.646757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:39.646757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:39.646757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:39.647579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:39.647579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:39.647579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:39.647579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:39.647579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:39.647579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:39.647579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:39.647579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:39.647579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:39.647579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:39.647579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:39.647579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:39.647579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:39.647579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:39.647579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:39.647579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:39.647579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:39.648466 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:39.648466 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:39.648466 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:39.648466 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:39.648466 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 294/579] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:39.648740 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1affd-e285-4e3b-9cc9-ac518f9b180e None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:39.657681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 286/580] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:40:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:39.658614 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256b997-d10b-4787-ba09-a28a0e81245f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:39.758676 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256b997-d10b-4787-ba09-a28a0e81245f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:39.759308 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1affd-e285-4e3b-9cc9-ac518f9b180e None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:39.792486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c3aa9-e98e-465a-8317-6c36c08e1448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:39.792668 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fb61c-1a05-4f9b-a834-88084eef2636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:39.793100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c3aa9-e98e-465a-8317-6c36c08e1448 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:39.793249 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fb61c-1a05-4f9b-a834-88084eef2636 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:39.793384 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c3aa9-e98e-465a-8317-6c36c08e1448 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:39.793535 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fb61c-1a05-4f9b-a834-88084eef2636 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:39.793661 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c3aa9-e98e-465a-8317-6c36c08e1448 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:39.793808 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fb61c-1a05-4f9b-a834-88084eef2636 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:39.794479 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c3aa9-e98e-465a-8317-6c36c08e1448 None admin] RBAC: Adding query filter params (role.id=7f17a5a0295f42e793e343cff968367c, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=462ecbb85c6b4a17a952fb74fa2de65e) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:39.794588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fb61c-1a05-4f9b-a834-88084eef2636 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:39.794794 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c3aa9-e98e-465a-8317-6c36c08e1448 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:39.794881 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fb61c-1a05-4f9b-a834-88084eef2636 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:39.796162 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fb61c-1a05-4f9b-a834-88084eef2636 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:39.796250 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c3aa9-e98e-465a-8317-6c36c08e1448 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:39.801478 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 287/581] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:39 2022] GET /identity/v3/role_assignments?user.id=462ecbb85c6b4a17a952fb74fa2de65e&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=7f17a5a0295f42e793e343cff968367c => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:39.802256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c3aa9-e98e-465a-8317-6c36c08e1448 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:39.816868 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 295/582] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:39.816868 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fb61c-1a05-4f9b-a834-88084eef2636 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:39.837346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:39.844158 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:39.932603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c3aa9-e98e-465a-8317-6c36c08e1448 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:39.950954 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fb61c-1a05-4f9b-a834-88084eef2636 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:39.973231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a79754-3834-4d45-bc57-4b30237e1595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:39.973870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a79754-3834-4d45-bc57-4b30237e1595 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:39.974151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a79754-3834-4d45-bc57-4b30237e1595 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:39.974614 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a79754-3834-4d45-bc57-4b30237e1595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:39.985856 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a79754-3834-4d45-bc57-4b30237e1595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:39.987352 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a79754-3834-4d45-bc57-4b30237e1595 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:39.994991 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fe09c-47f5-40c6-a3b0-77d48619a87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:39.995624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fe09c-47f5-40c6-a3b0-77d48619a87b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:39.995914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fe09c-47f5-40c6-a3b0-77d48619a87b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:39.996192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fe09c-47f5-40c6-a3b0-77d48619a87b None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:39.996917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fe09c-47f5-40c6-a3b0-77d48619a87b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:39.997227 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fe09c-47f5-40c6-a3b0-77d48619a87b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:39.998700 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fe09c-47f5-40c6-a3b0-77d48619a87b None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:40.003273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-b5a79754-3834-4d45-bc57-4b30237e1595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:40.003273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:40.003273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:40.003273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:40.003273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:40.003273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:40.003273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:40.003273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:40.003273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:40.003273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:40.003273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:40.003273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:40.003273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:40.003273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:40.003273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:40.004096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:40.004096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:40.004096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:40.004096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:40.004096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:40.004096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:40.004096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:40.004096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:40.004096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:40.004096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:40.004096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:40.004096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:40.004096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:40.004096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:40.004096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:40.004096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:40.004096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:40.004951 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:40.004951 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:40.004951 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:40.004951 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:40.009136 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 288/583] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:40.010118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a79754-3834-4d45-bc57-4b30237e1595 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:40.015723 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 296/584] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:40.016505 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fe09c-47f5-40c6-a3b0-77d48619a87b None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:40.096483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:40.101640 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:40.121330 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a79754-3834-4d45-bc57-4b30237e1595 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:40.133960 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fe09c-47f5-40c6-a3b0-77d48619a87b None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:40.156135 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb28809-5bbd-47c9-b2f3-febb6e740412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:40.156778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb28809-5bbd-47c9-b2f3-febb6e740412 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:40.157056 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb28809-5bbd-47c9-b2f3-febb6e740412 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:40.157335 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb28809-5bbd-47c9-b2f3-febb6e740412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:40.168676 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb28809-5bbd-47c9-b2f3-febb6e740412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:40.170109 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb28809-5bbd-47c9-b2f3-febb6e740412 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:40.172788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb7a83-40d5-46ad-8025-136e8e539e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:40.173928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb7a83-40d5-46ad-8025-136e8e539e6a None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:40.174359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb7a83-40d5-46ad-8025-136e8e539e6a None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:40.174823 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb7a83-40d5-46ad-8025-136e8e539e6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:40.182582 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb7a83-40d5-46ad-8025-136e8e539e6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:40.184251 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb7a83-40d5-46ad-8025-136e8e539e6a None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:40.184981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-fbb28809-5bbd-47c9-b2f3-febb6e740412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:40.184981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:40.184981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:40.184981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:40.184981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:40.184981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:40.184981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:40.184981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:40.184981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:40.184981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:40.184981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:40.184981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:40.184981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:40.184981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:40.184981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:40.185971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:40.185971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:40.185971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:40.185971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:40.185971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:40.185971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:40.185971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:40.185971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:40.185971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:40.185971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:40.185971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:40.185971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:40.185971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:40.185971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:40.185971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:40.185971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:40.185971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:40.194857 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:40.194857 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:40.194857 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:40.194857 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:40.194857 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 289/585] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:40.194857 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb28809-5bbd-47c9-b2f3-febb6e740412 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:40.198947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-54bb7a83-40d5-46ad-8025-136e8e539e6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:40.198947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:40.198947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:40.198947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:40.198947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:40.198947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:40.198947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:40.198947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:40.198947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:40.198947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:40.198947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:40.198947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:40.198947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:40.198947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:40.198947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:40.199832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:40.199832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:40.199832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:40.199832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:40.199832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:40.199832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:40.199832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:40.199832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:40.199832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:40.199832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:40.199832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:40.199832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:40.199832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:40.199832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:40.199832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:40.199832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:40.199832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:40.200716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:40.200716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:40.200716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:40.200716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:40.200716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:40.200716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:40.200716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:40.200716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:40.202524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 297/586] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:40.203343 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb7a83-40d5-46ad-8025-136e8e539e6a None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:40.305276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb28809-5bbd-47c9-b2f3-febb6e740412 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:40.315691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb7a83-40d5-46ad-8025-136e8e539e6a None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:40.333927 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:40.339395 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eaa52e-9fa7-4261-bbda-a1d6cf4fd160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:40.340014 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eaa52e-9fa7-4261-bbda-a1d6cf4fd160 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:40.340297 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eaa52e-9fa7-4261-bbda-a1d6cf4fd160 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:40.340572 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eaa52e-9fa7-4261-bbda-a1d6cf4fd160 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:40.341256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eaa52e-9fa7-4261-bbda-a1d6cf4fd160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:40.341559 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eaa52e-9fa7-4261-bbda-a1d6cf4fd160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:40.342962 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eaa52e-9fa7-4261-bbda-a1d6cf4fd160 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:40.352996 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:40.355362 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 290/587] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:40.356670 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eaa52e-9fa7-4261-bbda-a1d6cf4fd160 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:40.362916 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1af58f-323f-4998-a9c7-8cf45ede941d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:40.363801 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1af58f-323f-4998-a9c7-8cf45ede941d None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:40.364085 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1af58f-323f-4998-a9c7-8cf45ede941d None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:40.364365 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1af58f-323f-4998-a9c7-8cf45ede941d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:40.372256 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1af58f-323f-4998-a9c7-8cf45ede941d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:40.374181 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1af58f-323f-4998-a9c7-8cf45ede941d None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:40.389435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-9d1af58f-323f-4998-a9c7-8cf45ede941d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 14:40:40.389435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:40.389435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:40.389435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:40.389435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:40.389435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:40.389435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:40.389435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:40.389435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:40.389435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:40.389435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:40.389435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:40.389435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:40.389435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:40.389435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:40.389435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:40.390347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:40.390347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:40.390347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:40.390347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:40.390347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:40.390347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:40.390347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:40.390347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:40.390347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:40.390347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:40.390347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:40.390347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:40.390347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:40.390347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:40.390347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:40.390347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:40.390347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:40.390347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:40.396643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:40.396643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:40.396643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:40.396643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:40.396643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:40.396643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:40.396643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:40.396643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:40.396643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 14:40:40.396643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:40.396643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 298/588] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:40.396643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1af58f-323f-4998-a9c7-8cf45ede941d None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:40.462211 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eaa52e-9fa7-4261-bbda-a1d6cf4fd160 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:40.498779 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3a8ed-61d0-4d5f-9fab-f5a8500c2ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:40.500010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3a8ed-61d0-4d5f-9fab-f5a8500c2ca0 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:40.500441 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3a8ed-61d0-4d5f-9fab-f5a8500c2ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:40.500863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3a8ed-61d0-4d5f-9fab-f5a8500c2ca0 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:40.501704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3a8ed-61d0-4d5f-9fab-f5a8500c2ca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:40.502156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3a8ed-61d0-4d5f-9fab-f5a8500c2ca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:40.503711 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3a8ed-61d0-4d5f-9fab-f5a8500c2ca0 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:40.509032 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1af58f-323f-4998-a9c7-8cf45ede941d None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:40.516349 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 291/589] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:40.517333 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3a8ed-61d0-4d5f-9fab-f5a8500c2ca0 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:40.554473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84c1e5-2584-4ba9-8821-012f45ddd37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:40.555162 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84c1e5-2584-4ba9-8821-012f45ddd37f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:40.556023 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84c1e5-2584-4ba9-8821-012f45ddd37f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:40.556241 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84c1e5-2584-4ba9-8821-012f45ddd37f None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:40.556998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84c1e5-2584-4ba9-8821-012f45ddd37f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:40.557324 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84c1e5-2584-4ba9-8821-012f45ddd37f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:40.558797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84c1e5-2584-4ba9-8821-012f45ddd37f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:40.571667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 299/590] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:40.572291 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84c1e5-2584-4ba9-8821-012f45ddd37f None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:40.579873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:40.628254 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:40.632734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3a8ed-61d0-4d5f-9fab-f5a8500c2ca0 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:40.670145 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55281a6a-fbba-45fb-b779-4a9bc50bd52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:40.671014 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55281a6a-fbba-45fb-b779-4a9bc50bd52e None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:40.671290 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55281a6a-fbba-45fb-b779-4a9bc50bd52e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:40.671645 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55281a6a-fbba-45fb-b779-4a9bc50bd52e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:40.680929 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55281a6a-fbba-45fb-b779-4a9bc50bd52e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:40.682504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55281a6a-fbba-45fb-b779-4a9bc50bd52e None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:40.687227 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84c1e5-2584-4ba9-8821-012f45ddd37f None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:40.696432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-55281a6a-fbba-45fb-b779-4a9bc50bd52e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:40.696432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:40.696432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:40.696432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:40.696432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:40.696432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:40.696432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:40.696432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:40.696432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:40.696432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:40.696432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:40.696432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:40.696432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:40.696432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:40.696432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:40.697491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:40.697491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:40.697491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:40.697491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:40.697491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:40.697491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:40.697491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:40.697491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:40.697491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:40.697491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:40.697491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:40.697491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:40.697491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:40.697491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:40.697491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:40.697491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:40.697491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:40.698781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:40.698781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:40.698781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:40.698781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:40.698781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:40.698781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:40.698781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:40.698781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:40.703015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 292/591] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:40.703869 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55281a6a-fbba-45fb-b779-4a9bc50bd52e None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:40.724669 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51955605-7f3c-4f84-bf40-c9df835b1720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:40.725311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51955605-7f3c-4f84-bf40-c9df835b1720 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:40.725665 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51955605-7f3c-4f84-bf40-c9df835b1720 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:40.726012 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51955605-7f3c-4f84-bf40-c9df835b1720 None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:40.727437 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51955605-7f3c-4f84-bf40-c9df835b1720 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:40.727820 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51955605-7f3c-4f84-bf40-c9df835b1720 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:40.729489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51955605-7f3c-4f84-bf40-c9df835b1720 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:40.748026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 300/592] 10.222.0.86 () {56 vars in 1139 bytes} [Tue Jul 26 14:40:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:40.749186 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51955605-7f3c-4f84-bf40-c9df835b1720 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:40.816577 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55281a6a-fbba-45fb-b779-4a9bc50bd52e None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:40.829647 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:40.854613 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb863a-1983-4636-92ef-8f404aad1ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:40.855261 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb863a-1983-4636-92ef-8f404aad1ad4 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:40.855541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb863a-1983-4636-92ef-8f404aad1ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:40.855812 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb863a-1983-4636-92ef-8f404aad1ad4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:40.856857 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51955605-7f3c-4f84-bf40-c9df835b1720 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:40.863473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb863a-1983-4636-92ef-8f404aad1ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:40.865158 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb863a-1983-4636-92ef-8f404aad1ad4 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:40.869083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:40.876873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-88bb863a-1983-4636-92ef-8f404aad1ad4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:40:40.876873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:40.876873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:40.876873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:40.876873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:40.876873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:40.876873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:40.876873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:40.876873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:40.876873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:40.876873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:40.876873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:40.876873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:40.876873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:40.876873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:40.876873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:40.877994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:40.877994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:40.877994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:40.877994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:40.877994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:40.877994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:40.877994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:40.877994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:40.877994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:40.877994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:40.877994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:40.877994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:40.877994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:40.877994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:40.877994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:40.877994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:40.877994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:40.877994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:40.879078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:40.879078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:40.879078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:40.879078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:40.879078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:40.879078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:40.879078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:40.879078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:40.879078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:40:40.879078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:40.882787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 293/593] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:40.884132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb863a-1983-4636-92ef-8f404aad1ad4 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:40.892660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ca883-7c3d-4082-948b-176065a16846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:40.893336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ca883-7c3d-4082-948b-176065a16846 None admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:40.893617 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ca883-7c3d-4082-948b-176065a16846 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:40.896409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ca883-7c3d-4082-948b-176065a16846 None admin] PATH_INFO: `/v3/projects/12937bc17f02483285f18c492fe237e3/users/d12fc26e640f4337b4a4da60cc4d9adc/roles/7f17a5a0295f42e793e343cff968367c` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:40.912439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ca883-7c3d-4082-948b-176065a16846 None admin] RBAC: Authorizing `identity:create_grant(project_id=12937bc17f02483285f18c492fe237e3, user_id=d12fc26e640f4337b4a4da60cc4d9adc, role_id=7f17a5a0295f42e793e343cff968367c)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:40.915215 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ca883-7c3d-4082-948b-176065a16846 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:40.988065 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb863a-1983-4636-92ef-8f404aad1ad4 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:41.001572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 301/594] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:40:40 2022] PUT /identity/v3/projects/12937bc17f02483285f18c492fe237e3/users/d12fc26e640f4337b4a4da60cc4d9adc/roles/7f17a5a0295f42e793e343cff968367c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:40:41.001572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ca883-7c3d-4082-948b-176065a16846 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:41.025735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3294b24-b424-409b-a48c-a5f03b34ae28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:41.026401 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3294b24-b424-409b-a48c-a5f03b34ae28 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:41.026748 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3294b24-b424-409b-a48c-a5f03b34ae28 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:41.027031 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3294b24-b424-409b-a48c-a5f03b34ae28 None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:41.028015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3294b24-b424-409b-a48c-a5f03b34ae28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:41.028329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3294b24-b424-409b-a48c-a5f03b34ae28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:41.030205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3294b24-b424-409b-a48c-a5f03b34ae28 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:41.047937 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 294/595] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:41.048913 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3294b24-b424-409b-a48c-a5f03b34ae28 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:41.090541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:41.144436 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ca883-7c3d-4082-948b-176065a16846 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:41.172762 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3294b24-b424-409b-a48c-a5f03b34ae28 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:41.182989 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00e79f-ee32-4673-beee-9304a3e23c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:41.184152 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00e79f-ee32-4673-beee-9304a3e23c51 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:41.184598 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00e79f-ee32-4673-beee-9304a3e23c51 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:41.185024 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00e79f-ee32-4673-beee-9304a3e23c51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:41.195567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00e79f-ee32-4673-beee-9304a3e23c51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:41.197630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00e79f-ee32-4673-beee-9304a3e23c51 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:41.211826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6ce02-e0e2-4cec-b805-b3b964bbfc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:41.212449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6ce02-e0e2-4cec-b805-b3b964bbfc40 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:41.212557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-4b00e79f-ee32-4673-beee-9304a3e23c51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:41.212557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:41.212557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:41.212557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:41.212557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:41.212557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:41.212557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:41.212557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:41.212557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:41.212557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:41.212557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:41.212557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:41.212557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:41.212557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:41.212557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:41.213331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:41.213331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:41.213331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:41.213331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:41.213331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:41.213331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:41.213331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:41.213331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:41.213331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:41.213331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:41.213331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:41.213331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:41.213331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:41.213331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:41.213331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:41.213331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:41.213331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:41.214187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:41.214187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:41.214187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:41.214187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:41.214454 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6ce02-e0e2-4cec-b805-b3b964bbfc40 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:41.214454 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6ce02-e0e2-4cec-b805-b3b964bbfc40 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:41.214609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6ce02-e0e2-4cec-b805-b3b964bbfc40 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:41.215119 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6ce02-e0e2-4cec-b805-b3b964bbfc40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:41.216401 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6ce02-e0e2-4cec-b805-b3b964bbfc40 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:41.218214 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 302/596] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:41.219059 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00e79f-ee32-4673-beee-9304a3e23c51 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:41.236114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:41.242282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 295/597] 10.222.0.86 () {56 vars in 1137 bytes} [Tue Jul 26 14:40:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:41.243821 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6ce02-e0e2-4cec-b805-b3b964bbfc40 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:41.361838 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00e79f-ee32-4673-beee-9304a3e23c51 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:41.364087 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:41.377434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6ce02-e0e2-4cec-b805-b3b964bbfc40 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:41.408016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe5264-32f2-46ff-8218-20245b4e943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:41.408743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe5264-32f2-46ff-8218-20245b4e943e None admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:41.409018 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe5264-32f2-46ff-8218-20245b4e943e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:41.409290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe5264-32f2-46ff-8218-20245b4e943e None admin] PATH_INFO: `/v3/projects/12937bc17f02483285f18c492fe237e3/users/aa31ecab10a6499f92da49bc7abb403a/roles/7f17a5a0295f42e793e343cff968367c` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:41.418120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0ba15-67c3-40e9-b790-454598679029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:41.419776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0ba15-67c3-40e9-b790-454598679029 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:41.420414 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0ba15-67c3-40e9-b790-454598679029 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:41.420938 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0ba15-67c3-40e9-b790-454598679029 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:41.422134 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0ba15-67c3-40e9-b790-454598679029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:41.422740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0ba15-67c3-40e9-b790-454598679029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:41.425190 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0ba15-67c3-40e9-b790-454598679029 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:41.426339 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe5264-32f2-46ff-8218-20245b4e943e None admin] RBAC: Authorizing `identity:create_grant(project_id=12937bc17f02483285f18c492fe237e3, user_id=aa31ecab10a6499f92da49bc7abb403a, role_id=7f17a5a0295f42e793e343cff968367c)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:41.428133 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe5264-32f2-46ff-8218-20245b4e943e None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:41.439720 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 296/598] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:41.440705 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0ba15-67c3-40e9-b790-454598679029 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:41.511397 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 303/599] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:40:41 2022] PUT /identity/v3/projects/12937bc17f02483285f18c492fe237e3/users/aa31ecab10a6499f92da49bc7abb403a/roles/7f17a5a0295f42e793e343cff968367c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:40:41.513586 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe5264-32f2-46ff-8218-20245b4e943e None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:41.587290 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0ba15-67c3-40e9-b790-454598679029 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:41.606850 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:41.655151 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe5264-32f2-46ff-8218-20245b4e943e None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:41.665190 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cba2a-118b-42d5-89f5-7b92cd9599c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:41.666479 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cba2a-118b-42d5-89f5-7b92cd9599c8 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:41.666479 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cba2a-118b-42d5-89f5-7b92cd9599c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:41.666479 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cba2a-118b-42d5-89f5-7b92cd9599c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:41.697520 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cba2a-118b-42d5-89f5-7b92cd9599c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:41.699164 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cba2a-118b-42d5-89f5-7b92cd9599c8 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:41.702546 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa096d3-b6c0-4f4f-b0ee-2174fe3bb9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:41.703439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa096d3-b6c0-4f4f-b0ee-2174fe3bb9fe None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:41.703893 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa096d3-b6c0-4f4f-b0ee-2174fe3bb9fe None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:41.704326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa096d3-b6c0-4f4f-b0ee-2174fe3bb9fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:41.708752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:41.713849 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa096d3-b6c0-4f4f-b0ee-2174fe3bb9fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:41.715537 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa096d3-b6c0-4f4f-b0ee-2174fe3bb9fe None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:41.716673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-561cba2a-118b-42d5-89f5-7b92cd9599c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:41.716673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:41.716673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:41.716673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:41.716673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:41.716673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:41.716673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:41.716673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:41.716673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:41.716673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:41.716673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:41.716673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:41.716673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:41.716673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:41.716673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:41.717740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:41.717740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:41.717740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:41.717740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:41.717740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:41.717740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:41.717740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:41.717740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:41.717740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:41.717740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:41.717740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:41.717740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:41.717740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:41.717740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:41.717740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:41.717740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:41.717740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:41.718990 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:41.718990 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:41.718990 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:41.718990 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:41.718990 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 297/600] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:41.723590 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cba2a-118b-42d5-89f5-7b92cd9599c8 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:41.732593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-efa096d3-b6c0-4f4f-b0ee-2174fe3bb9fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:41.732593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:41.732593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:41.732593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:41.732593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:41.732593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:41.732593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:41.732593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:41.732593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:41.732593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:41.732593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:41.732593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:41.732593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:41.732593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:41.732593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:41.733649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:41.733649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:41.733649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:41.733649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:41.733649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:41.733649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:41.733649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:41.733649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:41.733649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:41.733649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:41.733649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:41.733649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:41.733649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:41.733649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:41.733649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:41.733649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:41.733649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:41.734678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:41.734678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:41.734678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:41.734678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:41.734678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:41.734678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:41.734678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:41.734678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:41.740599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 304/601] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:41.743461 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa096d3-b6c0-4f4f-b0ee-2174fe3bb9fe None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:41.851383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa096d3-b6c0-4f4f-b0ee-2174fe3bb9fe None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:41.857650 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cba2a-118b-42d5-89f5-7b92cd9599c8 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:41.896423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88989d6c-dffa-4ec7-99a2-6418cacbf1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:41.897406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88989d6c-dffa-4ec7-99a2-6418cacbf1d6 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:41.897956 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88989d6c-dffa-4ec7-99a2-6418cacbf1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:41.898593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88989d6c-dffa-4ec7-99a2-6418cacbf1d6 None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:41.900146 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88989d6c-dffa-4ec7-99a2-6418cacbf1d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:41.900669 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88989d6c-dffa-4ec7-99a2-6418cacbf1d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:41.902315 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88989d6c-dffa-4ec7-99a2-6418cacbf1d6 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:41.903346 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d75cac-7416-4807-8a9e-1c9484b75c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:41.904063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d75cac-7416-4807-8a9e-1c9484b75c43 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:41.904442 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d75cac-7416-4807-8a9e-1c9484b75c43 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:41.904775 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d75cac-7416-4807-8a9e-1c9484b75c43 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:41.905556 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d75cac-7416-4807-8a9e-1c9484b75c43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:41.906303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d75cac-7416-4807-8a9e-1c9484b75c43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:41.907592 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d75cac-7416-4807-8a9e-1c9484b75c43 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:41.921533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 298/603] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:41.921930 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 305/603] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:41.923744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88989d6c-dffa-4ec7-99a2-6418cacbf1d6 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:41.927455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dfe37-b2c1-4ed6-a4ac-d06a69af1f2b None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:41.927749 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dfe37-b2c1-4ed6-a4ac-d06a69af1f2b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:41.928035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dfe37-b2c1-4ed6-a4ac-d06a69af1f2b None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:41.929610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 299/604] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:41.930445 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dfe37-b2c1-4ed6-a4ac-d06a69af1f2b None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:42.033247 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88989d6c-dffa-4ec7-99a2-6418cacbf1d6 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:42.041634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dfe37-b2c1-4ed6-a4ac-d06a69af1f2b None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:42.045614 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:42.079136 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fde06-3994-4fc8-9293-3cb9598399f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:42.080089 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fde06-3994-4fc8-9293-3cb9598399f3 None admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:42.080580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fde06-3994-4fc8-9293-3cb9598399f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:42.081006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fde06-3994-4fc8-9293-3cb9598399f3 None admin] PATH_INFO: `/v3/projects/12937bc17f02483285f18c492fe237e3/users/e71086ec00454e26b24337e0876bfe89/roles/7f17a5a0295f42e793e343cff968367c` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:42.084426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa8ff9-9413-4c4d-bee2-a65b538e545e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:42.085336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa8ff9-9413-4c4d-bee2-a65b538e545e None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:42.085481 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa8ff9-9413-4c4d-bee2-a65b538e545e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:42.085669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa8ff9-9413-4c4d-bee2-a65b538e545e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:42.093923 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa8ff9-9413-4c4d-bee2-a65b538e545e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:42.095570 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa8ff9-9413-4c4d-bee2-a65b538e545e None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:42.100179 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432fde06-3994-4fc8-9293-3cb9598399f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=12937bc17f02483285f18c492fe237e3, user_id=e71086ec00454e26b24337e0876bfe89, role_id=7f17a5a0295f42e793e343cff968367c)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:42.100179 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432fde06-3994-4fc8-9293-3cb9598399f3 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:42.106912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:42.108947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-a2fa8ff9-9413-4c4d-bee2-a65b538e545e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:42.108947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:42.108947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:42.108947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:42.108947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:42.108947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:42.108947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:42.108947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:42.108947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:42.108947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:42.108947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:42.108947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:42.108947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:42.108947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:42.108947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:42.109814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:42.109814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:42.109814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:42.109814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:42.109814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:42.109814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:42.109814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:42.109814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:42.109814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:42.109814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:42.109814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:42.109814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:42.109814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:42.109814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:42.109814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:42.109814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:42.109814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:42.110732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:42.110732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:42.110732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:42.110732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:42.110732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:42.110732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:42.110732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:42.110732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:42.110732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 300/605] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:42.111703 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc20278-0f3b-4827-bc71-5775e964e9d6 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:42.111703 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc20278-0f3b-4827-bc71-5775e964e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:42.111870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc20278-0f3b-4827-bc71-5775e964e9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:42.134798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-2bc20278-0f3b-4827-bc71-5775e964e9d6 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:42.136339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2bc20278-0f3b-4827-bc71-5775e964e9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:42.213777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 301/607] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:42.213777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc20278-0f3b-4827-bc71-5775e964e9d6 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:42.214343 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 306/607] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:40:41 2022] PUT /identity/v3/projects/12937bc17f02483285f18c492fe237e3/users/e71086ec00454e26b24337e0876bfe89/roles/7f17a5a0295f42e793e343cff968367c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 14:40:42.252802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fde06-3994-4fc8-9293-3cb9598399f3 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:42.306794 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:42.343255 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:42.399249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc20278-0f3b-4827-bc71-5775e964e9d6 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:42.441845 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8284c-a50e-4410-8b7a-c5bfdeb4d2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:42.442913 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8284c-a50e-4410-8b7a-c5bfdeb4d2f7 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:42.443425 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8284c-a50e-4410-8b7a-c5bfdeb4d2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:42.443909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8284c-a50e-4410-8b7a-c5bfdeb4d2f7 None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:42.444982 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8284c-a50e-4410-8b7a-c5bfdeb4d2f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:42.445530 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8284c-a50e-4410-8b7a-c5bfdeb4d2f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:42.447266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8284c-a50e-4410-8b7a-c5bfdeb4d2f7 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:42.460842 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fde06-3994-4fc8-9293-3cb9598399f3 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:42.462299 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 302/608] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:42.468263 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8284c-a50e-4410-8b7a-c5bfdeb4d2f7 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:42.522068 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bde5a3-36fb-404b-a89f-340e9e4cd60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:42.523107 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bde5a3-36fb-404b-a89f-340e9e4cd60f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:42.523553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bde5a3-36fb-404b-a89f-340e9e4cd60f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:42.524355 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bde5a3-36fb-404b-a89f-340e9e4cd60f None admin] PATH_INFO: `/v3/roles/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:42.547633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bde5a3-36fb-404b-a89f-340e9e4cd60f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:42.558409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-a1bde5a3-36fb-404b-a89f-340e9e4cd60f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:42.558409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:42.558409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:42.558409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:42.558409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:42.558409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:42.558409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:42.558409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:42.558409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:42.558409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:42.558409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:42.558409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:42.558409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:42.558409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:42.558409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:42.558409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:42.559651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:42.559651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:42.559651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:42.559651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:42.559651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:42.559651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:42.559651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:42.559651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:42.559651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:42.559651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:42.559651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:42.559651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:42.559651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:42.559651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:42.559651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:42.559651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:42.560620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:42.560620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:42.560620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:42.560620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:42.560620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:42.560620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:42.560620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:42.560620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:42.560620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:42.560620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:42.560620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:42.560620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:42.564924 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 307/609] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:42.571378 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bde5a3-36fb-404b-a89f-340e9e4cd60f None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:42.628041 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8284c-a50e-4410-8b7a-c5bfdeb4d2f7 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:42.640125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:42.688617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd40b-9cd1-4fe2-bff6-95cc1df5089f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:42.689819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd40b-9cd1-4fe2-bff6-95cc1df5089f None admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:42.690985 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd40b-9cd1-4fe2-bff6-95cc1df5089f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:42.692247 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd40b-9cd1-4fe2-bff6-95cc1df5089f None admin] PATH_INFO: `/v3/projects/12937bc17f02483285f18c492fe237e3/users/6f495077bafd4fd18cc682fe0a6b7f8c/roles/7f17a5a0295f42e793e343cff968367c` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:42.722106 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cd40b-9cd1-4fe2-bff6-95cc1df5089f None admin] RBAC: Authorizing `identity:create_grant(project_id=12937bc17f02483285f18c492fe237e3, user_id=6f495077bafd4fd18cc682fe0a6b7f8c, role_id=7f17a5a0295f42e793e343cff968367c)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:42.723947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cd40b-9cd1-4fe2-bff6-95cc1df5089f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:42.742849 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:42.753914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bde5a3-36fb-404b-a89f-340e9e4cd60f None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:42.791827 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd9037-92cb-49ae-b9ac-108192e36b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:42.792634 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd9037-92cb-49ae-b9ac-108192e36b81 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:42.793020 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd9037-92cb-49ae-b9ac-108192e36b81 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:42.793452 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd9037-92cb-49ae-b9ac-108192e36b81 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:42.794416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd9037-92cb-49ae-b9ac-108192e36b81 None admin] RBAC: Adding query filter params (name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:42.794881 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd9037-92cb-49ae-b9ac-108192e36b81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:42.796444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd9037-92cb-49ae-b9ac-108192e36b81 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:42.806247 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 308/610] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:40:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:42.811906 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd9037-92cb-49ae-b9ac-108192e36b81 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:42.818781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 303/611] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:40:42 2022] PUT /identity/v3/projects/12937bc17f02483285f18c492fe237e3/users/6f495077bafd4fd18cc682fe0a6b7f8c/roles/7f17a5a0295f42e793e343cff968367c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:40:42.969889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd9037-92cb-49ae-b9ac-108192e36b81 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:43.020683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462af23-2fda-49d8-a08a-4b59b503d646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:43.021347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462af23-2fda-49d8-a08a-4b59b503d646 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:43.021640 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462af23-2fda-49d8-a08a-4b59b503d646 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:43.021921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462af23-2fda-49d8-a08a-4b59b503d646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:43.039019 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462af23-2fda-49d8-a08a-4b59b503d646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:43.040507 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462af23-2fda-49d8-a08a-4b59b503d646 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:43.066620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-f462af23-2fda-49d8-a08a-4b59b503d646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:43.066620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:43.066620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:43.066620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:43.066620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:43.066620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:43.066620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:43.066620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:43.066620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:43.066620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:43.066620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:43.066620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:43.066620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:43.066620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:43.066620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:43.067557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:43.067557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:43.067557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:43.067557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:43.067557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:43.067557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:43.067557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:43.067557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:43.067557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:43.067557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:43.067557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:43.067557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:43.067557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:43.067557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:43.067557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:43.067557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:43.067557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:43.068409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:43.068409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:43.068409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:43.068409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:43.068409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 309/612] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:43.074822 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd40b-9cd1-4fe2-bff6-95cc1df5089f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:43.209254 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd40b-9cd1-4fe2-bff6-95cc1df5089f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:43.245784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7fc20-a3a3-4154-bbb6-03dae10cdbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:43.246324 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7fc20-a3a3-4154-bbb6-03dae10cdbe3 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:43.246631 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7fc20-a3a3-4154-bbb6-03dae10cdbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:43.246904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7fc20-a3a3-4154-bbb6-03dae10cdbe3 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:43.247597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7fc20-a3a3-4154-bbb6-03dae10cdbe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:43.247956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7fc20-a3a3-4154-bbb6-03dae10cdbe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:43.249617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7fc20-a3a3-4154-bbb6-03dae10cdbe3 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:43.261465 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 304/613] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:43.266668 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462af23-2fda-49d8-a08a-4b59b503d646 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:43.279756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:43.420376 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462af23-2fda-49d8-a08a-4b59b503d646 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:43.437432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3a0ec-4d96-4bae-b0a8-e2adc16e93da None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:43.437976 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3a0ec-4d96-4bae-b0a8-e2adc16e93da None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:43.437976 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3a0ec-4d96-4bae-b0a8-e2adc16e93da None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:43.440786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 305/614] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:40:43.444977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b199a-abbd-4874-b706-93c51ab9f192 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:43.445270 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b199a-abbd-4874-b706-93c51ab9f192 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:43.445554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b199a-abbd-4874-b706-93c51ab9f192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:43.464750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-ef7b199a-abbd-4874-b706-93c51ab9f192 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:43.465954 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ef7b199a-abbd-4874-b706-93c51ab9f192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:43.479707 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c7ef1-2a3e-456c-a484-6b74d948010a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:43.480369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c7ef1-2a3e-456c-a484-6b74d948010a None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:43.480661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c7ef1-2a3e-456c-a484-6b74d948010a None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:43.480943 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c7ef1-2a3e-456c-a484-6b74d948010a None admin] PATH_INFO: `/v3/users/swift` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:43.483575 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:43.506853 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c7ef1-2a3e-456c-a484-6b74d948010a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:43.508879 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c7ef1-2a3e-456c-a484-6b74d948010a None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:43.527276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-f99c7ef1-2a3e-456c-a484-6b74d948010a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:40:43.527276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:43.527276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:43.527276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:43.527276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:43.527276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:43.527276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:43.527276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:43.527276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:43.527276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:43.527276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:43.527276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:43.527276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:43.527276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:43.527276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:43.527276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:43.528275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:43.528275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:43.528275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:43.528275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:43.528275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:43.528275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:43.528275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:43.528275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:43.528275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:43.528275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:43.528275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:43.528275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:43.528275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:43.528275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:43.528275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:43.528275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:43.528275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:43.528275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:43.529231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:43.529231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:43.529231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:43.529231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:43.529231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:43.529231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:43.529231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:43.529231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:43.529231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:40:43.529231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:43.542476 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 310/615] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:40:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:43.543912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c7ef1-2a3e-456c-a484-6b74d948010a None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:43.588155 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 306/616] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:43.625610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b199a-abbd-4874-b706-93c51ab9f192 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:43.678750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:43.748504 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c7ef1-2a3e-456c-a484-6b74d948010a None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:43.803579 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b199a-abbd-4874-b706-93c51ab9f192 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:43.828441 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe44a5-df69-42ee-9288-4b11a0a113e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:43.829429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe44a5-df69-42ee-9288-4b11a0a113e8 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:43.829919 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe44a5-df69-42ee-9288-4b11a0a113e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:43.830417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe44a5-df69-42ee-9288-4b11a0a113e8 None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:43.831442 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe44a5-df69-42ee-9288-4b11a0a113e8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:43.831964 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe44a5-df69-42ee-9288-4b11a0a113e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:43.833608 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe44a5-df69-42ee-9288-4b11a0a113e8 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:43.851159 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1db3a-ef26-41bd-995f-55f153365dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:43.852376 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1db3a-ef26-41bd-995f-55f153365dcb None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:43.852669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1db3a-ef26-41bd-995f-55f153365dcb None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:43.852948 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1db3a-ef26-41bd-995f-55f153365dcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:43.858736 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 311/617] 10.222.0.86 () {56 vars in 1135 bytes} [Tue Jul 26 14:40:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:43.860335 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe44a5-df69-42ee-9288-4b11a0a113e8 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:43.882298 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1db3a-ef26-41bd-995f-55f153365dcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:43.888875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-c4f1db3a-ef26-41bd-995f-55f153365dcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:43.888875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:43.888875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:43.888875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:43.888875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:43.888875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:43.888875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:43.888875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:43.888875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:43.888875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:43.888875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:43.888875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:43.888875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:43.888875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:43.888875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:43.888875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:43.889768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:43.889768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:43.889768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:43.889768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:43.889768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:43.889768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:43.889768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:43.889768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:43.889768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:43.889768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:43.889768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:43.889768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:43.889768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:43.889768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:43.889768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:43.889768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:43.890621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:43.890621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:43.890621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:43.890621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:43.890621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:43.890621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:43.890621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:43.890621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:43.890621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:43.890621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:43.890621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:43.890621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:43.899730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 307/618] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:40:43.916349 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1db3a-ef26-41bd-995f-55f153365dcb None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:43.938738 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:44.013271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe44a5-df69-42ee-9288-4b11a0a113e8 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:44.048523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c573ca-a7c6-40f7-af55-56b0606f5a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:44.049177 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c573ca-a7c6-40f7-af55-56b0606f5a35 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:44.049464 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c573ca-a7c6-40f7-af55-56b0606f5a35 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:44.049744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c573ca-a7c6-40f7-af55-56b0606f5a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:44.050831 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:44.062236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c573ca-a7c6-40f7-af55-56b0606f5a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:44.063805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c573ca-a7c6-40f7-af55-56b0606f5a35 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:44.079880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-10c573ca-a7c6-40f7-af55-56b0606f5a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:44.079880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:44.079880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:44.079880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:44.079880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:44.079880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:44.079880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:44.079880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:44.079880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:44.079880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:44.079880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:44.079880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:44.079880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:44.079880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:44.079880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:44.081000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:44.081000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:44.081000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:44.081000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:44.081000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:44.081000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:44.081000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:44.081000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:44.081000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:44.081000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:44.081000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:44.081000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:44.081000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:44.081000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:44.081000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:44.081000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:44.081000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:44.082046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:44.082046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:44.082046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:44.082046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:44.090314 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 312/619] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:44.092899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c573ca-a7c6-40f7-af55-56b0606f5a35 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:44.120877 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1db3a-ef26-41bd-995f-55f153365dcb None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:44.157875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4bd6e-a9f1-4420-8d3f-bb7fbf0e315d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:44.158545 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4bd6e-a9f1-4420-8d3f-bb7fbf0e315d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:44.158834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4bd6e-a9f1-4420-8d3f-bb7fbf0e315d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:44.159114 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4bd6e-a9f1-4420-8d3f-bb7fbf0e315d None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:44.159847 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4bd6e-a9f1-4420-8d3f-bb7fbf0e315d None admin] RBAC: Adding query filter params (name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:44.160157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4bd6e-a9f1-4420-8d3f-bb7fbf0e315d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:44.161601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4bd6e-a9f1-4420-8d3f-bb7fbf0e315d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:44.171120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 308/620] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:40:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:44.172371 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b331e3-d457-46d9-a592-9e2a1bbc9e58 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:44.172710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b331e3-d457-46d9-a592-9e2a1bbc9e58 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:44.172998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b331e3-d457-46d9-a592-9e2a1bbc9e58 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:44.178571 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 309/621] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:44.179778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af264cce-4a78-47f7-8e0e-a4f5479f6548 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:44.180106 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af264cce-4a78-47f7-8e0e-a4f5479f6548 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:44.180390 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af264cce-4a78-47f7-8e0e-a4f5479f6548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:44.199128 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-af264cce-4a78-47f7-8e0e-a4f5479f6548 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:44.200335 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-af264cce-4a78-47f7-8e0e-a4f5479f6548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:44.203835 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c573ca-a7c6-40f7-af55-56b0606f5a35 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:44.239497 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f12786-73e0-4fa1-940d-e7332a74501f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:44.240130 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f12786-73e0-4fa1-940d-e7332a74501f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:44.240418 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f12786-73e0-4fa1-940d-e7332a74501f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:44.240700 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f12786-73e0-4fa1-940d-e7332a74501f None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:44.241404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f12786-73e0-4fa1-940d-e7332a74501f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:44.241713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f12786-73e0-4fa1-940d-e7332a74501f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:44.243165 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f12786-73e0-4fa1-940d-e7332a74501f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:44.260578 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 313/622] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:44.261502 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f12786-73e0-4fa1-940d-e7332a74501f None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:44.278045 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 310/623] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:44.282921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af264cce-4a78-47f7-8e0e-a4f5479f6548 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:44.285597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:44.310445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:44.369748 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f12786-73e0-4fa1-940d-e7332a74501f None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:44.405640 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f63600-f71b-4dc4-85e8-b3c7d175b7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:44.406282 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f63600-f71b-4dc4-85e8-b3c7d175b7da None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:44.406606 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f63600-f71b-4dc4-85e8-b3c7d175b7da None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:44.406888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f63600-f71b-4dc4-85e8-b3c7d175b7da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:44.414896 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af264cce-4a78-47f7-8e0e-a4f5479f6548 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:44.417448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f63600-f71b-4dc4-85e8-b3c7d175b7da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:44.419639 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f63600-f71b-4dc4-85e8-b3c7d175b7da None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:44.435369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-62f63600-f71b-4dc4-85e8-b3c7d175b7da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:44.435369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:44.435369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:44.435369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:44.435369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:44.435369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:44.435369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:44.435369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:44.435369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:44.435369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:44.435369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:44.435369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:44.435369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:44.435369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:44.435369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:44.436487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:44.436487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:44.436487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:44.436487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:44.436487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:44.436487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:44.436487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:44.436487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:44.436487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:44.436487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:44.436487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:44.436487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:44.436487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:44.436487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:44.436487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:44.436487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:44.436487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:44.437549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:44.437549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:44.437549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:44.437549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:44.441114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 314/624] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:44.441959 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f63600-f71b-4dc4-85e8-b3c7d175b7da None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:44.457147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c33af-c5aa-4411-ba5e-7202ec268a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:44.458507 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c33af-c5aa-4411-ba5e-7202ec268a2f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:44.458943 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c33af-c5aa-4411-ba5e-7202ec268a2f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:44.459407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c33af-c5aa-4411-ba5e-7202ec268a2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:44.467353 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c33af-c5aa-4411-ba5e-7202ec268a2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:44.469076 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c33af-c5aa-4411-ba5e-7202ec268a2f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:44.481259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-db3c33af-c5aa-4411-ba5e-7202ec268a2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:44.481259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:44.481259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:44.481259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:44.481259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:44.481259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:44.481259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:44.481259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:44.481259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:44.481259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:44.481259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:44.481259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:44.481259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:44.481259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:44.481259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:44.482348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:44.482348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:44.482348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:44.482348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:44.482348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:44.482348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:44.482348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:44.482348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:44.482348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:44.482348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:44.482348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:44.482348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:44.482348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:44.482348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:44.482348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:44.482348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:44.482348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:44.483420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:44.483420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:44.483420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:44.483420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:44.483420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:44.483420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:44.483420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:44.483420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:44.485619 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 311/625] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:44.486587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c33af-c5aa-4411-ba5e-7202ec268a2f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:44.542813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:44.551595 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f63600-f71b-4dc4-85e8-b3c7d175b7da None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:44.553917 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:44.588486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113b88e-f8e1-4bb6-812f-e0439f3c10e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:44.589139 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113b88e-f8e1-4bb6-812f-e0439f3c10e8 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:44.589425 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113b88e-f8e1-4bb6-812f-e0439f3c10e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:44.589704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113b88e-f8e1-4bb6-812f-e0439f3c10e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:44.596448 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c33af-c5aa-4411-ba5e-7202ec268a2f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:44.600832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113b88e-f8e1-4bb6-812f-e0439f3c10e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:44.607153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-e113b88e-f8e1-4bb6-812f-e0439f3c10e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:44.607153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:44.607153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:44.607153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:44.607153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:44.607153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:44.607153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:44.607153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:44.607153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:44.607153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:44.607153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:44.607153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:44.607153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:44.607153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:44.607153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:44.607153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:44.608307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:44.608307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:44.608307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:44.608307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:44.608307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:44.608307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:44.608307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:44.608307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:44.608307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:44.608307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:44.608307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:44.608307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:44.608307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:44.608307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:44.608307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:44.608307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:44.609472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:44.609472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:44.609472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:44.609472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:44.609472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:44.609472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:44.609472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:44.609472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:44.609472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:44.609472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:44.609472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:44.609472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:44.609472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 315/626] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:44.609472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113b88e-f8e1-4bb6-812f-e0439f3c10e8 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:44.637088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c9d1c-c139-4b84-918b-7c36e5b7bca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:44.637844 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c9d1c-c139-4b84-918b-7c36e5b7bca0 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:44.638439 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c9d1c-c139-4b84-918b-7c36e5b7bca0 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:44.638439 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c9d1c-c139-4b84-918b-7c36e5b7bca0 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:44.639139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c9d1c-c139-4b84-918b-7c36e5b7bca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:44.639450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c9d1c-c139-4b84-918b-7c36e5b7bca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:44.640827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c9d1c-c139-4b84-918b-7c36e5b7bca0 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:44.653036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 312/627] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:44.654077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4f0b6-c4d0-4fb8-9c22-aba5144a39fd None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:44.654368 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4f0b6-c4d0-4fb8-9c22-aba5144a39fd None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:44.654677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4f0b6-c4d0-4fb8-9c22-aba5144a39fd None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:44.659335 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 313/628] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:44.659335 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4f0b6-c4d0-4fb8-9c22-aba5144a39fd None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:44.751447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113b88e-f8e1-4bb6-812f-e0439f3c10e8 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:44.774616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4f0b6-c4d0-4fb8-9c22-aba5144a39fd None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:44.787823 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b8cd0-7a1f-4e38-8854-7a96442c4fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:44.788452 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b8cd0-7a1f-4e38-8854-7a96442c4fc7 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:44.788743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b8cd0-7a1f-4e38-8854-7a96442c4fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:44.789808 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b8cd0-7a1f-4e38-8854-7a96442c4fc7 None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:44.790305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b8cd0-7a1f-4e38-8854-7a96442c4fc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:44.790657 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b8cd0-7a1f-4e38-8854-7a96442c4fc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:44.792114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b8cd0-7a1f-4e38-8854-7a96442c4fc7 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:44.799172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:44.806764 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 316/629] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:44.812331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b8cd0-7a1f-4e38-8854-7a96442c4fc7 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:44.812796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d272077-8e90-4781-902b-2383c48ec092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:44.815956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d272077-8e90-4781-902b-2383c48ec092 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:44.815956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d272077-8e90-4781-902b-2383c48ec092 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:44.815956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d272077-8e90-4781-902b-2383c48ec092 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:44.815956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d272077-8e90-4781-902b-2383c48ec092 None admin] RBAC: Adding query filter params (name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:44.815956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d272077-8e90-4781-902b-2383c48ec092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:44.816860 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d272077-8e90-4781-902b-2383c48ec092 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:44.824783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:44.825282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 314/630] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:40:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:44.826596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb93db-ba90-4fd3-adea-f4db82264225 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:44.826840 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb93db-ba90-4fd3-adea-f4db82264225 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:44.827139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb93db-ba90-4fd3-adea-f4db82264225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:44.845819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-82eb93db-ba90-4fd3-adea-f4db82264225 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:44.847058 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-82eb93db-ba90-4fd3-adea-f4db82264225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:44.926549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 315/631] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:44.926549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb93db-ba90-4fd3-adea-f4db82264225 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:44.926801 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b8cd0-7a1f-4e38-8854-7a96442c4fc7 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:44.964295 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3924d-7d11-413e-a29e-6f382c0c80df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:44.965051 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3924d-7d11-413e-a29e-6f382c0c80df None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:44.965422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3924d-7d11-413e-a29e-6f382c0c80df None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:44.965711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3924d-7d11-413e-a29e-6f382c0c80df None admin] PATH_INFO: `/v3/users/nova` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:44.973001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3924d-7d11-413e-a29e-6f382c0c80df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:44.974496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3924d-7d11-413e-a29e-6f382c0c80df None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:44.988751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-6cb3924d-7d11-413e-a29e-6f382c0c80df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:40:44.988751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:44.988751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:44.988751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:44.988751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:44.988751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:44.988751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:44.988751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:44.988751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:44.988751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:44.988751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:44.988751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:44.988751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:44.988751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:44.988751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:44.988751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:44.989771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:44.989771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:44.989771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:44.989771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:44.989771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:44.989771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:44.989771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:44.989771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:44.989771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:44.989771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:44.989771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:44.989771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:44.989771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:44.989771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:44.989771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:44.989771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:44.989771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:44.989771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:44.990813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:44.990813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:44.990813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:44.990813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:44.990813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:44.990813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:44.990813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:44.990813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:44.990813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:40:44.990813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:44.990813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 317/632] 10.222.0.86 () {56 vars in 1093 bytes} [Tue Jul 26 14:40:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:44.991387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3924d-7d11-413e-a29e-6f382c0c80df None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:45.047397 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb93db-ba90-4fd3-adea-f4db82264225 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:45.063745 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:45.066994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:45.084113 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2f88d-46b2-4644-8721-703f6d510a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:45.084791 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2f88d-46b2-4644-8721-703f6d510a18 None admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:45.085076 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2f88d-46b2-4644-8721-703f6d510a18 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:45.085355 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2f88d-46b2-4644-8721-703f6d510a18 None admin] PATH_INFO: `/v3/projects/12937bc17f02483285f18c492fe237e3/users/462ecbb85c6b4a17a952fb74fa2de65e/roles/7f17a5a0295f42e793e343cff968367c` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:45.101455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2f88d-46b2-4644-8721-703f6d510a18 None admin] RBAC: Authorizing `identity:create_grant(project_id=12937bc17f02483285f18c492fe237e3, user_id=462ecbb85c6b4a17a952fb74fa2de65e, role_id=7f17a5a0295f42e793e343cff968367c)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:45.106542 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2f88d-46b2-4644-8721-703f6d510a18 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:45.108179 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3924d-7d11-413e-a29e-6f382c0c80df None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:45.141908 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb27c4-4fa8-4b1a-a095-8a69bddcccc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:45.142583 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb27c4-4fa8-4b1a-a095-8a69bddcccc3 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:45.142874 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb27c4-4fa8-4b1a-a095-8a69bddcccc3 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:45.143154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb27c4-4fa8-4b1a-a095-8a69bddcccc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:45.154140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb27c4-4fa8-4b1a-a095-8a69bddcccc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:45.155641 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb27c4-4fa8-4b1a-a095-8a69bddcccc3 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:45.173980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-aefb27c4-4fa8-4b1a-a095-8a69bddcccc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:45.173980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:45.173980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:45.173980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:45.173980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:45.173980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:45.173980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:45.173980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:45.173980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:45.173980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:45.173980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:45.173980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:45.173980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:45.173980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:45.173980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:45.180798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:45.180798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:45.180798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:45.180798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:45.180798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:45.180798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:45.180798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:45.180798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:45.180798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:45.180798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:45.180798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:45.180798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:45.180798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:45.180798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:45.180798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:45.180798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:45.180798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:45.181670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:45.181670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:45.181670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:45.181670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:45.181670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 318/633] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:45.181670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb27c4-4fa8-4b1a-a095-8a69bddcccc3 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:45.216895 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 316/634] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:40:44 2022] PUT /identity/v3/projects/12937bc17f02483285f18c492fe237e3/users/462ecbb85c6b4a17a952fb74fa2de65e/roles/7f17a5a0295f42e793e343cff968367c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:40:45.217715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2f88d-46b2-4644-8721-703f6d510a18 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:45.301029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb27c4-4fa8-4b1a-a095-8a69bddcccc3 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:45.325285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:45.336162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2f88d-46b2-4644-8721-703f6d510a18 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:45.341285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86f113-9d2b-4e97-a9d4-eb0197cb451f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:45.341964 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86f113-9d2b-4e97-a9d4-eb0197cb451f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:45.342250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86f113-9d2b-4e97-a9d4-eb0197cb451f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:45.342564 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86f113-9d2b-4e97-a9d4-eb0197cb451f None admin] PATH_INFO: `/v3/roles/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:45.354708 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86f113-9d2b-4e97-a9d4-eb0197cb451f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:45.359746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-ce86f113-9d2b-4e97-a9d4-eb0197cb451f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:45.359746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:45.359746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:45.359746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:45.359746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:45.359746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:45.359746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:45.359746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:45.359746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:45.359746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:45.359746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:45.359746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:45.359746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:45.359746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:45.359746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:45.359746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:45.360751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:45.360751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:45.360751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:45.360751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:45.360751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:45.360751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:45.360751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:45.360751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:45.360751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:45.360751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:45.360751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:45.360751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:45.360751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:45.360751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:45.360751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:45.360751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:45.361581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:45.361581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:45.361581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:45.361581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:45.361581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:45.361581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:45.361581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:45.361581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:45.361581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:45.361581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:45.361581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:45.361581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:45.361581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 319/635] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:45.362248 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86f113-9d2b-4e97-a9d4-eb0197cb451f None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:45.387562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8914e-64ee-4994-b154-275f7e98bb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:45.388212 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8914e-64ee-4994-b154-275f7e98bb36 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:45.388500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8914e-64ee-4994-b154-275f7e98bb36 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:45.388776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8914e-64ee-4994-b154-275f7e98bb36 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:45.389590 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8914e-64ee-4994-b154-275f7e98bb36 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:45.389898 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8914e-64ee-4994-b154-275f7e98bb36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:45.391423 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8914e-64ee-4994-b154-275f7e98bb36 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:45.411519 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 317/636] 10.222.0.86 () {56 vars in 1133 bytes} [Tue Jul 26 14:40:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:45.412783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae622b9-5ec9-482b-9b02-69b6d58b701d None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:45.413075 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae622b9-5ec9-482b-9b02-69b6d58b701d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:45.413354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae622b9-5ec9-482b-9b02-69b6d58b701d None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:45.414858 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 318/637] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:45.415562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae622b9-5ec9-482b-9b02-69b6d58b701d None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:45.441096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:45.487561 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86f113-9d2b-4e97-a9d4-eb0197cb451f None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:45.522649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11ec3f-dc1e-4385-aee1-1f42fd8f6202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:45.523275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11ec3f-dc1e-4385-aee1-1f42fd8f6202 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:45.523557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11ec3f-dc1e-4385-aee1-1f42fd8f6202 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:45.524532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11ec3f-dc1e-4385-aee1-1f42fd8f6202 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:45.524734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae622b9-5ec9-482b-9b02-69b6d58b701d None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:45.525164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11ec3f-dc1e-4385-aee1-1f42fd8f6202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:45.525455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11ec3f-dc1e-4385-aee1-1f42fd8f6202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:45.526854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11ec3f-dc1e-4385-aee1-1f42fd8f6202 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:45.540633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 320/638] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:45.541469 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11ec3f-dc1e-4385-aee1-1f42fd8f6202 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:45.568620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eb01c-c804-4d57-8771-da1bfc5dd817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:45.569548 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eb01c-c804-4d57-8771-da1bfc5dd817 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:45.569977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eb01c-c804-4d57-8771-da1bfc5dd817 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:45.570420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eb01c-c804-4d57-8771-da1bfc5dd817 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:45.571816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972eb01c-c804-4d57-8771-da1bfc5dd817 None admin] RBAC: Adding query filter params (name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:45.572268 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972eb01c-c804-4d57-8771-da1bfc5dd817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:45.573878 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972eb01c-c804-4d57-8771-da1bfc5dd817 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:45.583313 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 319/639] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:40:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:45.584548 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f163cb-4cae-49d1-a440-b679de2efb95 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:45.584838 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f163cb-4cae-49d1-a440-b679de2efb95 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:45.585118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f163cb-4cae-49d1-a440-b679de2efb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:45.591131 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:45.606417 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-35f163cb-4cae-49d1-a440-b679de2efb95 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:45.607615 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-35f163cb-4cae-49d1-a440-b679de2efb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:45.653791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11ec3f-dc1e-4385-aee1-1f42fd8f6202 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:45.687392 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 320/640] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:45.688338 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f163cb-4cae-49d1-a440-b679de2efb95 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:45.704405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:45.706380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b8055-185c-44b3-a344-a39645b6b3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:45.707425 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b8055-185c-44b3-a344-a39645b6b3d9 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:45.708161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b8055-185c-44b3-a344-a39645b6b3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:45.708650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b8055-185c-44b3-a344-a39645b6b3d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:45.782037 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b8055-185c-44b3-a344-a39645b6b3d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:45.783841 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b8055-185c-44b3-a344-a39645b6b3d9 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:45.805991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f163cb-4cae-49d1-a440-b679de2efb95 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:45.825452 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:45.843072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c6110-7339-4fea-ac83-62ad0870d4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:45.843719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c6110-7339-4fea-ac83-62ad0870d4d6 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:45.844003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c6110-7339-4fea-ac83-62ad0870d4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:45.844291 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c6110-7339-4fea-ac83-62ad0870d4d6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:45.851690 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c6110-7339-4fea-ac83-62ad0870d4d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:45.853180 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c6110-7339-4fea-ac83-62ad0870d4d6 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:45.865030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-fa1c6110-7339-4fea-ac83-62ad0870d4d6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 14:40:45.865030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:45.865030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:45.865030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:45.865030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:45.865030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:45.865030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:45.865030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:45.865030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:45.865030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:45.865030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:45.865030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:45.865030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:45.865030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:45.865030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:45.865030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:45.865953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:45.865953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:45.865953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:45.865953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:45.865953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:45.865953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:45.865953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:45.865953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:45.865953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:45.865953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:45.865953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:45.865953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:45.865953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:45.865953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:45.865953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:45.865953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:45.865953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:45.865953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:45.867241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:45.867241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:45.867241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:45.867241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:45.867241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:45.867241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:45.867241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:45.867241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:45.867241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 14:40:45.867241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:45.867241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 321/641] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:45.867241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c6110-7339-4fea-ac83-62ad0870d4d6 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:45.891937 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 321/642] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:45.892638 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b8055-185c-44b3-a344-a39645b6b3d9 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:45.953146 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:45.979243 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c6110-7339-4fea-ac83-62ad0870d4d6 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:46.004683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b8055-185c-44b3-a344-a39645b6b3d9 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:46.015769 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9fee5-8af7-4a47-86aa-9d36d9a63cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:46.016736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9fee5-8af7-4a47-86aa-9d36d9a63cdb None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:46.017178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9fee5-8af7-4a47-86aa-9d36d9a63cdb None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:46.017452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9fee5-8af7-4a47-86aa-9d36d9a63cdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:46.028965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9fee5-8af7-4a47-86aa-9d36d9a63cdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:46.030404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9fee5-8af7-4a47-86aa-9d36d9a63cdb None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:46.041197 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded9602-8682-405c-9801-ad9e69a6ff25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:46.041838 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded9602-8682-405c-9801-ad9e69a6ff25 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:46.042124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded9602-8682-405c-9801-ad9e69a6ff25 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:46.042425 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded9602-8682-405c-9801-ad9e69a6ff25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:46.045329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-f1a9fee5-8af7-4a47-86aa-9d36d9a63cdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:46.045329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:46.045329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:46.045329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:46.045329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:46.045329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:46.045329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:46.045329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:46.045329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:46.045329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:46.045329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:46.045329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:46.045329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:46.045329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:46.045329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:46.046223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:46.046223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:46.046223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:46.046223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:46.046223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:46.046223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:46.046223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:46.046223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:46.046223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:46.046223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:46.046223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:46.046223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:46.046223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:46.046223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:46.046223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:46.046223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:46.046223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:46.047132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:46.047132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:46.047132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:46.047132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:46.050527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 322/643] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:46.051806 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9fee5-8af7-4a47-86aa-9d36d9a63cdb None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:46.054507 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:46.058208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded9602-8682-405c-9801-ad9e69a6ff25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:46.063168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-7ded9602-8682-405c-9801-ad9e69a6ff25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:46.063168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:46.063168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:46.063168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:46.063168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:46.063168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:46.063168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:46.063168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:46.063168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:46.063168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:46.063168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:46.063168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:46.063168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:46.063168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:46.063168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:46.063168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:46.070319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:46.070319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:46.070319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:46.070319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:46.070319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:46.070319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:46.070319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:46.070319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:46.070319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:46.070319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:46.070319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:46.070319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:46.070319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:46.070319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:46.070319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:46.070319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:46.072262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:46.072262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:46.072262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:46.072262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:46.072262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:46.072262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:46.072262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:46.072262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:46.072262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:46.072262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:46.072262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:46.072262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:46.072262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 322/644] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:46.072262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded9602-8682-405c-9801-ad9e69a6ff25 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:46.172422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9fee5-8af7-4a47-86aa-9d36d9a63cdb None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:46.194961 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded9602-8682-405c-9801-ad9e69a6ff25 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:46.200866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:46.209690 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2511844-50ad-4a2e-bedc-cd0a106eb5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:46.214342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2511844-50ad-4a2e-bedc-cd0a106eb5c9 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:46.214342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2511844-50ad-4a2e-bedc-cd0a106eb5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:46.214342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2511844-50ad-4a2e-bedc-cd0a106eb5c9 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:46.214342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2511844-50ad-4a2e-bedc-cd0a106eb5c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:46.214342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2511844-50ad-4a2e-bedc-cd0a106eb5c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:46.214342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2511844-50ad-4a2e-bedc-cd0a106eb5c9 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:46.235136 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 323/645] 10.222.0.86 () {56 vars in 1137 bytes} [Tue Jul 26 14:40:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:46.235300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6fda4-8b0c-49d8-9979-c1de4792fea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:46.235300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6fda4-8b0c-49d8-9979-c1de4792fea0 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:46.235500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2511844-50ad-4a2e-bedc-cd0a106eb5c9 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:46.235587 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6fda4-8b0c-49d8-9979-c1de4792fea0 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:46.235587 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6fda4-8b0c-49d8-9979-c1de4792fea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:46.247341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6fda4-8b0c-49d8-9979-c1de4792fea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:46.248793 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6fda4-8b0c-49d8-9979-c1de4792fea0 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:46.267268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-f5f6fda4-8b0c-49d8-9979-c1de4792fea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:46.267268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:46.267268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:46.267268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:46.267268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:46.267268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:46.267268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:46.267268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:46.267268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:46.267268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:46.267268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:46.267268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:46.267268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:46.267268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:46.267268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:46.268132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:46.268132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:46.268132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:46.268132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:46.268132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:46.268132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:46.268132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:46.268132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:46.268132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:46.268132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:46.268132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:46.268132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:46.268132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:46.268132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:46.268132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:46.268132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:46.268132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:46.269014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:46.269014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:46.269014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:46.269014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:46.269014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 323/646] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:46.269293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6fda4-8b0c-49d8-9979-c1de4792fea0 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:46.327888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:46.349739 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2511844-50ad-4a2e-bedc-cd0a106eb5c9 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:46.384418 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6fda4-8b0c-49d8-9979-c1de4792fea0 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:46.387369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261fdf2-633f-4255-9347-88952532eb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:46.387996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261fdf2-633f-4255-9347-88952532eb62 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:46.388279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261fdf2-633f-4255-9347-88952532eb62 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:46.388552 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261fdf2-633f-4255-9347-88952532eb62 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:46.389241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261fdf2-633f-4255-9347-88952532eb62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:46.389547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261fdf2-633f-4255-9347-88952532eb62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:46.390954 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261fdf2-633f-4255-9347-88952532eb62 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:46.402592 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 324/647] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:46.403411 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261fdf2-633f-4255-9347-88952532eb62 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:46.429799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71ccf7-6ef9-4c99-88db-6f888becbf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:46.431012 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71ccf7-6ef9-4c99-88db-6f888becbf44 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:46.431319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71ccf7-6ef9-4c99-88db-6f888becbf44 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:46.431565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71ccf7-6ef9-4c99-88db-6f888becbf44 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:46.432279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71ccf7-6ef9-4c99-88db-6f888becbf44 None admin] RBAC: Adding query filter params (name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:46.432587 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71ccf7-6ef9-4c99-88db-6f888becbf44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:46.433959 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71ccf7-6ef9-4c99-88db-6f888becbf44 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:46.448221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 324/648] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:40:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:46.448221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71ccf7-6ef9-4c99-88db-6f888becbf44 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:46.449835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:46.503610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261fdf2-633f-4255-9347-88952532eb62 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:46.538123 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fdf96-5af6-4718-adf0-ad4df768b4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:46.538784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fdf96-5af6-4718-adf0-ad4df768b4a5 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:46.539040 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fdf96-5af6-4718-adf0-ad4df768b4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:46.539834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fdf96-5af6-4718-adf0-ad4df768b4a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:46.560535 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71ccf7-6ef9-4c99-88db-6f888becbf44 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:46.574759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:46.595294 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a3142-ee74-4bd7-a138-5e6c182a0e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:46.595916 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a3142-ee74-4bd7-a138-5e6c182a0e33 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:46.596198 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a3142-ee74-4bd7-a138-5e6c182a0e33 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:46.596471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a3142-ee74-4bd7-a138-5e6c182a0e33 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:46.597159 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a3142-ee74-4bd7-a138-5e6c182a0e33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:46.597464 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a3142-ee74-4bd7-a138-5e6c182a0e33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:46.599034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a3142-ee74-4bd7-a138-5e6c182a0e33 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:46.615681 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 325/649] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:46.615681 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a3142-ee74-4bd7-a138-5e6c182a0e33 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:46.618775 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fdf96-5af6-4718-adf0-ad4df768b4a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:46.620226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fdf96-5af6-4718-adf0-ad4df768b4a5 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:46.665687 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:46.722269 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a3142-ee74-4bd7-a138-5e6c182a0e33 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:46.734020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 325/650] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:46.734020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fdf96-5af6-4718-adf0-ad4df768b4a5 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:46.762700 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecd0e1-a15d-4b4e-abe6-3a4f41cbfa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:46.763261 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecd0e1-a15d-4b4e-abe6-3a4f41cbfa58 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:46.763544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecd0e1-a15d-4b4e-abe6-3a4f41cbfa58 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:46.763813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecd0e1-a15d-4b4e-abe6-3a4f41cbfa58 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:46.771098 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecd0e1-a15d-4b4e-abe6-3a4f41cbfa58 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:46.772545 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecd0e1-a15d-4b4e-abe6-3a4f41cbfa58 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:46.784532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-71ecd0e1-a15d-4b4e-abe6-3a4f41cbfa58 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 14:40:46.784532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:46.784532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:46.784532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:46.784532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:46.784532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:46.784532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:46.784532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:46.784532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:46.784532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:46.784532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:46.784532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:46.784532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:46.784532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:46.784532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:46.784532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:46.785494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:46.785494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:46.785494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:46.785494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:46.785494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:46.785494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:46.785494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:46.785494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:46.785494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:46.785494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:46.785494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:46.785494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:46.785494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:46.785494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:46.785494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:46.785494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:46.785494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:46.785494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:46.787015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:46.787015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:46.787015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:46.787015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:46.787015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:46.787015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:46.787015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:46.787015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:46.787015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 14:40:46.787015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:46.787015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 326/651] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:46.787620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecd0e1-a15d-4b4e-abe6-3a4f41cbfa58 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:46.824846 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:46.843086 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fdf96-5af6-4718-adf0-ad4df768b4a5 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:46.878337 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10e662-90a6-4fbd-84a5-8e0e87976b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:46.879016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10e662-90a6-4fbd-84a5-8e0e87976b55 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:46.879325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10e662-90a6-4fbd-84a5-8e0e87976b55 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:46.879607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10e662-90a6-4fbd-84a5-8e0e87976b55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:46.890328 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10e662-90a6-4fbd-84a5-8e0e87976b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:46.891816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10e662-90a6-4fbd-84a5-8e0e87976b55 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:46.894254 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:46.895883 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecd0e1-a15d-4b4e-abe6-3a4f41cbfa58 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:46.907177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-0a10e662-90a6-4fbd-84a5-8e0e87976b55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:46.907177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:46.907177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:46.907177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:46.907177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:46.907177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:46.907177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:46.907177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:46.907177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:46.907177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:46.907177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:46.907177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:46.907177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:46.907177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:46.907177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:46.908278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:46.908278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:46.908278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:46.908278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:46.908278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:46.908278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:46.908278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:46.908278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:46.908278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:46.908278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:46.908278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:46.908278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:46.908278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:46.908278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:46.908278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:46.908278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:46.908278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:46.909141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:46.909141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:46.909141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:46.909141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:46.909141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 326/652] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:46.909419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10e662-90a6-4fbd-84a5-8e0e87976b55 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:46.938792 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0f8cc-dcd6-4f75-bf93-f5d35f5b1aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:46.939436 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0f8cc-dcd6-4f75-bf93-f5d35f5b1aa0 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:46.939720 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0f8cc-dcd6-4f75-bf93-f5d35f5b1aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:46.939995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0f8cc-dcd6-4f75-bf93-f5d35f5b1aa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:46.947594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0f8cc-dcd6-4f75-bf93-f5d35f5b1aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:46.949084 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0f8cc-dcd6-4f75-bf93-f5d35f5b1aa0 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:46.960415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-31c0f8cc-dcd6-4f75-bf93-f5d35f5b1aa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:46.960415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:46.960415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:46.960415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:46.960415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:46.960415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:46.960415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:46.960415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:46.960415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:46.960415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:46.960415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:46.960415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:46.960415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:46.960415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:46.960415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:46.961438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:46.961438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:46.961438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:46.961438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:46.961438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:46.961438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:46.961438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:46.961438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:46.961438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:46.961438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:46.961438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:46.961438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:46.961438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:46.961438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:46.961438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:46.961438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:46.961438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:46.962286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:46.962286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:46.962286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:46.962286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:46.962286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:46.962286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:46.962286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:46.962286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:46.962286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 327/653] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:46.962825 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0f8cc-dcd6-4f75-bf93-f5d35f5b1aa0 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:47.027330 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10e662-90a6-4fbd-84a5-8e0e87976b55 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:47.062910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:47.065051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bdfd3-7a0b-4cb1-b23d-4721412e1489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:47.065662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bdfd3-7a0b-4cb1-b23d-4721412e1489 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:47.065944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bdfd3-7a0b-4cb1-b23d-4721412e1489 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:47.066220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bdfd3-7a0b-4cb1-b23d-4721412e1489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:47.070088 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0f8cc-dcd6-4f75-bf93-f5d35f5b1aa0 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:47.077823 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bdfd3-7a0b-4cb1-b23d-4721412e1489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:47.084900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bdfd3-7a0b-4cb1-b23d-4721412e1489 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:47.093660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-156bdfd3-7a0b-4cb1-b23d-4721412e1489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:47.093660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:47.093660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:47.093660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:47.093660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:47.093660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:47.093660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:47.093660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:47.093660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:47.093660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:47.093660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:47.093660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:47.093660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:47.093660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:47.093660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:47.094595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:47.094595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:47.094595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:47.094595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:47.094595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:47.094595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:47.094595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:47.094595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:47.094595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:47.094595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:47.094595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:47.094595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:47.094595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:47.094595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:47.094595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:47.094595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:47.094595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:47.095476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:47.095476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:47.095476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:47.095476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:47.095476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 327/654] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:47.095751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bdfd3-7a0b-4cb1-b23d-4721412e1489 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:47.113591 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f38386-29b3-420d-9776-ef9031a81aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:47.114193 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f38386-29b3-420d-9776-ef9031a81aac None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:47.114526 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f38386-29b3-420d-9776-ef9031a81aac None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:47.114804 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f38386-29b3-420d-9776-ef9031a81aac None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:47.115619 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f38386-29b3-420d-9776-ef9031a81aac None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:47.115929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f38386-29b3-420d-9776-ef9031a81aac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:47.117869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f38386-29b3-420d-9776-ef9031a81aac None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:47.135967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 328/655] 10.222.0.86 () {56 vars in 1139 bytes} [Tue Jul 26 14:40:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:47.136793 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f38386-29b3-420d-9776-ef9031a81aac None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:47.157934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:47.215021 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bdfd3-7a0b-4cb1-b23d-4721412e1489 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:47.246273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f38386-29b3-420d-9776-ef9031a81aac None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:47.251295 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910e64a-923c-468a-a82a-3cc315496105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:47.251923 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910e64a-923c-468a-a82a-3cc315496105 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:47.252206 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910e64a-923c-468a-a82a-3cc315496105 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:47.252483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910e64a-923c-468a-a82a-3cc315496105 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:47.253174 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910e64a-923c-468a-a82a-3cc315496105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:47.253481 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910e64a-923c-468a-a82a-3cc315496105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:47.255041 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910e64a-923c-468a-a82a-3cc315496105 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:47.267580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 328/656] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:47.268692 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910e64a-923c-468a-a82a-3cc315496105 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:47.283565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5709762-6e2c-4663-bf0b-5d79aff7ba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:47.284120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5709762-6e2c-4663-bf0b-5d79aff7ba3f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:47.284402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5709762-6e2c-4663-bf0b-5d79aff7ba3f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:47.284674 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5709762-6e2c-4663-bf0b-5d79aff7ba3f None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:47.285414 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5709762-6e2c-4663-bf0b-5d79aff7ba3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:47.285721 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5709762-6e2c-4663-bf0b-5d79aff7ba3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:47.287187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5709762-6e2c-4663-bf0b-5d79aff7ba3f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:47.298501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 329/657] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:47.299136 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5709762-6e2c-4663-bf0b-5d79aff7ba3f None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:47.313070 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:47.372326 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910e64a-923c-468a-a82a-3cc315496105 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:47.381524 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:47.398276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5709762-6e2c-4663-bf0b-5d79aff7ba3f None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:47.407331 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85080e83-a16a-4076-a1d3-308c1e1c193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:47.407949 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85080e83-a16a-4076-a1d3-308c1e1c193e None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:47.408232 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85080e83-a16a-4076-a1d3-308c1e1c193e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:47.408512 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85080e83-a16a-4076-a1d3-308c1e1c193e None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:47.409200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85080e83-a16a-4076-a1d3-308c1e1c193e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:47.409507 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85080e83-a16a-4076-a1d3-308c1e1c193e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:47.411066 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85080e83-a16a-4076-a1d3-308c1e1c193e None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:47.422118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 329/658] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:47.423326 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0408cf-2503-4739-b22f-f406f8a380c6 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:47.423617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0408cf-2503-4739-b22f-f406f8a380c6 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:47.423894 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0408cf-2503-4739-b22f-f406f8a380c6 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:47.425262 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 330/659] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:47.425798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0408cf-2503-4739-b22f-f406f8a380c6 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:47.436493 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e5002-8201-4db6-9e7c-9d72c4ba420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:47.437118 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e5002-8201-4db6-9e7c-9d72c4ba420b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:47.437402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e5002-8201-4db6-9e7c-9d72c4ba420b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:47.437681 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e5002-8201-4db6-9e7c-9d72c4ba420b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:47.506263 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e5002-8201-4db6-9e7c-9d72c4ba420b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:47.507745 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e5002-8201-4db6-9e7c-9d72c4ba420b None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:47.521601 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:47.529008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0408cf-2503-4739-b22f-f406f8a380c6 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:47.562699 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447a7a9-1095-4786-997c-cbf8f120d789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:47.563290 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a7a9-1095-4786-997c-cbf8f120d789 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:47.563533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a7a9-1095-4786-997c-cbf8f120d789 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:47.563806 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a7a9-1095-4786-997c-cbf8f120d789 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:47.572291 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447a7a9-1095-4786-997c-cbf8f120d789 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:47.573744 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447a7a9-1095-4786-997c-cbf8f120d789 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:47.584967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-a447a7a9-1095-4786-997c-cbf8f120d789 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:40:47.584967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:47.584967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:47.584967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:47.584967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:47.584967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:47.584967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:47.584967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:47.584967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:47.584967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:47.584967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:47.584967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:47.584967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:47.584967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:47.584967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:47.584967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:47.586024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:47.586024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:47.586024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:47.586024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:47.586024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:47.586024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:47.586024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:47.586024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:47.586024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:47.586024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:47.586024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:47.586024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:47.586024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:47.586024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:47.586024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:47.586024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:47.586024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:47.586024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:47.587369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:47.587369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:47.587369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:47.587369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:47.587369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:47.587369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:47.587369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:47.587369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:47.587369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:40:47.587369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:47.587369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 331/660] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:47.587369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447a7a9-1095-4786-997c-cbf8f120d789 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:47.613335 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 330/661] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:47.614183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e5002-8201-4db6-9e7c-9d72c4ba420b None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:47.619519 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:47.692620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447a7a9-1095-4786-997c-cbf8f120d789 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:47.715079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e5002-8201-4db6-9e7c-9d72c4ba420b None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:47.725777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cbc20-c995-48e2-a594-3414f90fa490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:47.726407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cbc20-c995-48e2-a594-3414f90fa490 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:47.726716 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cbc20-c995-48e2-a594-3414f90fa490 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:47.727565 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cbc20-c995-48e2-a594-3414f90fa490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:47.728386 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cbc20-c995-48e2-a594-3414f90fa490 None admin] RBAC: Adding query filter params (role.id=7f17a5a0295f42e793e343cff968367c, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=d12fc26e640f4337b4a4da60cc4d9adc) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:47.728699 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cbc20-c995-48e2-a594-3414f90fa490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:47.728812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:47.730122 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cbc20-c995-48e2-a594-3414f90fa490 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:47.735816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 332/662] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:47 2022] GET /identity/v3/role_assignments?user.id=d12fc26e640f4337b4a4da60cc4d9adc&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=7f17a5a0295f42e793e343cff968367c => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:47.736977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe6b8a-02dc-4cda-a9e5-b644a9b8cd4e None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:47.742645 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe6b8a-02dc-4cda-a9e5-b644a9b8cd4e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:47.742645 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe6b8a-02dc-4cda-a9e5-b644a9b8cd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:47.753552 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b009f-7d3a-4415-af42-8880faddf9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:47.754460 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b009f-7d3a-4415-af42-8880faddf9d2 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:47.754744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b009f-7d3a-4415-af42-8880faddf9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:47.755015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b009f-7d3a-4415-af42-8880faddf9d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:47.756963 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-fdbe6b8a-02dc-4cda-a9e5-b644a9b8cd4e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:47.758290 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-fdbe6b8a-02dc-4cda-a9e5-b644a9b8cd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:47.763409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b009f-7d3a-4415-af42-8880faddf9d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:47.765669 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b009f-7d3a-4415-af42-8880faddf9d2 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:47.779973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-5d2b009f-7d3a-4415-af42-8880faddf9d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:47.779973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:47.779973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:47.779973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:47.779973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:47.779973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:47.779973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:47.779973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:47.779973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:47.779973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:47.779973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:47.779973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:47.779973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:47.779973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:47.779973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:47.780903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:47.780903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:47.780903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:47.780903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:47.780903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:47.780903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:47.780903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:47.780903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:47.780903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:47.780903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:47.780903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:47.780903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:47.780903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:47.780903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:47.780903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:47.780903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:47.780903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:47.781761 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:47.781761 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:47.781761 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:47.781761 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:47.781761 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:47.781761 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:47.781761 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:47.781761 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:47.783877 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 331/663] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:47.784593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b009f-7d3a-4415-af42-8880faddf9d2 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:47.840393 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 333/664] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:47.841001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe6b8a-02dc-4cda-a9e5-b644a9b8cd4e None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:47.869112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:47.926603 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b009f-7d3a-4415-af42-8880faddf9d2 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:47.962182 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe6b8a-02dc-4cda-a9e5-b644a9b8cd4e None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:47.969006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bfd23-147b-4ed5-a63f-b06429af8dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:47.969632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bfd23-147b-4ed5-a63f-b06429af8dd4 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:47.969917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bfd23-147b-4ed5-a63f-b06429af8dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:47.970640 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bfd23-147b-4ed5-a63f-b06429af8dd4 None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:47.971663 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bfd23-147b-4ed5-a63f-b06429af8dd4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:47.971766 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bfd23-147b-4ed5-a63f-b06429af8dd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:47.973512 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bfd23-147b-4ed5-a63f-b06429af8dd4 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:47.992709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 332/665] 10.222.0.86 () {56 vars in 1137 bytes} [Tue Jul 26 14:40:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:47.993567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bfd23-147b-4ed5-a63f-b06429af8dd4 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:48.003527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f922b-a7ce-4d0d-ac73-722e9d1168c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:48.004255 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f922b-a7ce-4d0d-ac73-722e9d1168c1 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:48.004631 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f922b-a7ce-4d0d-ac73-722e9d1168c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:48.004904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f922b-a7ce-4d0d-ac73-722e9d1168c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:48.016104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f922b-a7ce-4d0d-ac73-722e9d1168c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:48.017535 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f922b-a7ce-4d0d-ac73-722e9d1168c1 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:48.026105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:48.033426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-954f922b-a7ce-4d0d-ac73-722e9d1168c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:48.033426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:48.033426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:48.033426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:48.033426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:48.033426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:48.033426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:48.033426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:48.033426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:48.033426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:48.033426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:48.033426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:48.033426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:48.033426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:48.033426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:48.034366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:48.034366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:48.034366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:48.034366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:48.034366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:48.034366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:48.034366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:48.034366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:48.034366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:48.034366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:48.034366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:48.034366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:48.034366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:48.034366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:48.034366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:48.034366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:48.034366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:48.035510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:48.035510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:48.035510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:48.035510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:48.038435 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 334/666] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:48.039509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f922b-a7ce-4d0d-ac73-722e9d1168c1 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:48.101535 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bfd23-147b-4ed5-a63f-b06429af8dd4 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:48.117026 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:48.139668 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2659dd-1774-49a0-9b84-d3ec1dbda1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:48.140843 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2659dd-1774-49a0-9b84-d3ec1dbda1bf None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:48.141235 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2659dd-1774-49a0-9b84-d3ec1dbda1bf None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:48.141514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2659dd-1774-49a0-9b84-d3ec1dbda1bf None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:48.142266 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2659dd-1774-49a0-9b84-d3ec1dbda1bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:48.142615 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f922b-a7ce-4d0d-ac73-722e9d1168c1 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:48.142735 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2659dd-1774-49a0-9b84-d3ec1dbda1bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:48.144204 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2659dd-1774-49a0-9b84-d3ec1dbda1bf None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:48.160281 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 333/667] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:48.160963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2659dd-1774-49a0-9b84-d3ec1dbda1bf None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:48.182970 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135f839-b018-48c4-9527-800e0ff5413c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:48.183995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135f839-b018-48c4-9527-800e0ff5413c None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:48.184583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135f839-b018-48c4-9527-800e0ff5413c None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:48.184937 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135f839-b018-48c4-9527-800e0ff5413c None admin] PATH_INFO: `/v3/roles/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:48.197132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135f839-b018-48c4-9527-800e0ff5413c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:48.202655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-f135f839-b018-48c4-9527-800e0ff5413c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:48.202655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:48.202655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:48.202655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:48.202655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:48.202655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:48.202655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:48.202655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:48.202655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:48.202655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:48.202655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:48.202655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:48.202655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:48.202655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:48.202655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:48.202655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:48.203580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:48.203580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:48.203580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:48.203580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:48.203580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:48.203580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:48.203580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:48.203580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:48.203580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:48.203580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:48.203580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:48.203580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:48.203580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:48.203580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:48.203580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:48.203580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:48.204403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:48.204403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:48.204403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:48.204403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:48.204403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:48.204403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:48.204403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:48.204403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:48.204403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:48.204403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:48.204403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:48.204403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:48.208691 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 335/668] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:48.209627 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135f839-b018-48c4-9527-800e0ff5413c None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:48.256853 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:48.272484 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2659dd-1774-49a0-9b84-d3ec1dbda1bf None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:48.312704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28860596-0d59-424b-93d7-5274687a0a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:48.313088 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28860596-0d59-424b-93d7-5274687a0a5e None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:48.313378 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28860596-0d59-424b-93d7-5274687a0a5e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:48.313664 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28860596-0d59-424b-93d7-5274687a0a5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:48.319049 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135f839-b018-48c4-9527-800e0ff5413c None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:48.355610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cba21-6032-4264-b672-e8c8c37461ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:48.356149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cba21-6032-4264-b672-e8c8c37461ac None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:48.356436 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cba21-6032-4264-b672-e8c8c37461ac None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:48.356725 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cba21-6032-4264-b672-e8c8c37461ac None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:48.357406 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cba21-6032-4264-b672-e8c8c37461ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:48.357713 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cba21-6032-4264-b672-e8c8c37461ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:48.359121 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cba21-6032-4264-b672-e8c8c37461ac None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:48.360750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:48.376535 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 336/669] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:48.376535 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cba21-6032-4264-b672-e8c8c37461ac None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:48.395128 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28860596-0d59-424b-93d7-5274687a0a5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:48.396589 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28860596-0d59-424b-93d7-5274687a0a5e None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:48.475127 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cba21-6032-4264-b672-e8c8c37461ac None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:48.492898 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:48.504489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 334/670] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:48.505527 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28860596-0d59-424b-93d7-5274687a0a5e None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:48.516953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed83474-98f6-4b82-87ed-db7b16563741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:48.517578 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed83474-98f6-4b82-87ed-db7b16563741 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:48.517868 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed83474-98f6-4b82-87ed-db7b16563741 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:48.518152 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed83474-98f6-4b82-87ed-db7b16563741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:48.518990 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed83474-98f6-4b82-87ed-db7b16563741 None admin] RBAC: Adding query filter params (role.id=7f17a5a0295f42e793e343cff968367c, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=aa31ecab10a6499f92da49bc7abb403a) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:48.519307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed83474-98f6-4b82-87ed-db7b16563741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:48.520820 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed83474-98f6-4b82-87ed-db7b16563741 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:48.527405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 337/671] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:48 2022] GET /identity/v3/role_assignments?user.id=aa31ecab10a6499f92da49bc7abb403a&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=7f17a5a0295f42e793e343cff968367c => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:48.528237 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed83474-98f6-4b82-87ed-db7b16563741 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:48.617193 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:48.646574 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28860596-0d59-424b-93d7-5274687a0a5e None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:48.681077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed83474-98f6-4b82-87ed-db7b16563741 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:48.703815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a745d80-5596-4e21-bbc6-9ee50688b799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:48.704806 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a745d80-5596-4e21-bbc6-9ee50688b799 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:48.705305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a745d80-5596-4e21-bbc6-9ee50688b799 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:48.705815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a745d80-5596-4e21-bbc6-9ee50688b799 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:48.706793 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a745d80-5596-4e21-bbc6-9ee50688b799 None admin] RBAC: Adding query filter params (name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:48.707306 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a745d80-5596-4e21-bbc6-9ee50688b799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:48.708945 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a745d80-5596-4e21-bbc6-9ee50688b799 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:48.719605 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 335/672] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:40:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:48.721144 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa474c-218d-49ad-b5c8-5f064ddc6734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:48.721897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa474c-218d-49ad-b5c8-5f064ddc6734 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:48.722238 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa474c-218d-49ad-b5c8-5f064ddc6734 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:48.722588 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa474c-218d-49ad-b5c8-5f064ddc6734 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:48.725775 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a745d80-5596-4e21-bbc6-9ee50688b799 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:48.731289 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa474c-218d-49ad-b5c8-5f064ddc6734 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:48.732942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa474c-218d-49ad-b5c8-5f064ddc6734 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:48.746468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-3daa474c-218d-49ad-b5c8-5f064ddc6734 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:48.746468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:48.746468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:48.746468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:48.746468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:48.746468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:48.746468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:48.746468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:48.746468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:48.746468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:48.746468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:48.746468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:48.746468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:48.746468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:48.746468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:48.747440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:48.747440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:48.747440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:48.747440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:48.747440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:48.747440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:48.747440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:48.747440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:48.747440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:48.747440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:48.747440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:48.747440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:48.747440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:48.747440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:48.747440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:48.747440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:48.747440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:48.748303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:48.748303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:48.748303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:48.748303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:48.748303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:48.748303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:48.748303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:48.748303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:48.750611 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 338/673] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:48.752011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa474c-218d-49ad-b5c8-5f064ddc6734 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:48.785683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:48.843887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a745d80-5596-4e21-bbc6-9ee50688b799 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:48.884487 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa474c-218d-49ad-b5c8-5f064ddc6734 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:48.884899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce02d2-7748-4c34-94d4-7f9a405e86b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:48.885554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce02d2-7748-4c34-94d4-7f9a405e86b0 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:48.885843 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce02d2-7748-4c34-94d4-7f9a405e86b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:48.886123 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce02d2-7748-4c34-94d4-7f9a405e86b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:48.898897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce02d2-7748-4c34-94d4-7f9a405e86b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:48.900367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce02d2-7748-4c34-94d4-7f9a405e86b0 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:48.907077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:48.916778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-46ce02d2-7748-4c34-94d4-7f9a405e86b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:48.916778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:48.916778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:48.916778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:48.916778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:48.916778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:48.916778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:48.916778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:48.916778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:48.916778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:48.916778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:48.916778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:48.916778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:48.916778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:48.916778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:48.925278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:48.925278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:48.925278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:48.925278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:48.925278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:48.925278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:48.925278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:48.925278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:48.925278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:48.925278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:48.925278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:48.925278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:48.925278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:48.925278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:48.925278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:48.925278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:48.925278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:48.926909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:48.926909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:48.926909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:48.926909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:48.926909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 336/674] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:48.926909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce02d2-7748-4c34-94d4-7f9a405e86b0 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:48.937179 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b63421-b41f-440e-aa13-178cec332f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:48.938777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b63421-b41f-440e-aa13-178cec332f45 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:48.939348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b63421-b41f-440e-aa13-178cec332f45 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:48.939927 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b63421-b41f-440e-aa13-178cec332f45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:48.956570 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b63421-b41f-440e-aa13-178cec332f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:48.958739 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b63421-b41f-440e-aa13-178cec332f45 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:48.978906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-c0b63421-b41f-440e-aa13-178cec332f45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:48.978906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:48.978906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:48.978906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:48.978906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:48.978906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:48.978906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:48.978906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:48.978906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:48.978906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:48.978906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:48.978906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:48.978906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:48.978906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:48.978906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:48.980003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:48.980003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:48.980003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:48.980003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:48.980003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:48.980003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:48.980003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:48.980003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:48.980003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:48.980003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:48.980003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:48.980003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:48.980003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:48.980003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:48.980003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:48.980003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:48.980003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:48.981071 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:48.981071 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:48.981071 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:48.981071 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:48.982208 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 339/675] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:48.987420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b63421-b41f-440e-aa13-178cec332f45 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:49.046596 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce02d2-7748-4c34-94d4-7f9a405e86b0 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:49.050447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:49.095213 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f6ca2-30a6-4496-8003-ecc9867c8bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:49.096077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6ca2-30a6-4496-8003-ecc9867c8bd4 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:49.096503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6ca2-30a6-4496-8003-ecc9867c8bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:49.096920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6ca2-30a6-4496-8003-ecc9867c8bd4 None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:49.097303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b63421-b41f-440e-aa13-178cec332f45 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:49.098193 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f6ca2-30a6-4496-8003-ecc9867c8bd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:49.098675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f6ca2-30a6-4496-8003-ecc9867c8bd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:49.101415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f6ca2-30a6-4496-8003-ecc9867c8bd4 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:49.123177 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 337/676] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:49.123490 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f6ca2-30a6-4496-8003-ecc9867c8bd4 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:49.139986 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1c659-83a4-4633-9c23-6cf006343db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:49.140575 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1c659-83a4-4633-9c23-6cf006343db8 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:49.140863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1c659-83a4-4633-9c23-6cf006343db8 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:49.141436 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1c659-83a4-4633-9c23-6cf006343db8 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:49.141939 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1c659-83a4-4633-9c23-6cf006343db8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:49.142254 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1c659-83a4-4633-9c23-6cf006343db8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:49.143669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1c659-83a4-4633-9c23-6cf006343db8 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:49.156846 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 340/677] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:49.157763 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1c659-83a4-4633-9c23-6cf006343db8 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:49.190637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:49.254916 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f6ca2-30a6-4496-8003-ecc9867c8bd4 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:49.279251 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1c659-83a4-4633-9c23-6cf006343db8 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:49.291886 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99853e-d3d4-4fdc-a80b-d9f53dd13ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:49.292592 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99853e-d3d4-4fdc-a80b-d9f53dd13ed2 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:49.292975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99853e-d3d4-4fdc-a80b-d9f53dd13ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:49.293428 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99853e-d3d4-4fdc-a80b-d9f53dd13ed2 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:49.294074 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99853e-d3d4-4fdc-a80b-d9f53dd13ed2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:49.294505 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99853e-d3d4-4fdc-a80b-d9f53dd13ed2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:49.295951 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99853e-d3d4-4fdc-a80b-d9f53dd13ed2 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:49.313279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 338/678] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:49.314265 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99853e-d3d4-4fdc-a80b-d9f53dd13ed2 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:49.324818 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a417fa-370e-498c-8605-35429d22c1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:49.325722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a417fa-370e-498c-8605-35429d22c1a5 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:49.326181 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a417fa-370e-498c-8605-35429d22c1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:49.327143 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a417fa-370e-498c-8605-35429d22c1a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:49.328152 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a417fa-370e-498c-8605-35429d22c1a5 None admin] RBAC: Adding query filter params (role.id=7f17a5a0295f42e793e343cff968367c, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=e71086ec00454e26b24337e0876bfe89) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:49.329033 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a417fa-370e-498c-8605-35429d22c1a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:49.330975 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a417fa-370e-498c-8605-35429d22c1a5 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:49.346634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 341/679] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:49 2022] GET /identity/v3/role_assignments?user.id=e71086ec00454e26b24337e0876bfe89&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=7f17a5a0295f42e793e343cff968367c => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:49.346634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a417fa-370e-498c-8605-35429d22c1a5 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:49.352970 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:49.528261 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99853e-d3d4-4fdc-a80b-d9f53dd13ed2 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:49.534827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:49.543449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a417fa-370e-498c-8605-35429d22c1a5 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:49.574135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546021eb-1545-4b33-a8d8-a21f28d6d5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:49.575179 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546021eb-1545-4b33-a8d8-a21f28d6d5ad None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:49.575661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546021eb-1545-4b33-a8d8-a21f28d6d5ad None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:49.576145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546021eb-1545-4b33-a8d8-a21f28d6d5ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:49.583827 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546021eb-1545-4b33-a8d8-a21f28d6d5ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:49.585541 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546021eb-1545-4b33-a8d8-a21f28d6d5ad None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:49.592313 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce22776-e2a3-4207-9bda-64e12636d8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:49.592977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce22776-e2a3-4207-9bda-64e12636d8d4 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:49.593264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce22776-e2a3-4207-9bda-64e12636d8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:49.593543 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce22776-e2a3-4207-9bda-64e12636d8d4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:49.601636 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce22776-e2a3-4207-9bda-64e12636d8d4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:49.602524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-546021eb-1545-4b33-a8d8-a21f28d6d5ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:49.602524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:49.602524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:49.602524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:49.602524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:49.602524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:49.602524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:49.602524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:49.602524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:49.602524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:49.602524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:49.602524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:49.602524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:49.602524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:49.602524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:49.603367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:49.603367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:49.603367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:49.603367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:49.603367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:49.603367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:49.603367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:49.603367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:49.603367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:49.603367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:49.603367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:49.603367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:49.603367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:49.603367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:49.603367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:49.603367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:49.603367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:49.604242 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:49.604242 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:49.604242 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:49.604242 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:49.604242 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:49.604242 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:49.604242 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:49.604242 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:49.604694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce22776-e2a3-4207-9bda-64e12636d8d4 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:49.606568 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 339/680] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:49.612200 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546021eb-1545-4b33-a8d8-a21f28d6d5ad None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:49.619697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-5ce22776-e2a3-4207-9bda-64e12636d8d4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:40:49.619697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:49.619697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:49.619697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:49.619697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:49.619697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:49.619697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:49.619697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:49.619697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:49.619697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:49.619697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:49.619697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:49.619697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:49.619697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:49.619697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:49.619697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:49.621015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:49.621015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:49.621015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:49.621015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:49.621015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:49.621015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:49.621015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:49.621015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:49.621015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:49.621015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:49.621015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:49.621015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:49.621015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:49.621015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:49.621015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:49.621015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:49.621015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:49.621015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:49.621918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:49.621918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:49.621918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:49.621918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:49.621918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:49.621918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:49.621918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:49.621918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:49.621918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:40:49.621918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:49.621918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 342/681] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:40:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:49.626981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce22776-e2a3-4207-9bda-64e12636d8d4 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:49.766636 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce22776-e2a3-4207-9bda-64e12636d8d4 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:49.798097 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:49.807747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6e778-86b7-4ca8-a8b7-0758e0357036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:49.808685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6e778-86b7-4ca8-a8b7-0758e0357036 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:49.810666 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6e778-86b7-4ca8-a8b7-0758e0357036 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:49.810666 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6e778-86b7-4ca8-a8b7-0758e0357036 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:49.810836 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6e778-86b7-4ca8-a8b7-0758e0357036 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:49.811042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6e778-86b7-4ca8-a8b7-0758e0357036 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:49.812653 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6e778-86b7-4ca8-a8b7-0758e0357036 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:49.834594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 343/682] 10.222.0.86 () {56 vars in 1135 bytes} [Tue Jul 26 14:40:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:49.841183 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6e778-86b7-4ca8-a8b7-0758e0357036 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:49.856755 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546021eb-1545-4b33-a8d8-a21f28d6d5ad None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:49.859275 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:49.905156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76adcd5-551b-448f-b13e-d87a0cd34447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:49.906066 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76adcd5-551b-448f-b13e-d87a0cd34447 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:49.906356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76adcd5-551b-448f-b13e-d87a0cd34447 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:49.906667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76adcd5-551b-448f-b13e-d87a0cd34447 None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:49.907685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76adcd5-551b-448f-b13e-d87a0cd34447 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:49.908397 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76adcd5-551b-448f-b13e-d87a0cd34447 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:49.909877 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76adcd5-551b-448f-b13e-d87a0cd34447 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:49.927890 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 340/683] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:49.930609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28431631-6d4e-4de2-8403-ba869469aca3 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:49.931147 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28431631-6d4e-4de2-8403-ba869469aca3 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:49.931147 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28431631-6d4e-4de2-8403-ba869469aca3 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:49.932995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 341/684] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:49.937856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28431631-6d4e-4de2-8403-ba869469aca3 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:49.974534 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6e778-86b7-4ca8-a8b7-0758e0357036 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:50.022434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540791e-14d4-4dd8-8bcb-4883a9e64a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:50.023603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540791e-14d4-4dd8-8bcb-4883a9e64a21 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:50.023959 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540791e-14d4-4dd8-8bcb-4883a9e64a21 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:50.024580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540791e-14d4-4dd8-8bcb-4883a9e64a21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:50.048342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28431631-6d4e-4de2-8403-ba869469aca3 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:50.090497 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62d2d9-f0d9-45ed-9c71-bf219668b00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:50.091133 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62d2d9-f0d9-45ed-9c71-bf219668b00f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:50.091422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62d2d9-f0d9-45ed-9c71-bf219668b00f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:50.091706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62d2d9-f0d9-45ed-9c71-bf219668b00f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:50.092616 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62d2d9-f0d9-45ed-9c71-bf219668b00f None admin] RBAC: Adding query filter params (role.id=7f17a5a0295f42e793e343cff968367c, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=6f495077bafd4fd18cc682fe0a6b7f8c) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:50.093412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62d2d9-f0d9-45ed-9c71-bf219668b00f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:50.101550 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62d2d9-f0d9-45ed-9c71-bf219668b00f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:50.107658 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 342/685] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:49 2022] GET /identity/v3/role_assignments?user.id=6f495077bafd4fd18cc682fe0a6b7f8c&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=7f17a5a0295f42e793e343cff968367c => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:50.108970 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f3c43-8d37-40a6-b9bf-f122efa2d2d0 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:50.109261 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f3c43-8d37-40a6-b9bf-f122efa2d2d0 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:50.109531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f3c43-8d37-40a6-b9bf-f122efa2d2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:50.118024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540791e-14d4-4dd8-8bcb-4883a9e64a21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:50.119940 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540791e-14d4-4dd8-8bcb-4883a9e64a21 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:50.134322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-ca0f3c43-8d37-40a6-b9bf-f122efa2d2d0 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:50.135596 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ca0f3c43-8d37-40a6-b9bf-f122efa2d2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:50.138238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:50.141657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:50.218734 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 343/686] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:50.238443 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f3c43-8d37-40a6-b9bf-f122efa2d2d0 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:50.261963 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 344/687] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:50.268180 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540791e-14d4-4dd8-8bcb-4883a9e64a21 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:50.394694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540791e-14d4-4dd8-8bcb-4883a9e64a21 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:50.417764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:50.446345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8344fd-ed32-4691-8598-b3df22c31dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:50.446958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f3c43-8d37-40a6-b9bf-f122efa2d2d0 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:50.447567 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8344fd-ed32-4691-8598-b3df22c31dea None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:50.448032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8344fd-ed32-4691-8598-b3df22c31dea None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:50.448489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8344fd-ed32-4691-8598-b3df22c31dea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:50.462713 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8344fd-ed32-4691-8598-b3df22c31dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:50.464805 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8344fd-ed32-4691-8598-b3df22c31dea None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:50.484624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-bf8344fd-ed32-4691-8598-b3df22c31dea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:50.484624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:50.484624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:50.484624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:50.484624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:50.484624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:50.484624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:50.484624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:50.484624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:50.484624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:50.484624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:50.484624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:50.484624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:50.484624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:50.484624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:50.485538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:50.485538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:50.485538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:50.485538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:50.485538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:50.485538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:50.485538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:50.485538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:50.485538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:50.485538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:50.485538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:50.485538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:50.485538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:50.485538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:50.485538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:50.485538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:50.485538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:50.486460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:50.486460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:50.486460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:50.486460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:50.487901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 345/688] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:50.495050 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8344fd-ed32-4691-8598-b3df22c31dea None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:50.508729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33b22f-509c-4b2b-928c-683280375c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:50.509723 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33b22f-509c-4b2b-928c-683280375c73 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:50.510241 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33b22f-509c-4b2b-928c-683280375c73 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:50.510805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33b22f-509c-4b2b-928c-683280375c73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:50.523045 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:50.525321 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33b22f-509c-4b2b-928c-683280375c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:50.530995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-2e33b22f-509c-4b2b-928c-683280375c73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:50.530995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:50.530995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:50.530995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:50.530995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:50.530995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:50.530995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:50.530995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:50.530995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:50.530995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:50.530995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:50.530995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:50.530995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:50.530995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:50.530995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:50.530995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:50.538199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:50.538199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:50.538199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:50.538199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:50.538199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:50.538199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:50.538199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:50.538199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:50.538199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:50.538199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:50.538199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:50.538199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:50.538199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:50.538199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:50.538199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:50.538199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:50.539144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:50.539144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:50.539144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:50.539144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:50.539144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:50.539144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:50.539144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:50.539144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:50.539144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:50.539144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:50.539144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:50.539144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:50.539144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 344/689] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:40:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:50.545163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33b22f-509c-4b2b-928c-683280375c73 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:50.619496 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8344fd-ed32-4691-8598-b3df22c31dea None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:50.657029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26267062-c5e5-43f1-9814-3b667a849ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:50.657638 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26267062-c5e5-43f1-9814-3b667a849ed3 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:50.657847 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26267062-c5e5-43f1-9814-3b667a849ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:50.658115 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26267062-c5e5-43f1-9814-3b667a849ed3 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:50.658844 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26267062-c5e5-43f1-9814-3b667a849ed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:50.659149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26267062-c5e5-43f1-9814-3b667a849ed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:50.660519 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26267062-c5e5-43f1-9814-3b667a849ed3 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:50.694675 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 346/690] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:50.702499 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26267062-c5e5-43f1-9814-3b667a849ed3 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:50.714075 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33b22f-509c-4b2b-928c-683280375c73 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:50.746758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:50.799219 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbb0d3-58d4-4bfb-89ed-1b703a3bfc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:50.800037 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb0d3-58d4-4bfb-89ed-1b703a3bfc56 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:50.800513 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb0d3-58d4-4bfb-89ed-1b703a3bfc56 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:50.800890 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb0d3-58d4-4bfb-89ed-1b703a3bfc56 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:50.801671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbb0d3-58d4-4bfb-89ed-1b703a3bfc56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:50.802086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbb0d3-58d4-4bfb-89ed-1b703a3bfc56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:50.803622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbb0d3-58d4-4bfb-89ed-1b703a3bfc56 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:50.815804 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 345/691] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:50.819219 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbb0d3-58d4-4bfb-89ed-1b703a3bfc56 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:50.893496 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26267062-c5e5-43f1-9814-3b667a849ed3 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:50.929863 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:50.946931 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544320e-8d52-455b-8e7c-22990d5a128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:50.947849 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544320e-8d52-455b-8e7c-22990d5a128a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:50.948284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544320e-8d52-455b-8e7c-22990d5a128a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:50.948707 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544320e-8d52-455b-8e7c-22990d5a128a None admin] PATH_INFO: `/v3/projects/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:50.958564 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544320e-8d52-455b-8e7c-22990d5a128a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:50.960701 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544320e-8d52-455b-8e7c-22990d5a128a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:50.978856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbb0d3-58d4-4bfb-89ed-1b703a3bfc56 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:51.018291 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444a7a5-f4ed-4f33-9a2d-de61c82e7ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:51.019258 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444a7a5-f4ed-4f33-9a2d-de61c82e7ebe None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:51.019694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444a7a5-f4ed-4f33-9a2d-de61c82e7ebe None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:51.020122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444a7a5-f4ed-4f33-9a2d-de61c82e7ebe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:51.034108 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444a7a5-f4ed-4f33-9a2d-de61c82e7ebe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:51.035890 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444a7a5-f4ed-4f33-9a2d-de61c82e7ebe None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:51.052733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-c444a7a5-f4ed-4f33-9a2d-de61c82e7ebe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:51.052733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:51.052733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:51.052733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:51.052733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:51.052733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:51.052733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:51.052733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:51.052733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:51.052733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:51.052733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:51.052733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:51.052733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:51.052733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:51.052733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:51.053864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:51.053864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:51.053864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:51.053864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:51.053864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:51.053864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:51.053864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:51.053864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:51.053864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:51.053864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:51.053864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:51.053864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:51.053864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:51.053864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:51.053864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:51.053864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:51.053864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:51.054841 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:51.054841 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:51.054841 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:51.054841 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:51.056992 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 346/692] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:51.058561 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dff26-dfce-4bcc-aa27-648c3f97567c None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:51.059006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dff26-dfce-4bcc-aa27-648c3f97567c None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:51.059453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dff26-dfce-4bcc-aa27-648c3f97567c None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:51.061519 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 347/693] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:51.062535 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39dff26-dfce-4bcc-aa27-648c3f97567c None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:51.105112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-d544320e-8d52-455b-8e7c-22990d5a128a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:51.105112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:51.105112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:51.105112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:51.105112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:51.105112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:51.105112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:51.105112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:51.105112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:51.105112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:51.105112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:51.105112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:51.105112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:51.105112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:51.105112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:51.106252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:51.106252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:51.106252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:51.106252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:51.106252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:51.106252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:51.106252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:51.106252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:51.106252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:51.106252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:51.106252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:51.106252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:51.106252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:51.106252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:51.106252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:51.106252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:51.106252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:51.107408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:51.107408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:51.107408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:51.107408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:51.107408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:51.107408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:51.107408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:51.107408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:51.108816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 347/694] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:40:51.110083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38361c-4311-452f-93fa-b542fb76f143 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:51.110490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38361c-4311-452f-93fa-b542fb76f143 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:51.110862 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38361c-4311-452f-93fa-b542fb76f143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:51.129213 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-4f38361c-4311-452f-93fa-b542fb76f143 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:51.130642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4f38361c-4311-452f-93fa-b542fb76f143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:51.194141 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39dff26-dfce-4bcc-aa27-648c3f97567c None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:51.201598 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 348/695] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:51.202641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38361c-4311-452f-93fa-b542fb76f143 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:51.212592 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:51.219202 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:51.245677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c5b67-3bd1-4d3a-abe9-cc980d7730e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:51.246586 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c5b67-3bd1-4d3a-abe9-cc980d7730e8 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:51.247869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c5b67-3bd1-4d3a-abe9-cc980d7730e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:51.248306 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c5b67-3bd1-4d3a-abe9-cc980d7730e8 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:51.249687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c5b67-3bd1-4d3a-abe9-cc980d7730e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:51.250605 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c5b67-3bd1-4d3a-abe9-cc980d7730e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:51.252158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c5b67-3bd1-4d3a-abe9-cc980d7730e8 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:51.268541 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 348/696] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:51.269895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c5b67-3bd1-4d3a-abe9-cc980d7730e8 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:51.338705 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38361c-4311-452f-93fa-b542fb76f143 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:51.376888 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b6f53-cc21-427f-bfef-547c1e08b984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:51.377863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b6f53-cc21-427f-bfef-547c1e08b984 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:51.378336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b6f53-cc21-427f-bfef-547c1e08b984 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:51.378817 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b6f53-cc21-427f-bfef-547c1e08b984 None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:51.379778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b6f53-cc21-427f-bfef-547c1e08b984 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:51.380449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b6f53-cc21-427f-bfef-547c1e08b984 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:51.380933 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c5b67-3bd1-4d3a-abe9-cc980d7730e8 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:51.382452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b6f53-cc21-427f-bfef-547c1e08b984 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:51.395671 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 349/697] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:51.396945 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b6f53-cc21-427f-bfef-547c1e08b984 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:51.417940 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b869ab-9bb9-4ac6-89f2-dd3fa5dfd985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:51.418629 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b869ab-9bb9-4ac6-89f2-dd3fa5dfd985 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:51.419094 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b869ab-9bb9-4ac6-89f2-dd3fa5dfd985 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:51.419204 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b869ab-9bb9-4ac6-89f2-dd3fa5dfd985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:51.430902 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b869ab-9bb9-4ac6-89f2-dd3fa5dfd985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:51.432366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b869ab-9bb9-4ac6-89f2-dd3fa5dfd985 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:51.448285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-84b869ab-9bb9-4ac6-89f2-dd3fa5dfd985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:51.448285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:51.448285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:51.448285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:51.448285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:51.448285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:51.448285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:51.448285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:51.448285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:51.448285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:51.448285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:51.448285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:51.448285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:51.448285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:51.448285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:51.449171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:51.449171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:51.449171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:51.449171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:51.449171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:51.449171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:51.449171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:51.449171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:51.449171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:51.449171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:51.449171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:51.449171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:51.449171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:51.449171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:51.449171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:51.449171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:51.449171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:51.450682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:51.450682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:51.450682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:51.450682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:51.450682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 349/698] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:51.450682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b869ab-9bb9-4ac6-89f2-dd3fa5dfd985 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:51.480011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:51.485352 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:51.511829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b6f53-cc21-427f-bfef-547c1e08b984 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:51.548334 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33409751-cc7d-4d73-a757-bc51d769791c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:51.549442 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33409751-cc7d-4d73-a757-bc51d769791c None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:51.550040 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33409751-cc7d-4d73-a757-bc51d769791c None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:51.550553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33409751-cc7d-4d73-a757-bc51d769791c None admin] PATH_INFO: `/v3/users/nova` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:51.559188 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33409751-cc7d-4d73-a757-bc51d769791c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:51.560857 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b869ab-9bb9-4ac6-89f2-dd3fa5dfd985 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:51.561465 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33409751-cc7d-4d73-a757-bc51d769791c None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:51.575306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-33409751-cc7d-4d73-a757-bc51d769791c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:40:51.575306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:51.575306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:51.575306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:51.575306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:51.575306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:51.575306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:51.575306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:51.575306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:51.575306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:51.575306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:51.575306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:51.575306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:51.575306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:51.575306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:51.575306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:51.576288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:51.576288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:51.576288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:51.576288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:51.576288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:51.576288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:51.576288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:51.576288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:51.576288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:51.576288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:51.576288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:51.576288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:51.576288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:51.576288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:51.576288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:51.576288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:51.576288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:51.576288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:51.577226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:51.577226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:51.577226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:51.577226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:51.577226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:51.577226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:51.577226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:51.577226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:51.577226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:40:51.577226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:51.582457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 350/699] 10.222.0.86 () {56 vars in 1093 bytes} [Tue Jul 26 14:40:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:51.582457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33409751-cc7d-4d73-a757-bc51d769791c None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:51.598066 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c479217-2480-4a54-ba22-108ec007b516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:51.599079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c479217-2480-4a54-ba22-108ec007b516 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:51.599079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c479217-2480-4a54-ba22-108ec007b516 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:51.599271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c479217-2480-4a54-ba22-108ec007b516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:51.600056 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c479217-2480-4a54-ba22-108ec007b516 None admin] RBAC: Adding query filter params (role.id=7f17a5a0295f42e793e343cff968367c, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=462ecbb85c6b4a17a952fb74fa2de65e) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:51.600369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c479217-2480-4a54-ba22-108ec007b516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:51.602202 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c479217-2480-4a54-ba22-108ec007b516 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:51.608856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 350/700] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:51 2022] GET /identity/v3/role_assignments?user.id=462ecbb85c6b4a17a952fb74fa2de65e&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=7f17a5a0295f42e793e343cff968367c => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:51.609724 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c479217-2480-4a54-ba22-108ec007b516 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:51.719445 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33409751-cc7d-4d73-a757-bc51d769791c None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:51.765213 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3880d8-3c04-4976-a2b4-96184060142f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:51.766219 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3880d8-3c04-4976-a2b4-96184060142f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:51.766736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3880d8-3c04-4976-a2b4-96184060142f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:51.767218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3880d8-3c04-4976-a2b4-96184060142f None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:51.768149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3880d8-3c04-4976-a2b4-96184060142f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:51.768658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3880d8-3c04-4976-a2b4-96184060142f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:51.770243 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3880d8-3c04-4976-a2b4-96184060142f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:51.772069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:51.784515 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 351/701] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:51.786175 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18407d80-72d7-4923-84fe-23967d0e743e None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:51.786727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18407d80-72d7-4923-84fe-23967d0e743e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:51.787205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18407d80-72d7-4923-84fe-23967d0e743e None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:51.789054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 352/702] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:51.791238 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18407d80-72d7-4923-84fe-23967d0e743e None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:51.811682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:51.824443 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c479217-2480-4a54-ba22-108ec007b516 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:51.868375 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a55f0-ecb8-4110-9b6c-d175e8d84861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:51.869004 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a55f0-ecb8-4110-9b6c-d175e8d84861 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:51.869292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a55f0-ecb8-4110-9b6c-d175e8d84861 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:51.869565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a55f0-ecb8-4110-9b6c-d175e8d84861 None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:51.870366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a55f0-ecb8-4110-9b6c-d175e8d84861 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:51.870909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a55f0-ecb8-4110-9b6c-d175e8d84861 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:51.872153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a55f0-ecb8-4110-9b6c-d175e8d84861 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:51.892932 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 351/703] 10.222.0.86 () {56 vars in 1133 bytes} [Tue Jul 26 14:40:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:51.894293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed9b7e-264c-4fea-bb11-28ebd5b01e2e None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:51.894655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed9b7e-264c-4fea-bb11-28ebd5b01e2e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:51.895031 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed9b7e-264c-4fea-bb11-28ebd5b01e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:51.915323 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-30ed9b7e-264c-4fea-bb11-28ebd5b01e2e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:51.916642 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-30ed9b7e-264c-4fea-bb11-28ebd5b01e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:51.923167 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18407d80-72d7-4923-84fe-23967d0e743e None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:51.969804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ea00b-ff7f-4e63-8511-abfd41e39070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:51.970375 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ea00b-ff7f-4e63-8511-abfd41e39070 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:51.970692 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ea00b-ff7f-4e63-8511-abfd41e39070 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:51.970968 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ea00b-ff7f-4e63-8511-abfd41e39070 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:51.971659 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ea00b-ff7f-4e63-8511-abfd41e39070 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:51.973105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ea00b-ff7f-4e63-8511-abfd41e39070 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:52.006927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 352/704] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:52.008815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed9b7e-264c-4fea-bb11-28ebd5b01e2e None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:52.086591 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 353/705] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jul 26 14:40:51 2022] POST /identity/v3/users => generated 254 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:40:52.087788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ea00b-ff7f-4e63-8511-abfd41e39070 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:52.109735 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:52.145591 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed9b7e-264c-4fea-bb11-28ebd5b01e2e None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:52.197995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cd1bf-c293-460b-ba62-65e5d5b8de7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:52.199042 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cd1bf-c293-460b-ba62-65e5d5b8de7d None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:52.199742 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cd1bf-c293-460b-ba62-65e5d5b8de7d None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:52.200251 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cd1bf-c293-460b-ba62-65e5d5b8de7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:52.252606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:52.345576 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cd1bf-c293-460b-ba62-65e5d5b8de7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:52.347102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cd1bf-c293-460b-ba62-65e5d5b8de7d None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:52.361256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ea00b-ff7f-4e63-8511-abfd41e39070 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:52.405153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7921d-e0fc-4930-8f1e-8b9480eab795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:52.405832 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7921d-e0fc-4930-8f1e-8b9480eab795 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:52.406123 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7921d-e0fc-4930-8f1e-8b9480eab795 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:52.406364 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7921d-e0fc-4930-8f1e-8b9480eab795 None admin] PATH_INFO: `/v3/services/network` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:52.407032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7921d-e0fc-4930-8f1e-8b9480eab795 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:52.408572 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7921d-e0fc-4930-8f1e-8b9480eab795 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:52.422637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-2ac7921d-e0fc-4930-8f1e-8b9480eab795 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:40:52.422637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:52.422637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:40:52.422637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:40:52.422637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:40:52.422637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:40:52.422637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:40:52.422637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:40:52.422637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:40:52.422637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:52.422637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:40:52.422637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:52.422637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:52.422637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:52.422637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:52.422637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:52.422637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:52.424053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:52.424053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:52.424053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:52.424053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:52.424053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:52.424053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:52.424053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:40:52.424053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:40:52.424053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:40:52.424053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:40:52.424053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:52.424053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:52.424053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:52.424053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:52.424053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:52.424053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:52.424854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:52.424854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:52.424854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:52.424854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:52.424854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:52.424854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:52.424854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:52.424854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:52.424854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:52.424854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:52.424854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:40:52.424854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:40:52.424854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:40:52.424854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:52.428754 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 354/706] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:52 2022] GET /identity/v3/services/network => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:52.430596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7921d-e0fc-4930-8f1e-8b9480eab795 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:52.480837 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:52.519503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 353/707] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:52.525258 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cd1bf-c293-460b-ba62-65e5d5b8de7d None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:52.572467 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7921d-e0fc-4930-8f1e-8b9480eab795 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:52.590829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:52.629519 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c27d4-096e-4315-8bc4-b7e979b993d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:52.630809 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c27d4-096e-4315-8bc4-b7e979b993d0 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:52.631998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c27d4-096e-4315-8bc4-b7e979b993d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:52.632724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c27d4-096e-4315-8bc4-b7e979b993d0 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:52.633843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c27d4-096e-4315-8bc4-b7e979b993d0 None admin] RBAC: Adding query filter params (name=network) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:52.634438 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c27d4-096e-4315-8bc4-b7e979b993d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:52.636313 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c27d4-096e-4315-8bc4-b7e979b993d0 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:52.648329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 355/708] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jul 26 14:40:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:52.659457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c27d4-096e-4315-8bc4-b7e979b993d0 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:52.697497 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cd1bf-c293-460b-ba62-65e5d5b8de7d None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:52.743713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403703f-69ca-4c52-a91f-fdedc842bf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:52.744459 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403703f-69ca-4c52-a91f-fdedc842bf8d None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:52.744771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403703f-69ca-4c52-a91f-fdedc842bf8d None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:52.745192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403703f-69ca-4c52-a91f-fdedc842bf8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:52.758425 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2403703f-69ca-4c52-a91f-fdedc842bf8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:52.759071 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2403703f-69ca-4c52-a91f-fdedc842bf8d None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:52.775531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-2403703f-69ca-4c52-a91f-fdedc842bf8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:52.775531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:52.775531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:52.775531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:52.775531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:52.775531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:52.775531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:52.775531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:52.775531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:52.775531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:52.775531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:52.775531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:52.775531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:52.775531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:52.775531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:52.776900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:52.776900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:52.776900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:52.776900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:52.776900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:52.776900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:52.776900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:52.776900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:52.776900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:52.776900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:52.776900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:52.776900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:52.776900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:52.776900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:52.776900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:52.776900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:52.776900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:52.778732 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:52.778732 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:52.778732 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:52.778732 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:52.778732 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 354/709] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:52.778732 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f601b-4b90-4d21-8634-5d617595adea None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:52.778732 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f601b-4b90-4d21-8634-5d617595adea None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:52.779520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f601b-4b90-4d21-8634-5d617595adea None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:52.780383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 355/710] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:52.785375 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f601b-4b90-4d21-8634-5d617595adea None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:52.809259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c27d4-096e-4315-8bc4-b7e979b993d0 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:52.818565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:52.848359 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777f802-bd83-4e5b-b3c6-94a08d6a88ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:52.849849 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777f802-bd83-4e5b-b3c6-94a08d6a88ac None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:52.850314 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777f802-bd83-4e5b-b3c6-94a08d6a88ac None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:52.850861 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777f802-bd83-4e5b-b3c6-94a08d6a88ac None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:52.851923 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777f802-bd83-4e5b-b3c6-94a08d6a88ac None admin] RBAC: Adding query filter params (type=network) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:52.852413 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777f802-bd83-4e5b-b3c6-94a08d6a88ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:52.854126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777f802-bd83-4e5b-b3c6-94a08d6a88ac None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:52.861757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 356/711] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jul 26 14:40:52 2022] GET /identity/v3/services?type=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:52.863516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffd6ae-c19f-4e98-9b68-5b20531e66c8 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:52.863983 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffd6ae-c19f-4e98-9b68-5b20531e66c8 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:52.864429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffd6ae-c19f-4e98-9b68-5b20531e66c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:52.887992 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-ecffd6ae-c19f-4e98-9b68-5b20531e66c8 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:52.889709 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ecffd6ae-c19f-4e98-9b68-5b20531e66c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:52.934796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:52.972951 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 357/712] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:52.978925 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f601b-4b90-4d21-8634-5d617595adea None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:52.999695 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffd6ae-c19f-4e98-9b68-5b20531e66c8 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:53.034165 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa197b1-bc41-4740-8189-8a010ca7791f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:53.034165 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa197b1-bc41-4740-8189-8a010ca7791f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:53.034165 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa197b1-bc41-4740-8189-8a010ca7791f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:53.034165 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa197b1-bc41-4740-8189-8a010ca7791f None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:53.034590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa197b1-bc41-4740-8189-8a010ca7791f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:53.034590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa197b1-bc41-4740-8189-8a010ca7791f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:53.034590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa197b1-bc41-4740-8189-8a010ca7791f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:53.045543 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 356/713] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:53.055393 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa197b1-bc41-4740-8189-8a010ca7791f None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:53.159253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffd6ae-c19f-4e98-9b68-5b20531e66c8 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:53.203712 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac924ef-606b-4876-9cbf-00d0b30769c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:53.204362 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac924ef-606b-4876-9cbf-00d0b30769c2 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:53.204639 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac924ef-606b-4876-9cbf-00d0b30769c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:53.204909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac924ef-606b-4876-9cbf-00d0b30769c2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:53.205536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac924ef-606b-4876-9cbf-00d0b30769c2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:53.206934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac924ef-606b-4876-9cbf-00d0b30769c2 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:53.214729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:53.221795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-aac924ef-606b-4876-9cbf-00d0b30769c2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:40:53.221795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:53.221795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:40:53.221795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:40:53.221795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:40:53.221795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:40:53.221795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:40:53.221795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:40:53.221795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:40:53.221795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:53.221795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:40:53.221795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:53.221795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:53.221795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:53.221795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:53.221795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:53.222829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:53.222829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:53.222829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:53.222829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:53.222829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:53.222829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:53.222829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:53.222829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:40:53.222829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:40:53.222829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:40:53.222829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:40:53.222829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:53.222829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:53.222829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:53.222829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:53.222829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:53.223652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:53.223652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:53.223652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:53.223652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:53.223652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:53.223652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:53.223652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:53.223652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:53.223652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:53.223652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:53.223652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:53.223652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:40:53.223652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:40:53.223652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:40:53.223652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:53.227133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 358/714] 10.222.0.86 () {56 vars in 1129 bytes} [Tue Jul 26 14:40:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:53.239806 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa197b1-bc41-4740-8189-8a010ca7791f None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:53.244189 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac924ef-606b-4876-9cbf-00d0b30769c2 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:53.307974 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539e4be-da3d-4aae-8034-6d7f7c72009b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:53.309424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539e4be-da3d-4aae-8034-6d7f7c72009b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:53.310155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539e4be-da3d-4aae-8034-6d7f7c72009b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:53.310914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539e4be-da3d-4aae-8034-6d7f7c72009b None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:53.326955 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539e4be-da3d-4aae-8034-6d7f7c72009b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:53.329836 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539e4be-da3d-4aae-8034-6d7f7c72009b None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:53.340949 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:53.357135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-a539e4be-da3d-4aae-8034-6d7f7c72009b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:53.357135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:53.357135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:53.357135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:53.357135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:53.357135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:53.357135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:53.357135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:53.357135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:53.357135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:53.357135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:53.357135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:53.357135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:53.357135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:53.357135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:53.358260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:53.358260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:53.358260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:53.358260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:53.358260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:53.358260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:53.358260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:53.358260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:53.358260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:53.358260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:53.358260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:53.358260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:53.358260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:53.358260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:53.358260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:53.358260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:53.358260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:53.359404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:53.359404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:53.359404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:53.359404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:53.359404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:53.359404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:53.359404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:53.359404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:53.361952 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 357/715] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:40:53.368050 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539e4be-da3d-4aae-8034-6d7f7c72009b None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:53.485546 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539e4be-da3d-4aae-8034-6d7f7c72009b None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:53.489159 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac924ef-606b-4876-9cbf-00d0b30769c2 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:53.527229 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf5ff3-1bde-4584-acdd-b7804d92070d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:53.528294 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf5ff3-1bde-4584-acdd-b7804d92070d None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:53.528733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf5ff3-1bde-4584-acdd-b7804d92070d None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:53.529207 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf5ff3-1bde-4584-acdd-b7804d92070d None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:53.530181 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf5ff3-1bde-4584-acdd-b7804d92070d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:53.531038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf5ff3-1bde-4584-acdd-b7804d92070d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:53.532892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf5ff3-1bde-4584-acdd-b7804d92070d None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:53.550603 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 358/716] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:53.552587 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf5ff3-1bde-4584-acdd-b7804d92070d None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:53.565526 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:53.586299 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcbb26-b378-4860-b6af-47b60588c36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:53.586964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcbb26-b378-4860-b6af-47b60588c36f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:53.587244 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcbb26-b378-4860-b6af-47b60588c36f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:53.587519 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcbb26-b378-4860-b6af-47b60588c36f None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:53.588200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcbb26-b378-4860-b6af-47b60588c36f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:53.588505 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcbb26-b378-4860-b6af-47b60588c36f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:53.589882 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcbb26-b378-4860-b6af-47b60588c36f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:53.598419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 359/717] 10.222.0.86 () {56 vars in 1124 bytes} [Tue Jul 26 14:40:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:53.603473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcbb26-b378-4860-b6af-47b60588c36f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:53.721834 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf5ff3-1bde-4584-acdd-b7804d92070d None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:53.730952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:53.734083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcbb26-b378-4860-b6af-47b60588c36f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:53.779235 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4c2a3-e572-4b8e-b704-e4257fb3f404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:53.780034 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4c2a3-e572-4b8e-b704-e4257fb3f404 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:53.780331 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4c2a3-e572-4b8e-b704-e4257fb3f404 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:53.780635 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4c2a3-e572-4b8e-b704-e4257fb3f404 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:53.781386 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4c2a3-e572-4b8e-b704-e4257fb3f404 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:53.781700 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4c2a3-e572-4b8e-b704-e4257fb3f404 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:53.783203 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4c2a3-e572-4b8e-b704-e4257fb3f404 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:53.788673 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c6b27-ff25-4447-8ef1-cad3ac03ba87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:53.789342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c6b27-ff25-4447-8ef1-cad3ac03ba87 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:53.789701 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c6b27-ff25-4447-8ef1-cad3ac03ba87 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:53.789980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c6b27-ff25-4447-8ef1-cad3ac03ba87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:53.790798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c6b27-ff25-4447-8ef1-cad3ac03ba87 None admin] RBAC: Adding query filter params (role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=d12fc26e640f4337b4a4da60cc4d9adc) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:53.791114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c6b27-ff25-4447-8ef1-cad3ac03ba87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:53.792540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c6b27-ff25-4447-8ef1-cad3ac03ba87 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:53.793541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 360/718] 10.222.0.86 () {56 vars in 1124 bytes} [Tue Jul 26 14:40:53 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:53.802945 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 359/719] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:53 2022] GET /identity/v3/role_assignments?user.id=d12fc26e640f4337b4a4da60cc4d9adc&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:54.111791 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2060ac-6c97-4267-a753-0d9eb9cbea00 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:54.112328 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2060ac-6c97-4267-a753-0d9eb9cbea00 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:54.112328 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2060ac-6c97-4267-a753-0d9eb9cbea00 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:54.113984 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 361/720] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:54.119822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e2c19-1530-40fc-a26f-db00a5305e4a None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:54.120119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e2c19-1530-40fc-a26f-db00a5305e4a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:54.120408 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e2c19-1530-40fc-a26f-db00a5305e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:54.142723 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-2c3e2c19-1530-40fc-a26f-db00a5305e4a None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:54.143923 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2c3e2c19-1530-40fc-a26f-db00a5305e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:54.236034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 360/721] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:54.283940 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2060ac-6c97-4267-a753-0d9eb9cbea00 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:54.428496 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2060ac-6c97-4267-a753-0d9eb9cbea00 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:54.480055 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ab3f6-881c-4afb-89d5-13fc6768af28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:54.480725 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ab3f6-881c-4afb-89d5-13fc6768af28 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:54.481013 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ab3f6-881c-4afb-89d5-13fc6768af28 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:54.481292 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ab3f6-881c-4afb-89d5-13fc6768af28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:54.497195 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ab3f6-881c-4afb-89d5-13fc6768af28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:54.502373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-134ab3f6-881c-4afb-89d5-13fc6768af28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:54.502373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:54.502373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:54.502373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:54.502373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:54.502373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:54.502373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:54.502373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:54.502373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:54.502373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:54.502373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:54.502373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:54.502373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:54.502373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:54.502373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:54.502373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:54.503279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:54.503279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:54.503279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:54.503279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:54.503279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:54.503279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:54.503279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:54.503279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:54.503279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:54.503279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:54.503279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:54.503279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:54.503279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:54.503279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:54.503279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:54.503279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:54.504088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:54.504088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:54.504088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:54.504088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:54.504088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:54.504088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:54.504088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:54.504088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:54.504088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:54.504088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:54.504088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:54.504088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:54.505244 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 362/722] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:40:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:54.511506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e2c19-1530-40fc-a26f-db00a5305e4a None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:54.513722 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:54.670549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e2c19-1530-40fc-a26f-db00a5305e4a None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:54.735201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01636931-1c3f-4c21-8260-5b2008f75e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:54.735808 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01636931-1c3f-4c21-8260-5b2008f75e93 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:54.736043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01636931-1c3f-4c21-8260-5b2008f75e93 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:54.736310 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01636931-1c3f-4c21-8260-5b2008f75e93 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:54.737049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01636931-1c3f-4c21-8260-5b2008f75e93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:54.737357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01636931-1c3f-4c21-8260-5b2008f75e93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:54.738782 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01636931-1c3f-4c21-8260-5b2008f75e93 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:54.749854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 361/723] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:54.755470 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ab3f6-881c-4afb-89d5-13fc6768af28 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:54.781828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:54.870711 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ab3f6-881c-4afb-89d5-13fc6768af28 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:54.916679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07376c70-773b-490e-9c17-7ed2add82e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:54.917338 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07376c70-773b-490e-9c17-7ed2add82e36 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:54.917626 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07376c70-773b-490e-9c17-7ed2add82e36 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:54.917907 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07376c70-773b-490e-9c17-7ed2add82e36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:54.931547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07376c70-773b-490e-9c17-7ed2add82e36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:54.933008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07376c70-773b-490e-9c17-7ed2add82e36 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:54.953348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-07376c70-773b-490e-9c17-7ed2add82e36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:54.953348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:54.953348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:54.953348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:54.953348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:54.953348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:54.953348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:54.953348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:54.953348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:54.953348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:54.953348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:54.953348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:54.953348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:54.953348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:54.953348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:54.954808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:54.954808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:54.954808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:54.954808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:54.954808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:54.954808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:54.954808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:54.954808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:54.954808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:54.954808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:54.954808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:54.954808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:54.954808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:54.954808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:54.954808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:54.954808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:54.954808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:54.956372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:54.956372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:54.956372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:54.956372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:54.956372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 363/724] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:54.960546 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01636931-1c3f-4c21-8260-5b2008f75e93 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:54.979432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f288fe-baef-437e-b8f6-885564a53377 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:54.979838 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f288fe-baef-437e-b8f6-885564a53377 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:54.979981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f288fe-baef-437e-b8f6-885564a53377 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:54.981835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 364/725] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:40:54.986766 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406c707-de8e-489c-8e29-37c3c4ee9f21 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:54.987011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406c707-de8e-489c-8e29-37c3c4ee9f21 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:54.987240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406c707-de8e-489c-8e29-37c3c4ee9f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:55.008389 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-f406c707-de8e-489c-8e29-37c3c4ee9f21 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:55.009811 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f406c707-de8e-489c-8e29-37c3c4ee9f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:55.062067 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:55.089236 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 365/726] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:40:55.121716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01636931-1c3f-4c21-8260-5b2008f75e93 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:55.153939 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406c707-de8e-489c-8e29-37c3c4ee9f21 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:55.166722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:55.168148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7555500-9d8f-4a7e-a086-6298b812e5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:55.168835 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7555500-9d8f-4a7e-a086-6298b812e5db None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:55.169140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7555500-9d8f-4a7e-a086-6298b812e5db None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:55.169420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7555500-9d8f-4a7e-a086-6298b812e5db None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:55.170121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7555500-9d8f-4a7e-a086-6298b812e5db None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:55.170449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7555500-9d8f-4a7e-a086-6298b812e5db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:55.171877 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7555500-9d8f-4a7e-a086-6298b812e5db None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:55.193786 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 362/727] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:55.199522 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7555500-9d8f-4a7e-a086-6298b812e5db None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:55.284759 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406c707-de8e-489c-8e29-37c3c4ee9f21 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:55.331930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22941e85-c312-4091-8342-2c2a73ab4ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:55.333107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22941e85-c312-4091-8342-2c2a73ab4ca6 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:55.333617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22941e85-c312-4091-8342-2c2a73ab4ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:55.334128 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22941e85-c312-4091-8342-2c2a73ab4ca6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:55.349911 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22941e85-c312-4091-8342-2c2a73ab4ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:55.355569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-22941e85-c312-4091-8342-2c2a73ab4ca6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:55.355569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:55.355569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:55.355569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:55.355569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:55.355569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:55.355569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:55.355569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:55.355569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:55.355569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:55.355569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:55.355569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:55.355569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:55.355569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:55.355569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:55.355569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:55.356492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:55.356492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:55.356492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:55.356492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:55.356492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:55.356492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:55.356492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:55.356492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:55.356492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:55.356492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:55.356492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:55.356492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:55.356492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:55.356492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:55.356492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:55.356492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:55.357318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:55.357318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:55.357318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:55.357318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:55.357318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:55.357318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:55.357318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:55.357318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:55.357318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:55.357318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:55.357318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:40:55.357318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:55.357977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 366/728] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:40:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:55.363918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22941e85-c312-4091-8342-2c2a73ab4ca6 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:55.466573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:55.466772 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7555500-9d8f-4a7e-a086-6298b812e5db None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:55.494838 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:55.506833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f96575-f32a-4309-88c3-3a95abbcfff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:55.507534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f96575-f32a-4309-88c3-3a95abbcfff5 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:55.507882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f96575-f32a-4309-88c3-3a95abbcfff5 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:55.508164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f96575-f32a-4309-88c3-3a95abbcfff5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:55.517910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f96575-f32a-4309-88c3-3a95abbcfff5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:55.522720 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f96575-f32a-4309-88c3-3a95abbcfff5 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:55.526112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22941e85-c312-4091-8342-2c2a73ab4ca6 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:55.536423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-08f96575-f32a-4309-88c3-3a95abbcfff5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:40:55.536423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:55.536423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:55.536423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:55.536423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:55.536423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:55.536423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:55.536423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:55.536423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:55.536423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:55.536423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:55.536423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:55.536423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:55.536423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:55.536423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:55.536423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:55.537327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:55.537327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:55.537327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:55.537327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:55.537327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:55.537327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:55.537327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:55.537327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:55.537327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:55.537327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:55.537327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:55.537327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:55.537327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:55.537327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:55.537327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:55.537327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:55.537327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:55.537327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:55.538239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:55.538239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:55.538239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:55.538239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:55.538239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:55.538239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:55.538239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:55.538239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:55.538239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:40:55.538239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:55.538239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 363/729] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:40:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:40:55.540263 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1c780-0bf6-4d46-8499-23dc92b0b2ea None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:55.540618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1c780-0bf6-4d46-8499-23dc92b0b2ea None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:55.540968 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1c780-0bf6-4d46-8499-23dc92b0b2ea None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:55.546448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 364/730] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:55.547317 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1c780-0bf6-4d46-8499-23dc92b0b2ea None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:55.575327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01701255-9dcb-4df9-862c-ac97e5e3743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:55.576333 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01701255-9dcb-4df9-862c-ac97e5e3743d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:55.576814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01701255-9dcb-4df9-862c-ac97e5e3743d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:55.577361 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01701255-9dcb-4df9-862c-ac97e5e3743d None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:55.578238 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01701255-9dcb-4df9-862c-ac97e5e3743d None admin] RBAC: Adding query filter params (name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:55.578738 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01701255-9dcb-4df9-862c-ac97e5e3743d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:55.580458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01701255-9dcb-4df9-862c-ac97e5e3743d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:55.589212 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 367/731] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:40:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:55.594804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba829da-d66c-4a37-bc57-1b60e6557008 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:55.595297 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba829da-d66c-4a37-bc57-1b60e6557008 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:55.595749 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba829da-d66c-4a37-bc57-1b60e6557008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:55.615425 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-fba829da-d66c-4a37-bc57-1b60e6557008 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:55.616856 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-fba829da-d66c-4a37-bc57-1b60e6557008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:55.656630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1c780-0bf6-4d46-8499-23dc92b0b2ea None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:55.692799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb0846-3e6b-46bb-8c4e-9d48a306900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:55.693534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb0846-3e6b-46bb-8c4e-9d48a306900b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:55.694076 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb0846-3e6b-46bb-8c4e-9d48a306900b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:55.694187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb0846-3e6b-46bb-8c4e-9d48a306900b None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:55.695160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb0846-3e6b-46bb-8c4e-9d48a306900b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:55.695614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb0846-3e6b-46bb-8c4e-9d48a306900b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:55.697132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb0846-3e6b-46bb-8c4e-9d48a306900b None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:55.705748 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 368/732] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:55.706884 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba829da-d66c-4a37-bc57-1b60e6557008 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:55.725305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 365/733] 10.222.0.86 () {56 vars in 1135 bytes} [Tue Jul 26 14:40:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:55.731251 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb0846-3e6b-46bb-8c4e-9d48a306900b None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:55.770004 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:55.802776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:55.832535 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba829da-d66c-4a37-bc57-1b60e6557008 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:55.887425 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb0846-3e6b-46bb-8c4e-9d48a306900b None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:55.888687 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4abbf-56e5-4df9-aa77-e26c626a54a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:55.889409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4abbf-56e5-4df9-aa77-e26c626a54a9 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:55.889700 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4abbf-56e5-4df9-aa77-e26c626a54a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:55.890033 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4abbf-56e5-4df9-aa77-e26c626a54a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:55.905462 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4abbf-56e5-4df9-aa77-e26c626a54a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:55.907360 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4abbf-56e5-4df9-aa77-e26c626a54a9 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:55.929719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-a5e4abbf-56e5-4df9-aa77-e26c626a54a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:55.929719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:55.929719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:55.929719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:55.929719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:55.929719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:55.929719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:55.929719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:55.929719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:55.929719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:55.929719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:55.929719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:55.929719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:55.929719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:55.929719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:55.930694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:55.930694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:55.930694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:55.930694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:55.930694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:55.930694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:55.930694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:55.930694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:55.930694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:55.930694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:55.930694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:55.930694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:55.930694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:55.930694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:55.930694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:55.930694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:55.930694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:55.931543 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:55.931543 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:55.931543 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:55.931543 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:55.931543 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 369/734] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:55.936521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4abbf-56e5-4df9-aa77-e26c626a54a9 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:55.937573 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf142ec-aa44-4087-9ed9-83717fca53fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:55.938455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf142ec-aa44-4087-9ed9-83717fca53fe None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:55.938964 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf142ec-aa44-4087-9ed9-83717fca53fe None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:55.939440 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf142ec-aa44-4087-9ed9-83717fca53fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:56.051272 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4abbf-56e5-4df9-aa77-e26c626a54a9 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:56.063838 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:56.098289 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87abfba-d7b1-4fc1-9b83-77102fd0ea97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:56.098952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87abfba-d7b1-4fc1-9b83-77102fd0ea97 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:56.099734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87abfba-d7b1-4fc1-9b83-77102fd0ea97 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:56.100023 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87abfba-d7b1-4fc1-9b83-77102fd0ea97 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:56.100987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87abfba-d7b1-4fc1-9b83-77102fd0ea97 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:56.102429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87abfba-d7b1-4fc1-9b83-77102fd0ea97 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:56.145356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf142ec-aa44-4087-9ed9-83717fca53fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:56.147045 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf142ec-aa44-4087-9ed9-83717fca53fe None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:56.192248 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:56.214896 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 370/735] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jul 26 14:40:55 2022] POST /identity/v3/services => generated 240 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:40:56.216605 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87abfba-d7b1-4fc1-9b83-77102fd0ea97 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:56.280898 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 366/736] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:56.283526 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5890809-fff6-439d-adbf-4d91b6fd00d4 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:56.284038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5890809-fff6-439d-adbf-4d91b6fd00d4 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:56.284721 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5890809-fff6-439d-adbf-4d91b6fd00d4 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:56.294964 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 367/737] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:56 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:56.297022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5890809-fff6-439d-adbf-4d91b6fd00d4 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:56.357455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87abfba-d7b1-4fc1-9b83-77102fd0ea97 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:56.401681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345ee97-ffe8-4cce-9426-3945141593f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:56.402322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345ee97-ffe8-4cce-9426-3945141593f9 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:56.402638 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345ee97-ffe8-4cce-9426-3945141593f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:56.402918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345ee97-ffe8-4cce-9426-3945141593f9 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:56.404407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345ee97-ffe8-4cce-9426-3945141593f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:56.404407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345ee97-ffe8-4cce-9426-3945141593f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:56.405302 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345ee97-ffe8-4cce-9426-3945141593f9 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:56.419339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 371/738] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:56.420921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185992fb-0d19-4b09-a656-9d46d7f6b7e1 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:56.421230 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185992fb-0d19-4b09-a656-9d46d7f6b7e1 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:56.421760 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185992fb-0d19-4b09-a656-9d46d7f6b7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:56.424586 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5890809-fff6-439d-adbf-4d91b6fd00d4 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:56.441720 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-185992fb-0d19-4b09-a656-9d46d7f6b7e1 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:56.442985 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-185992fb-0d19-4b09-a656-9d46d7f6b7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:56.465203 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b8243-e2fb-43cb-bfea-0126941cb71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:56.465854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b8243-e2fb-43cb-bfea-0126941cb71e None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:56.466193 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b8243-e2fb-43cb-bfea-0126941cb71e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:56.466500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b8243-e2fb-43cb-bfea-0126941cb71e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:56.468741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:56.478431 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b8243-e2fb-43cb-bfea-0126941cb71e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:56.483024 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b8243-e2fb-43cb-bfea-0126941cb71e None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:56.483024 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:56.497145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-f57b8243-e2fb-43cb-bfea-0126941cb71e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:56.497145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:56.497145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:56.497145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:56.497145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:56.497145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:56.497145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:56.497145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:56.497145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:56.497145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:56.497145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:56.497145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:56.497145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:56.497145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:56.497145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:56.498048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:56.498048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:56.498048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:56.498048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:56.498048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:56.498048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:56.498048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:56.498048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:56.498048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:56.498048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:56.498048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:56.498048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:56.498048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:56.498048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:56.498048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:56.498048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:56.498048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:56.499234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:56.499234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:56.499234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:56.499234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:56.500194 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 368/739] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:56.501196 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28db8b-c9bd-40a2-9206-75dd9628afcd None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:56.501486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28db8b-c9bd-40a2-9206-75dd9628afcd None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:56.501767 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28db8b-c9bd-40a2-9206-75dd9628afcd None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:56.503194 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 369/740] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:56.503726 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28db8b-c9bd-40a2-9206-75dd9628afcd None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:56.528976 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 372/741] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:56 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:56.530258 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3e9b6-68f0-4be3-bc9f-3abeac13591c None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:56.530599 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3e9b6-68f0-4be3-bc9f-3abeac13591c None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:56.530881 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3e9b6-68f0-4be3-bc9f-3abeac13591c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:56.550464 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-d5c3e9b6-68f0-4be3-bc9f-3abeac13591c None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:56.551675 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d5c3e9b6-68f0-4be3-bc9f-3abeac13591c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:56.622178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 373/742] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:56 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:56.623634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3e9b6-68f0-4be3-bc9f-3abeac13591c None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:56.636614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28db8b-c9bd-40a2-9206-75dd9628afcd None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:56.673642 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de3143-6957-413f-87e1-ca6a531661a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:56.674301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de3143-6957-413f-87e1-ca6a531661a3 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:56.674623 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de3143-6957-413f-87e1-ca6a531661a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:56.674909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de3143-6957-413f-87e1-ca6a531661a3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:56.685356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de3143-6957-413f-87e1-ca6a531661a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:56.687059 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de3143-6957-413f-87e1-ca6a531661a3 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:56.700093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-78de3143-6957-413f-87e1-ca6a531661a3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:40:56.700093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:56.700093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:56.700093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:56.700093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:56.700093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:56.700093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:56.700093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:56.700093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:56.700093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:56.700093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:56.700093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:56.700093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:56.700093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:56.700093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:56.700093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:56.701049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:56.701049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:56.701049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:56.701049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:56.701049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:56.701049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:56.701049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:56.701049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:56.701049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:56.701049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:56.701049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:56.701049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:56.701049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:56.701049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:56.701049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:56.701049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:56.701049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:56.701049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:56.701994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:56.701994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:56.701994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:56.701994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:56.701994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:56.701994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:56.701994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:56.701994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:56.701994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:40:56.701994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:56.701994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 370/743] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jul 26 14:40:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:56.702628 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de3143-6957-413f-87e1-ca6a531661a3 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:56.733181 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:56.745617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3e9b6-68f0-4be3-bc9f-3abeac13591c None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:56.763635 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:56.781595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb154a82-8fb8-4f7c-bfda-18fe3a5ea943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:56.782226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb154a82-8fb8-4f7c-bfda-18fe3a5ea943 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:56.782547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb154a82-8fb8-4f7c-bfda-18fe3a5ea943 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:56.782836 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb154a82-8fb8-4f7c-bfda-18fe3a5ea943 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:56.783539 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb154a82-8fb8-4f7c-bfda-18fe3a5ea943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:56.783851 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb154a82-8fb8-4f7c-bfda-18fe3a5ea943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:56.785234 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb154a82-8fb8-4f7c-bfda-18fe3a5ea943 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:56.797297 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 374/744] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:56.798177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb154a82-8fb8-4f7c-bfda-18fe3a5ea943 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:56.828568 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de3143-6957-413f-87e1-ca6a531661a3 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:56.870549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78915c-d6b7-4234-a890-f48be24ab79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:56.871228 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78915c-d6b7-4234-a890-f48be24ab79e None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:56.871468 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78915c-d6b7-4234-a890-f48be24ab79e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:56.871741 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78915c-d6b7-4234-a890-f48be24ab79e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:56.889294 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78915c-d6b7-4234-a890-f48be24ab79e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:56.889455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-0b78915c-d6b7-4234-a890-f48be24ab79e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:56.889455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:56.889455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:56.889455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:56.889455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:56.889455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:56.889455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:56.889455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:56.889455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:56.889455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:56.889455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:56.889455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:56.889455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:56.889455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:56.889455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:56.889455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:56.890325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:56.890325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:56.890325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:56.890325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:56.890325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:56.890325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:56.890325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:56.890325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:56.890325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:56.890325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:56.890325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:56.890325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:56.890325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:56.890325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:56.890325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:56.890325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:56.891201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:56.891201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:56.891201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:56.891201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:56.891201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:56.891201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:56.891201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:56.891201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:56.891201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:56.891201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:56.891201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:56.891201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:56.891201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 371/745] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:40:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:56.891885 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78915c-d6b7-4234-a890-f48be24ab79e None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:56.916897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb154a82-8fb8-4f7c-bfda-18fe3a5ea943 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:56.952339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d031484-78dd-4038-b5df-6098c413a8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:56.953039 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d031484-78dd-4038-b5df-6098c413a8a5 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:56.953324 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d031484-78dd-4038-b5df-6098c413a8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:56.953606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d031484-78dd-4038-b5df-6098c413a8a5 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:56.954295 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d031484-78dd-4038-b5df-6098c413a8a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:56.955732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d031484-78dd-4038-b5df-6098c413a8a5 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:56.998641 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78915c-d6b7-4234-a890-f48be24ab79e None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:57.013501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:57.016105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 375/746] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jul 26 14:40:56 2022] POST /identity/v3/services => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:40:57.017002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d031484-78dd-4038-b5df-6098c413a8a5 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:57.028397 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:57.057660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f98d4-821c-4ee9-83bd-5da97f6061e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:57.058312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f98d4-821c-4ee9-83bd-5da97f6061e3 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:57.058621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f98d4-821c-4ee9-83bd-5da97f6061e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:57.058897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f98d4-821c-4ee9-83bd-5da97f6061e3 None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:57.059761 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f98d4-821c-4ee9-83bd-5da97f6061e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:57.060070 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f98d4-821c-4ee9-83bd-5da97f6061e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:57.061672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f98d4-821c-4ee9-83bd-5da97f6061e3 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:57.089408 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 372/747] 10.222.0.86 () {56 vars in 1149 bytes} [Tue Jul 26 14:40:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:57.090493 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f98d4-821c-4ee9-83bd-5da97f6061e3 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:57.157239 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d031484-78dd-4038-b5df-6098c413a8a5 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:57.199836 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e8e1b-a9dd-42d2-be44-b248523dd9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:57.200630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e8e1b-a9dd-42d2-be44-b248523dd9de None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:57.200911 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e8e1b-a9dd-42d2-be44-b248523dd9de None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:57.201184 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e8e1b-a9dd-42d2-be44-b248523dd9de None admin] PATH_INFO: `/v3/projects/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:57.208544 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e8e1b-a9dd-42d2-be44-b248523dd9de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:57.209988 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e8e1b-a9dd-42d2-be44-b248523dd9de None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:57.220768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f98d4-821c-4ee9-83bd-5da97f6061e3 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:57.223094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-8f0e8e1b-a9dd-42d2-be44-b248523dd9de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:57.223094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:57.223094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:57.223094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:57.223094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:57.223094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:57.223094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:57.223094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:57.223094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:57.223094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:57.223094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:57.223094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:57.223094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:57.223094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:57.223094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:57.224453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:57.224453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:57.224453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:57.224453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:57.224453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:57.224453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:57.224453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:57.224453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:57.224453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:57.224453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:57.224453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:57.224453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:57.224453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:57.224453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:57.224453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:57.224453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:57.224453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:57.225316 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:57.225316 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:57.225316 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:57.225316 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:57.225316 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:57.225316 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:57.225316 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:57.225316 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:57.225316 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 376/748] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:57.229691 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e8e1b-a9dd-42d2-be44-b248523dd9de None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:57.281499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14624605-fb2f-4992-9df7-d7b0bbb44d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:57.282143 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14624605-fb2f-4992-9df7-d7b0bbb44d4a None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:57.282471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14624605-fb2f-4992-9df7-d7b0bbb44d4a None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:57.283015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14624605-fb2f-4992-9df7-d7b0bbb44d4a None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:57.284226 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14624605-fb2f-4992-9df7-d7b0bbb44d4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:57.284542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14624605-fb2f-4992-9df7-d7b0bbb44d4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:57.286604 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14624605-fb2f-4992-9df7-d7b0bbb44d4a None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:57.298831 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 373/749] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:57.299816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14624605-fb2f-4992-9df7-d7b0bbb44d4a None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:57.308746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:57.341189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:57.350074 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e8e1b-a9dd-42d2-be44-b248523dd9de None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:57.393491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdf9ab-2c13-4876-a450-32509ccb2d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:57.394181 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdf9ab-2c13-4876-a450-32509ccb2d92 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:57.394501 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdf9ab-2c13-4876-a450-32509ccb2d92 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:57.394830 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdf9ab-2c13-4876-a450-32509ccb2d92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:57.434434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14624605-fb2f-4992-9df7-d7b0bbb44d4a None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:57.467989 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdf9ab-2c13-4876-a450-32509ccb2d92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:57.469444 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdf9ab-2c13-4876-a450-32509ccb2d92 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:57.470508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a7eb1-af61-4b2d-bd7d-c0b5fff776d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:57.471206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a7eb1-af61-4b2d-bd7d-c0b5fff776d3 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:57.471561 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a7eb1-af61-4b2d-bd7d-c0b5fff776d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:57.471911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a7eb1-af61-4b2d-bd7d-c0b5fff776d3 None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:57.472915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a7eb1-af61-4b2d-bd7d-c0b5fff776d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:57.473297 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a7eb1-af61-4b2d-bd7d-c0b5fff776d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:57.474849 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a7eb1-af61-4b2d-bd7d-c0b5fff776d3 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:57.491367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 374/750] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:57.493340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a7eb1-af61-4b2d-bd7d-c0b5fff776d3 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:57.540103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:57.573313 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 377/751] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:40:57.574362 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdf9ab-2c13-4876-a450-32509ccb2d92 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:57.594822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:57.604839 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a7eb1-af61-4b2d-bd7d-c0b5fff776d3 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:57.644307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe861d3-1ddf-4d94-8f9e-f767165d8ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:57.645339 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe861d3-1ddf-4d94-8f9e-f767165d8ef5 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:57.645693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe861d3-1ddf-4d94-8f9e-f767165d8ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:57.646051 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe861d3-1ddf-4d94-8f9e-f767165d8ef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:57.660180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe861d3-1ddf-4d94-8f9e-f767165d8ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:57.662277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe861d3-1ddf-4d94-8f9e-f767165d8ef5 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:57.681621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-cbe861d3-1ddf-4d94-8f9e-f767165d8ef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:57.681621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:57.681621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:57.681621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:57.681621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:57.681621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:57.681621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:57.681621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:57.681621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:57.681621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:57.681621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:57.681621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:57.681621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:57.681621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:57.681621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:57.682810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:57.682810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:57.682810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:57.682810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:57.682810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:57.682810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:57.682810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:57.682810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:57.682810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:57.682810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:57.682810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:57.682810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:57.682810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:57.682810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:57.682810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:57.682810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:57.682810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:57.683703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:57.683703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:57.683703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:57.683703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:57.686595 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 375/752] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:57.687650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe861d3-1ddf-4d94-8f9e-f767165d8ef5 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:57.696872 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdf9ab-2c13-4876-a450-32509ccb2d92 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:57.735719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3aceeb-6d96-4f8c-b120-838082b5bb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:57.735929 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3aceeb-6d96-4f8c-b120-838082b5bb85 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:57.736218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3aceeb-6d96-4f8c-b120-838082b5bb85 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:57.736500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3aceeb-6d96-4f8c-b120-838082b5bb85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:57.737297 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3aceeb-6d96-4f8c-b120-838082b5bb85 None admin] RBAC: Adding query filter params (role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=462ecbb85c6b4a17a952fb74fa2de65e) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:57.737619 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3aceeb-6d96-4f8c-b120-838082b5bb85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:57.739067 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3aceeb-6d96-4f8c-b120-838082b5bb85 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:57.746751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 378/753] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:57 2022] GET /identity/v3/role_assignments?user.id=462ecbb85c6b4a17a952fb74fa2de65e&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:57.747684 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3aceeb-6d96-4f8c-b120-838082b5bb85 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:57.786277 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:57.830860 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe861d3-1ddf-4d94-8f9e-f767165d8ef5 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:57.870300 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3aceeb-6d96-4f8c-b120-838082b5bb85 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:57.883899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542376e-98d7-4a17-84d1-39f3a08d79ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:57.884562 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542376e-98d7-4a17-84d1-39f3a08d79ad None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:57.884846 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542376e-98d7-4a17-84d1-39f3a08d79ad None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:57.885125 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542376e-98d7-4a17-84d1-39f3a08d79ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:57.897716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542376e-98d7-4a17-84d1-39f3a08d79ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:57.899408 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542376e-98d7-4a17-84d1-39f3a08d79ad None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:57.901517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:57.917238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-c542376e-98d7-4a17-84d1-39f3a08d79ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:57.917238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:57.917238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:57.917238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:57.917238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:57.917238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:57.917238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:57.917238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:57.917238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:57.917238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:57.917238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:57.917238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:57.917238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:57.917238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:57.917238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:57.918624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:57.918624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:57.918624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:57.918624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:57.918624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:57.918624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:57.918624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:57.918624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:57.918624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:57.918624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:57.918624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:57.918624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:57.918624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:57.918624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:57.918624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:57.918624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:57.918624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:57.919500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:57.919500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:57.919500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:57.919500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:57.919500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 376/754] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:57.920215 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cdfd9-6fff-46bc-b5fb-35cccfa4104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:57.921016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cdfd9-6fff-46bc-b5fb-35cccfa4104f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:57.921306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cdfd9-6fff-46bc-b5fb-35cccfa4104f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:57.921584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cdfd9-6fff-46bc-b5fb-35cccfa4104f None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:57.922294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cdfd9-6fff-46bc-b5fb-35cccfa4104f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:57.922627 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cdfd9-6fff-46bc-b5fb-35cccfa4104f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:57.924007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cdfd9-6fff-46bc-b5fb-35cccfa4104f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:57.924211 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542376e-98d7-4a17-84d1-39f3a08d79ad None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:57.940686 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 379/755] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:57.959232 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cdfd9-6fff-46bc-b5fb-35cccfa4104f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:58.051111 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542376e-98d7-4a17-84d1-39f3a08d79ad None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:58.069884 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:58.081859 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cdfd9-6fff-46bc-b5fb-35cccfa4104f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:58.091260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042c51f-4c23-4b65-9765-e35237b972a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:58.092022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042c51f-4c23-4b65-9765-e35237b972a2 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:58.092451 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042c51f-4c23-4b65-9765-e35237b972a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:58.092827 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042c51f-4c23-4b65-9765-e35237b972a2 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:58.093819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042c51f-4c23-4b65-9765-e35237b972a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:58.094079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042c51f-4c23-4b65-9765-e35237b972a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:58.095632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042c51f-4c23-4b65-9765-e35237b972a2 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:58.109431 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 377/756] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:58.115486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042c51f-4c23-4b65-9765-e35237b972a2 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:58.129751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ed2d2-874e-4d96-bd85-0c12fce267c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:58.134807 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ed2d2-874e-4d96-bd85-0c12fce267c8 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:58.135288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ed2d2-874e-4d96-bd85-0c12fce267c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:58.135752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ed2d2-874e-4d96-bd85-0c12fce267c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:58.148093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ed2d2-874e-4d96-bd85-0c12fce267c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:58.152179 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ed2d2-874e-4d96-bd85-0c12fce267c8 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:58.173466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-fd7ed2d2-874e-4d96-bd85-0c12fce267c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:40:58.173466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:58.173466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:58.173466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:58.173466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:58.173466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:58.173466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:58.173466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:58.173466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:58.173466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:58.173466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:58.173466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:58.173466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:58.173466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:58.173466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:58.173466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:58.174553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:58.174553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:58.174553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:58.174553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:58.174553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:58.174553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:58.174553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:58.174553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:58.174553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:58.174553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:58.174553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:58.174553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:58.174553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:58.174553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:58.174553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:58.174553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:58.174553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:58.174553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:58.175473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:58.175473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:58.175473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:58.175473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:58.175473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:58.175473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:58.175473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:58.175473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:58.175473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:40:58.175473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:58.183490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 380/757] 10.222.0.86 () {56 vars in 1093 bytes} [Tue Jul 26 14:40:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:40:58.189683 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ed2d2-874e-4d96-bd85-0c12fce267c8 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:58.244655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:58.306987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ed2d2-874e-4d96-bd85-0c12fce267c8 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:58.356365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d913d9-c32d-4d8c-97a0-1ab4e7bb6166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:58.357785 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d913d9-c32d-4d8c-97a0-1ab4e7bb6166 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:58.358411 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d913d9-c32d-4d8c-97a0-1ab4e7bb6166 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:58.358844 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d913d9-c32d-4d8c-97a0-1ab4e7bb6166 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:58.359840 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d913d9-c32d-4d8c-97a0-1ab4e7bb6166 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:58.360306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d913d9-c32d-4d8c-97a0-1ab4e7bb6166 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:58.361912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d913d9-c32d-4d8c-97a0-1ab4e7bb6166 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:58.381322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 381/758] 10.222.0.86 () {56 vars in 1133 bytes} [Tue Jul 26 14:40:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:58.385636 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042c51f-4c23-4b65-9765-e35237b972a2 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:58.386730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d913d9-c32d-4d8c-97a0-1ab4e7bb6166 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:58.407270 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:58.462412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3197c-92c4-47f2-8010-f21ab1922ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:58.462412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3197c-92c4-47f2-8010-f21ab1922ce7 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:58.462412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3197c-92c4-47f2-8010-f21ab1922ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:58.462412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3197c-92c4-47f2-8010-f21ab1922ce7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:58.470465 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3197c-92c4-47f2-8010-f21ab1922ce7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:58.472464 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3197c-92c4-47f2-8010-f21ab1922ce7 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:58.486299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-56b3197c-92c4-47f2-8010-f21ab1922ce7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:58.486299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:58.486299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:58.486299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:58.486299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:58.486299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:58.486299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:58.486299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:58.486299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:58.486299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:58.486299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:58.486299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:58.486299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:58.486299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:58.486299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:58.487411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:58.487411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:58.487411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:58.487411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:58.487411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:58.487411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:58.487411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:58.487411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:58.487411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:58.487411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:58.487411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:58.487411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:58.487411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:58.487411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:58.487411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:58.487411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:58.487411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:58.488599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:58.488599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:58.488599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:58.488599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:58.488599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:58.488599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:58.488599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:58.488599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:58.489026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 378/759] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:58.495494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3197c-92c4-47f2-8010-f21ab1922ce7 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:58.564313 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d913d9-c32d-4d8c-97a0-1ab4e7bb6166 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:58.603501 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474907d-ffc8-45c5-bd78-b6418450df10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:58.604158 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474907d-ffc8-45c5-bd78-b6418450df10 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:58.604509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474907d-ffc8-45c5-bd78-b6418450df10 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:58.604791 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474907d-ffc8-45c5-bd78-b6418450df10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:58.616041 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474907d-ffc8-45c5-bd78-b6418450df10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:58.617714 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474907d-ffc8-45c5-bd78-b6418450df10 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:58.624734 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3197c-92c4-47f2-8010-f21ab1922ce7 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:58.633827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-5474907d-ffc8-45c5-bd78-b6418450df10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:58.633827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:58.633827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:58.633827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:58.633827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:58.633827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:58.633827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:58.633827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:58.633827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:58.633827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:58.633827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:58.633827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:58.633827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:58.633827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:58.633827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:58.634784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:58.634784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:58.634784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:58.634784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:58.634784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:58.634784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:58.634784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:58.634784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:58.634784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:58.634784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:58.634784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:58.634784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:58.634784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:58.634784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:58.634784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:58.634784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:58.634784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:58.635668 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:58.635668 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:58.635668 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:58.635668 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:58.639679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 382/760] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:58.641077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069b14a-2379-4f98-85ab-c9e357a8a331 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:58.641369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069b14a-2379-4f98-85ab-c9e357a8a331 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:58.641651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069b14a-2379-4f98-85ab-c9e357a8a331 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:58.642529 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:58.646472 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 383/761] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:58.651100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069b14a-2379-4f98-85ab-c9e357a8a331 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:58.669924 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3cb90-3b27-4f91-9f1a-0330ec472db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:58.673927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3cb90-3b27-4f91-9f1a-0330ec472db2 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:58.673927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3cb90-3b27-4f91-9f1a-0330ec472db2 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:58.673927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3cb90-3b27-4f91-9f1a-0330ec472db2 None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:58.673927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3cb90-3b27-4f91-9f1a-0330ec472db2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:58.673927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3cb90-3b27-4f91-9f1a-0330ec472db2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:58.674591 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3cb90-3b27-4f91-9f1a-0330ec472db2 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:58.698545 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 379/762] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:58.700093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1610016-b1a3-4b5a-849c-c9f0c7f4b53c None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:58.700517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1610016-b1a3-4b5a-849c-c9f0c7f4b53c None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:58.700922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1610016-b1a3-4b5a-849c-c9f0c7f4b53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:58.725404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-a1610016-b1a3-4b5a-849c-c9f0c7f4b53c None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:58.727448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a1610016-b1a3-4b5a-849c-c9f0c7f4b53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:58.738462 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:58.790803 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069b14a-2379-4f98-85ab-c9e357a8a331 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:58.814784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 380/763] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:40:58.816129 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1610016-b1a3-4b5a-849c-c9f0c7f4b53c None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:58.840060 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525921d-5d4d-43af-811c-622497ed68b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:58.841162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525921d-5d4d-43af-811c-622497ed68b9 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:58.841648 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525921d-5d4d-43af-811c-622497ed68b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:58.842211 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525921d-5d4d-43af-811c-622497ed68b9 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:58.843241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525921d-5d4d-43af-811c-622497ed68b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:58.843865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525921d-5d4d-43af-811c-622497ed68b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:58.845557 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525921d-5d4d-43af-811c-622497ed68b9 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:58.864818 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 384/764] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:58.866106 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525921d-5d4d-43af-811c-622497ed68b9 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:58.932984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1610016-b1a3-4b5a-849c-c9f0c7f4b53c None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:58.935618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:58.969630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec50e3-b224-4a78-9b63-623dd2c71129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:58.970254 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec50e3-b224-4a78-9b63-623dd2c71129 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:58.970576 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec50e3-b224-4a78-9b63-623dd2c71129 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:58.970856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec50e3-b224-4a78-9b63-623dd2c71129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:58.971646 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec50e3-b224-4a78-9b63-623dd2c71129 None admin] RBAC: Adding query filter params (role.id=7f17a5a0295f42e793e343cff968367c, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=0834be7405cd4c968763099251d37154) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:58.971961 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec50e3-b224-4a78-9b63-623dd2c71129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:58.973457 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec50e3-b224-4a78-9b63-623dd2c71129 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:58.982824 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525921d-5d4d-43af-811c-622497ed68b9 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:58.986572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 381/765] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:58 2022] GET /identity/v3/role_assignments?user.id=0834be7405cd4c968763099251d37154&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=7f17a5a0295f42e793e343cff968367c => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:58.988281 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec50e3-b224-4a78-9b63-623dd2c71129 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:59.008364 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:59.025722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465836c-af99-4db6-898d-0a02149b8475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:59.026938 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465836c-af99-4db6-898d-0a02149b8475 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:59.027425 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465836c-af99-4db6-898d-0a02149b8475 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:59.027902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465836c-af99-4db6-898d-0a02149b8475 None admin] PATH_INFO: `/v3/services/network` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:59.028751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465836c-af99-4db6-898d-0a02149b8475 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:59.030633 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465836c-af99-4db6-898d-0a02149b8475 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:59.041522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-1465836c-af99-4db6-898d-0a02149b8475 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:40:59.041522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:59.041522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:40:59.041522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:40:59.041522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:40:59.041522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:40:59.041522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:40:59.041522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:40:59.041522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:40:59.041522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:59.041522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:40:59.041522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:59.041522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:59.041522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:59.041522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:59.041522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:59.041522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:59.042573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:59.042573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:59.042573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:59.042573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:59.042573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:59.042573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:59.042573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:40:59.042573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:40:59.042573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:40:59.042573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:40:59.042573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:59.042573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:59.042573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:59.042573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:59.042573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:59.042573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:59.043405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:59.043405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:59.043405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:59.043405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:59.043405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:59.043405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:59.043405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:59.043405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:59.043405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:59.043405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:59.043405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:40:59.043405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:40:59.043405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:40:59.043405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:40:59.046108 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 385/766] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:58 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:59.052805 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465836c-af99-4db6-898d-0a02149b8475 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:59.224283 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec50e3-b224-4a78-9b63-623dd2c71129 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:59.266247 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465836c-af99-4db6-898d-0a02149b8475 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:59.277313 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f99c0-2697-4458-ab8d-e6ec19d6728c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:59.277971 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f99c0-2697-4458-ab8d-e6ec19d6728c None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:59.278258 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f99c0-2697-4458-ab8d-e6ec19d6728c None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:59.278572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f99c0-2697-4458-ab8d-e6ec19d6728c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:59.285631 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f99c0-2697-4458-ab8d-e6ec19d6728c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:59.287106 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f99c0-2697-4458-ab8d-e6ec19d6728c None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:59.299307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-356f99c0-2697-4458-ab8d-e6ec19d6728c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:59.299307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:59.299307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:59.299307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:59.299307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:59.299307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:59.299307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:59.299307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:59.299307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:59.299307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:59.299307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:59.299307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:59.299307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:59.299307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:59.299307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:59.300183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:59.300183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:59.300183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:59.300183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:59.300183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:59.300183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:59.300183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:59.300183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:59.300183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:59.300183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:59.300183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:59.300183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:59.300183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:59.300183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:59.300183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:59.300183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:59.300183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:59.301102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:59.301102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:59.301102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:59.301102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:59.301102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:59.301102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:59.301102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:59.301102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:59.301102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 382/767] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:59.301881 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4851c-3886-422c-9e38-75240f5c201c None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:59.302223 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4851c-3886-422c-9e38-75240f5c201c None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:59.302472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4851c-3886-422c-9e38-75240f5c201c None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:59.307756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 383/768] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:59.307756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4851c-3886-422c-9e38-75240f5c201c None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:59.313524 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b78325-b28b-44fa-8547-fffaac7d72e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:59.314153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b78325-b28b-44fa-8547-fffaac7d72e7 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:59.314471 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b78325-b28b-44fa-8547-fffaac7d72e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:59.314757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b78325-b28b-44fa-8547-fffaac7d72e7 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:59.315446 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b78325-b28b-44fa-8547-fffaac7d72e7 None admin] RBAC: Adding query filter params (name=network) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:59.315764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b78325-b28b-44fa-8547-fffaac7d72e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:59.317149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b78325-b28b-44fa-8547-fffaac7d72e7 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:59.322455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 386/769] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jul 26 14:40:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:59.328398 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf8ef4-d67b-4f01-8ad6-6829377f7010 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:59.328698 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf8ef4-d67b-4f01-8ad6-6829377f7010 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:59.328985 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf8ef4-d67b-4f01-8ad6-6829377f7010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:59.341656 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:59.349703 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-8aaf8ef4-d67b-4f01-8ad6-6829377f7010 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:59.350980 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8aaf8ef4-d67b-4f01-8ad6-6829377f7010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:59.406142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:59.427668 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4851c-3886-422c-9e38-75240f5c201c None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:59.438410 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 387/770] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:40:59.438410 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf8ef4-d67b-4f01-8ad6-6829377f7010 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:59.473869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd7bcf-ad9f-4fff-9ad6-1ebca492c2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:59.474870 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd7bcf-ad9f-4fff-9ad6-1ebca492c2a3 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:59.475380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd7bcf-ad9f-4fff-9ad6-1ebca492c2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:59.475930 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd7bcf-ad9f-4fff-9ad6-1ebca492c2a3 None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:59.477884 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd7bcf-ad9f-4fff-9ad6-1ebca492c2a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:59.478414 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd7bcf-ad9f-4fff-9ad6-1ebca492c2a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:59.480304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd7bcf-ad9f-4fff-9ad6-1ebca492c2a3 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:59.494300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 384/771] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:59.495509 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd7bcf-ad9f-4fff-9ad6-1ebca492c2a3 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:59.562419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf8ef4-d67b-4f01-8ad6-6829377f7010 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:59.592746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:59.600704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903234d9-6f26-4acd-8ae0-f964fb0f3967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:59.611218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903234d9-6f26-4acd-8ae0-f964fb0f3967 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:59.611218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903234d9-6f26-4acd-8ae0-f964fb0f3967 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:59.611218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903234d9-6f26-4acd-8ae0-f964fb0f3967 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:59.611218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903234d9-6f26-4acd-8ae0-f964fb0f3967 None admin] RBAC: Adding query filter params (type=network) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:59.611218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903234d9-6f26-4acd-8ae0-f964fb0f3967 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:59.611218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903234d9-6f26-4acd-8ae0-f964fb0f3967 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:59.611708 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd7bcf-ad9f-4fff-9ad6-1ebca492c2a3 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:59.611785 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 388/772] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jul 26 14:40:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:59.611785 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903234d9-6f26-4acd-8ae0-f964fb0f3967 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:59.642850 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2e424-91ae-496e-bfbc-3bed914bb54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:59.643946 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2e424-91ae-496e-bfbc-3bed914bb54b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:59.644443 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2e424-91ae-496e-bfbc-3bed914bb54b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:59.644940 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2e424-91ae-496e-bfbc-3bed914bb54b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:59.645932 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2e424-91ae-496e-bfbc-3bed914bb54b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:59.647567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2e424-91ae-496e-bfbc-3bed914bb54b None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:59.659981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-93a2e424-91ae-496e-bfbc-3bed914bb54b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:40:59.659981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:59.659981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:40:59.659981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:40:59.659981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:40:59.659981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:40:59.659981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:40:59.659981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:40:59.659981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:40:59.659981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:59.659981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:40:59.659981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:59.659981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:59.659981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:59.659981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:59.659981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:59.660905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:59.660905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:59.660905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:59.660905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:59.660905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:59.660905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:59.660905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:59.660905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:40:59.660905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:40:59.660905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:40:59.660905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:40:59.660905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:59.660905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:59.660905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:59.660905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:59.660905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:59.661765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:59.661765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:59.661765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:59.661765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:59.661765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:59.661765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:59.661765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:59.661765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:59.661765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:59.661765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:59.661765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:59.661765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:40:59.661765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:40:59.661765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:40:59.661765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:40:59.664601 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 385/773] 10.222.0.86 () {56 vars in 1129 bytes} [Tue Jul 26 14:40:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:59.665618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2e424-91ae-496e-bfbc-3bed914bb54b None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:59.683190 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:59.729206 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903234d9-6f26-4acd-8ae0-f964fb0f3967 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:59.767349 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2a086-7144-428e-8d31-ef074563d681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:59.768110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2a086-7144-428e-8d31-ef074563d681 None admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:59.768363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2a086-7144-428e-8d31-ef074563d681 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:59.768584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2a086-7144-428e-8d31-ef074563d681 None admin] PATH_INFO: `/v3/projects/12937bc17f02483285f18c492fe237e3/users/d12fc26e640f4337b4a4da60cc4d9adc/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:59.770721 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2a086-7144-428e-8d31-ef074563d681 None admin] RBAC: Authorizing `identity:create_grant(project_id=12937bc17f02483285f18c492fe237e3, user_id=d12fc26e640f4337b4a4da60cc4d9adc, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:59.772248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2a086-7144-428e-8d31-ef074563d681 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:59.781016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2e424-91ae-496e-bfbc-3bed914bb54b None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:59.816249 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e45e13-9369-4be2-ae0e-9934c2f3ccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:59.816883 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e45e13-9369-4be2-ae0e-9934c2f3ccf3 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:59.817234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e45e13-9369-4be2-ae0e-9934c2f3ccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:59.817594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e45e13-9369-4be2-ae0e-9934c2f3ccf3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:59.818430 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e45e13-9369-4be2-ae0e-9934c2f3ccf3 None admin] RBAC: Adding query filter params (interface=public, service_id=3fbf0dfe627940b3a0d43ecdd9cd2118, region_id=RegionOne) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:59.818812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e45e13-9369-4be2-ae0e-9934c2f3ccf3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:59.820694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e45e13-9369-4be2-ae0e-9934c2f3ccf3 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:59.828788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 386/774] 10.222.0.86 () {56 vars in 1251 bytes} [Tue Jul 26 14:40:59 2022] GET /identity/v3/endpoints?service_id=3fbf0dfe627940b3a0d43ecdd9cd2118&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:59.829376 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e45e13-9369-4be2-ae0e-9934c2f3ccf3 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:59.848997 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:59.863730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 389/775] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:40:59 2022] PUT /identity/v3/projects/12937bc17f02483285f18c492fe237e3/users/d12fc26e640f4337b4a4da60cc4d9adc/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:40:59.866024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2a086-7144-428e-8d31-ef074563d681 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:59.939387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e45e13-9369-4be2-ae0e-9934c2f3ccf3 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:59.979592 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec85d99-a45c-482f-a044-555ec646f92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:59.980351 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec85d99-a45c-482f-a044-555ec646f92f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:59.980689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec85d99-a45c-482f-a044-555ec646f92f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:59.986417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec85d99-a45c-482f-a044-555ec646f92f None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:59.986417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec85d99-a45c-482f-a044-555ec646f92f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:59.986417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec85d99-a45c-482f-a044-555ec646f92f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:59.986417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec85d99-a45c-482f-a044-555ec646f92f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:59.989724 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 387/776] 10.222.0.86 () {56 vars in 1124 bytes} [Tue Jul 26 14:40:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:59.998601 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec85d99-a45c-482f-a044-555ec646f92f None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:00.099480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2a086-7144-428e-8d31-ef074563d681 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:00.101054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:00.145985 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:00.148468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25558983-fa00-41b1-825c-47b354fec56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:00.149102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25558983-fa00-41b1-825c-47b354fec56b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:00.149538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25558983-fa00-41b1-825c-47b354fec56b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:00.149818 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25558983-fa00-41b1-825c-47b354fec56b None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:00.151817 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25558983-fa00-41b1-825c-47b354fec56b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:00.154866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25558983-fa00-41b1-825c-47b354fec56b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:00.159540 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 390/777] 10.222.0.86 () {56 vars in 1087 bytes} [Tue Jul 26 14:40:59 2022] GET /identity/v3/services => generated 772 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:00.161589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d3032-12c1-4437-937e-5b973b4f1be8 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:00.161874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d3032-12c1-4437-937e-5b973b4f1be8 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:00.162153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d3032-12c1-4437-937e-5b973b4f1be8 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:00.164525 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 391/778] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:00.168819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec85d99-a45c-482f-a044-555ec646f92f None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:00.173154 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207affb3-058a-4186-9544-d30d87f6f286 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:00.173524 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207affb3-058a-4186-9544-d30d87f6f286 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:00.173885 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207affb3-058a-4186-9544-d30d87f6f286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:00.199078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-207affb3-058a-4186-9544-d30d87f6f286 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:00.200290 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-207affb3-058a-4186-9544-d30d87f6f286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:00.210951 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530225e5-3a26-42b7-92a8-20a842993d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:00.211702 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530225e5-3a26-42b7-92a8-20a842993d14 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:00.211989 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530225e5-3a26-42b7-92a8-20a842993d14 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:00.212265 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530225e5-3a26-42b7-92a8-20a842993d14 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:00.213078 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530225e5-3a26-42b7-92a8-20a842993d14 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:00.213376 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530225e5-3a26-42b7-92a8-20a842993d14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:00.215928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530225e5-3a26-42b7-92a8-20a842993d14 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:00.226571 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 388/779] 10.222.0.86 () {56 vars in 1124 bytes} [Tue Jul 26 14:40:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:00.230116 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530225e5-3a26-42b7-92a8-20a842993d14 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:00.357168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 392/780] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:00.364424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530225e5-3a26-42b7-92a8-20a842993d14 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:00.388164 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207affb3-058a-4186-9544-d30d87f6f286 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:00.406441 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a32ef6-e124-4992-891d-c12f9f9910c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:00.407336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a32ef6-e124-4992-891d-c12f9f9910c0 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:00.407628 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a32ef6-e124-4992-891d-c12f9f9910c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:00.407912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a32ef6-e124-4992-891d-c12f9f9910c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:00.408833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a32ef6-e124-4992-891d-c12f9f9910c0 None admin] RBAC: Adding query filter params (interface=public, service_id=6698ec33b91240c7b76bb351908298da, region_id=RegionOne) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:00.409448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a32ef6-e124-4992-891d-c12f9f9910c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:00.410868 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a32ef6-e124-4992-891d-c12f9f9910c0 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:00.419589 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 389/781] 10.222.0.86 () {56 vars in 1251 bytes} [Tue Jul 26 14:41:00 2022] GET /identity/v3/endpoints?service_id=6698ec33b91240c7b76bb351908298da&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:00.428514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a32ef6-e124-4992-891d-c12f9f9910c0 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:00.443568 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:00.508098 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:00.515096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207affb3-058a-4186-9544-d30d87f6f286 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:00.552956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d63d44-c695-4373-a9ca-4fd7b136d6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:00.553899 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d63d44-c695-4373-a9ca-4fd7b136d6f7 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:00.554480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d63d44-c695-4373-a9ca-4fd7b136d6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:00.555447 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d63d44-c695-4373-a9ca-4fd7b136d6f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:00.558875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a32ef6-e124-4992-891d-c12f9f9910c0 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:00.568079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d63d44-c695-4373-a9ca-4fd7b136d6f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:41:00.573718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-91d63d44-c695-4373-a9ca-4fd7b136d6f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:41:00.573718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:00.573718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:00.573718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:00.573718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:00.573718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:00.573718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:00.573718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:00.573718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:00.573718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:00.573718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:00.573718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:00.573718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:41:00.573718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:41:00.573718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:41:00.573718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:41:00.574876 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:41:00.574876 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:41:00.574876 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:41:00.574876 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:41:00.574876 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:00.574876 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:00.574876 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:00.574876 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:00.574876 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:00.574876 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:00.574876 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:00.574876 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:00.574876 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:00.574876 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:00.574876 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:00.574876 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:00.575918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:00.575918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:00.575918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:00.575918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:00.575918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:41:00.575918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:41:00.575918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:41:00.575918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:41:00.575918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:41:00.575918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:41:00.575918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:41:00.575918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:00.582499 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 393/782] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:41:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:00.584621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d63d44-c695-4373-a9ca-4fd7b136d6f7 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:00.596913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977c2f7-5662-4cb1-b14f-89c7b8a7080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:00.597911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977c2f7-5662-4cb1-b14f-89c7b8a7080a None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:00.598204 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977c2f7-5662-4cb1-b14f-89c7b8a7080a None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:00.598518 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977c2f7-5662-4cb1-b14f-89c7b8a7080a None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:00.599188 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977c2f7-5662-4cb1-b14f-89c7b8a7080a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:00.601208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977c2f7-5662-4cb1-b14f-89c7b8a7080a None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:00.613672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 390/783] 10.222.0.86 () {56 vars in 1087 bytes} [Tue Jul 26 14:41:00 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:00.702635 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d63d44-c695-4373-a9ca-4fd7b136d6f7 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:00.741842 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200822ef-7c6a-4dc8-84fa-a984e2fc2d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:00.742540 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200822ef-7c6a-4dc8-84fa-a984e2fc2d3a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:00.742831 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200822ef-7c6a-4dc8-84fa-a984e2fc2d3a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:00.743111 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200822ef-7c6a-4dc8-84fa-a984e2fc2d3a None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:00.743848 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200822ef-7c6a-4dc8-84fa-a984e2fc2d3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:00.744160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200822ef-7c6a-4dc8-84fa-a984e2fc2d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:00.745560 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200822ef-7c6a-4dc8-84fa-a984e2fc2d3a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:00.755307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 394/784] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:41:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:00.763611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977c2f7-5662-4cb1-b14f-89c7b8a7080a None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:00.849157 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:00.881457 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977c2f7-5662-4cb1-b14f-89c7b8a7080a None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:00.918721 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ebc76-7a67-45f2-8f2c-d5732f3739e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:00.919381 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ebc76-7a67-45f2-8f2c-d5732f3739e9 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:00.919670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ebc76-7a67-45f2-8f2c-d5732f3739e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:00.919953 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ebc76-7a67-45f2-8f2c-d5732f3739e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:00.932564 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ebc76-7a67-45f2-8f2c-d5732f3739e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:00.934204 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ebc76-7a67-45f2-8f2c-d5732f3739e9 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:00.949366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-cf7ebc76-7a67-45f2-8f2c-d5732f3739e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:00.949366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:00.949366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:00.949366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:00.949366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:00.949366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:00.949366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:00.949366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:00.949366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:00.949366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:00.949366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:00.949366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:00.949366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:00.949366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:00.949366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:00.950711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:00.950711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:00.950711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:00.950711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:00.950711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:00.950711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:00.950711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:00.950711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:00.950711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:00.950711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:00.950711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:00.950711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:00.950711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:00.950711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:00.950711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:00.950711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:00.950711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:00.952021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:00.952021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:00.952021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:00.952021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:00.952021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 391/785] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:00.956890 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200822ef-7c6a-4dc8-84fa-a984e2fc2d3a None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:00.982466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:01.068645 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200822ef-7c6a-4dc8-84fa-a984e2fc2d3a None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:01.108989 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb7a96-9f20-4f5f-b888-f470377b47f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:01.109622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb7a96-9f20-4f5f-b888-f470377b47f6 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:01.109902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb7a96-9f20-4f5f-b888-f470377b47f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:01.110182 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb7a96-9f20-4f5f-b888-f470377b47f6 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:01.110911 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb7a96-9f20-4f5f-b888-f470377b47f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:01.111224 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb7a96-9f20-4f5f-b888-f470377b47f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:01.112599 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb7a96-9f20-4f5f-b888-f470377b47f6 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:01.125168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 395/786] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:01.130599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ebc76-7a67-45f2-8f2c-d5732f3739e9 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:01.236675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ebc76-7a67-45f2-8f2c-d5732f3739e9 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:01.261814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:01.283138 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89ce89-da5e-4d4b-93d6-1c394e110ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:01.286063 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89ce89-da5e-4d4b-93d6-1c394e110ae7 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:01.286063 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89ce89-da5e-4d4b-93d6-1c394e110ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:01.286063 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89ce89-da5e-4d4b-93d6-1c394e110ae7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:01.292956 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89ce89-da5e-4d4b-93d6-1c394e110ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:01.294646 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89ce89-da5e-4d4b-93d6-1c394e110ae7 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:01.312473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-ad89ce89-da5e-4d4b-93d6-1c394e110ae7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:41:01.312473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:01.312473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:01.312473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:01.312473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:01.312473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:01.312473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:01.312473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:01.312473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:01.312473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:01.312473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:01.312473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:01.312473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:41:01.312473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:41:01.312473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:41:01.312473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:41:01.313471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:01.313471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:01.313471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:41:01.313471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:01.313471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:41:01.313471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:01.313471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:01.313471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:01.313471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:01.313471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:01.313471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:01.313471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:01.313471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:01.313471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:01.313471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:01.313471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:01.313471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:01.313471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:01.314383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:01.314383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:01.314383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:41:01.314383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:41:01.314383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:41:01.314383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:41:01.314383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:41:01.314383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:41:01.314383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:41:01.314383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:01.314965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 392/787] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:41:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:01.323522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb7a96-9f20-4f5f-b888-f470377b47f6 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:01.424403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effcc05-ca87-4022-a2b1-5aab8d547d3c None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:01.424734 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effcc05-ca87-4022-a2b1-5aab8d547d3c None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:01.424958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effcc05-ca87-4022-a2b1-5aab8d547d3c None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:01.426471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 393/788] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:01.435738 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167ecee-58b9-44fa-807d-23467d4efe0f None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:01.436017 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167ecee-58b9-44fa-807d-23467d4efe0f None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:01.436288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167ecee-58b9-44fa-807d-23467d4efe0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:01.466820 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:01.479388 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-d167ecee-58b9-44fa-807d-23467d4efe0f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:01.484526 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb7a96-9f20-4f5f-b888-f470377b47f6 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:01.484653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d167ecee-58b9-44fa-807d-23467d4efe0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:01.516313 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31262272-ae0e-40c9-8eda-d5dde525052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:01.517162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31262272-ae0e-40c9-8eda-d5dde525052f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:01.517553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31262272-ae0e-40c9-8eda-d5dde525052f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:01.517938 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31262272-ae0e-40c9-8eda-d5dde525052f None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:01.518953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31262272-ae0e-40c9-8eda-d5dde525052f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:01.519386 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31262272-ae0e-40c9-8eda-d5dde525052f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:01.520999 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31262272-ae0e-40c9-8eda-d5dde525052f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:01.544026 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 396/789] 10.222.0.86 () {56 vars in 1135 bytes} [Tue Jul 26 14:41:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:01.545406 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31262272-ae0e-40c9-8eda-d5dde525052f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:01.624925 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 394/790] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:01.662977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31262272-ae0e-40c9-8eda-d5dde525052f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:01.696054 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167ecee-58b9-44fa-807d-23467d4efe0f None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:01.708655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a4d20-f990-44b4-a1e1-d6930ec82caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:01.709310 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a4d20-f990-44b4-a1e1-d6930ec82caa None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:01.709597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a4d20-f990-44b4-a1e1-d6930ec82caa None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:01.709877 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a4d20-f990-44b4-a1e1-d6930ec82caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:01.721008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a4d20-f990-44b4-a1e1-d6930ec82caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:01.722638 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a4d20-f990-44b4-a1e1-d6930ec82caa None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:01.730774 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:01.743602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-e57a4d20-f990-44b4-a1e1-d6930ec82caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:01.743602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:01.743602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:01.743602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:01.743602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:01.743602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:01.743602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:01.743602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:01.743602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:01.743602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:01.743602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:01.743602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:01.743602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:01.743602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:01.743602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:01.744581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:01.744581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:01.744581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:01.744581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:01.744581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:01.744581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:01.744581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:01.744581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:01.744581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:01.744581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:01.744581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:01.744581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:01.744581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:01.744581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:01.744581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:01.744581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:01.744581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:01.745521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:01.745521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:01.745521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:01.745521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:01.749915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 397/791] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:01.752067 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a4d20-f990-44b4-a1e1-d6930ec82caa None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:01.853889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167ecee-58b9-44fa-807d-23467d4efe0f None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:01.872074 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:01.899567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fb160-f287-4893-8925-d38054bd3f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:01.900321 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fb160-f287-4893-8925-d38054bd3f02 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:01.900855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fb160-f287-4893-8925-d38054bd3f02 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:01.900855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fb160-f287-4893-8925-d38054bd3f02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:01.916006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fb160-f287-4893-8925-d38054bd3f02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:41:01.921563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-590fb160-f287-4893-8925-d38054bd3f02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:41:01.921563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:01.921563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:01.921563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:01.921563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:01.921563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:01.921563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:01.921563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:01.921563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:01.921563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:01.921563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:01.921563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:01.921563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:41:01.921563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:41:01.921563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:41:01.921563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:41:01.922520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:41:01.922520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:41:01.922520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:41:01.922520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:41:01.922520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:01.922520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:01.922520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:01.922520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:01.922520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:01.922520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:01.922520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:01.922520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:01.922520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:01.922520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:01.922520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:01.922520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:01.923711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:01.923711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:01.923711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:01.923711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:01.923711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:41:01.923711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:41:01.923711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:41:01.923711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:41:01.923711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:41:01.923711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:41:01.923711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:41:01.923711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:01.923711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 395/792] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:41:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:01.931651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fb160-f287-4893-8925-d38054bd3f02 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:01.958564 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a4d20-f990-44b4-a1e1-d6930ec82caa None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:02.024643 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e73e7-8492-4fb6-a232-a71b70e54df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:02.026339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e73e7-8492-4fb6-a232-a71b70e54df0 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:02.026828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e73e7-8492-4fb6-a232-a71b70e54df0 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:02.027438 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e73e7-8492-4fb6-a232-a71b70e54df0 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:02.029434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e73e7-8492-4fb6-a232-a71b70e54df0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:02.030702 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e73e7-8492-4fb6-a232-a71b70e54df0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:02.033805 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e73e7-8492-4fb6-a232-a71b70e54df0 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:02.053834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 398/793] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:02.058768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e73e7-8492-4fb6-a232-a71b70e54df0 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:02.136354 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fb160-f287-4893-8925-d38054bd3f02 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:02.154736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:02.213286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3253a-c84d-4b7d-8b0c-dd4729a83c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:02.213920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3253a-c84d-4b7d-8b0c-dd4729a83c67 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:02.214203 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3253a-c84d-4b7d-8b0c-dd4729a83c67 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:02.214550 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3253a-c84d-4b7d-8b0c-dd4729a83c67 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:02.215237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3253a-c84d-4b7d-8b0c-dd4729a83c67 None admin] RBAC: Adding query filter params (name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:02.215743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3253a-c84d-4b7d-8b0c-dd4729a83c67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:02.216910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3253a-c84d-4b7d-8b0c-dd4729a83c67 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:02.221897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e73e7-8492-4fb6-a232-a71b70e54df0 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:02.234007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 396/794] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:41:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:02.239239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3253a-c84d-4b7d-8b0c-dd4729a83c67 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:02.258567 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c6cb0-d4a4-4ab4-9516-db43539c3804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:02.259643 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c6cb0-d4a4-4ab4-9516-db43539c3804 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:02.260128 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c6cb0-d4a4-4ab4-9516-db43539c3804 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:02.260553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c6cb0-d4a4-4ab4-9516-db43539c3804 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:02.268118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c6cb0-d4a4-4ab4-9516-db43539c3804 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:02.269829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c6cb0-d4a4-4ab4-9516-db43539c3804 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:02.283541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-170c6cb0-d4a4-4ab4-9516-db43539c3804 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:02.283541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:02.283541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:02.283541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:02.283541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:02.283541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:02.283541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:02.283541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:02.283541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:02.283541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:02.283541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:02.283541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:02.283541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:41:02.283541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:41:02.283541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:41:02.284608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:41:02.284608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:02.284608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:02.284608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:02.284608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:02.284608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:02.284608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:02.284608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:02.284608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:02.284608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:02.284608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:02.284608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:02.284608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:02.284608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:02.284608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:02.284608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:02.284608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:02.285715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:41:02.285715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:41:02.285715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:41:02.285715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:41:02.285715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:41:02.285715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:41:02.285715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:02.285715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:02.287796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 399/795] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:41:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:02.293740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c6cb0-d4a4-4ab4-9516-db43539c3804 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:02.303743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:02.396542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3253a-c84d-4b7d-8b0c-dd4729a83c67 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:02.404562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c6cb0-d4a4-4ab4-9516-db43539c3804 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:02.415711 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:02.432352 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b0568-868c-4c6a-9990-7cb94cb82cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:02.432997 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b0568-868c-4c6a-9990-7cb94cb82cf3 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:02.433274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b0568-868c-4c6a-9990-7cb94cb82cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:02.433549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b0568-868c-4c6a-9990-7cb94cb82cf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:02.444499 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2f9d0-d530-45ae-b77b-0eb02cbf57df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:02.445255 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2f9d0-d530-45ae-b77b-0eb02cbf57df None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:02.445610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2f9d0-d530-45ae-b77b-0eb02cbf57df None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:02.445963 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2f9d0-d530-45ae-b77b-0eb02cbf57df None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:02.446116 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b0568-868c-4c6a-9990-7cb94cb82cf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:02.446883 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2f9d0-d530-45ae-b77b-0eb02cbf57df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:02.447262 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2f9d0-d530-45ae-b77b-0eb02cbf57df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:02.447642 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b0568-868c-4c6a-9990-7cb94cb82cf3 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:02.449925 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2f9d0-d530-45ae-b77b-0eb02cbf57df None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:02.464340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-b43b0568-868c-4c6a-9990-7cb94cb82cf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:02.464340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:02.464340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:02.464340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:02.464340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:02.464340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:02.464340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:02.464340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:02.464340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:02.464340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:02.464340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:02.464340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:02.464340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:02.464340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:02.464340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:02.465279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:02.465279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:02.465279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:02.465279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:02.465279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:02.465279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:02.465279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:02.465279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:02.465279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:02.465279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:02.465279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:02.465279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:02.465279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:02.465279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:02.465279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:02.465279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:02.465279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:02.466195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:02.466195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:02.466195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:02.466195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:02.466462 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 400/796] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:41:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:02.466537 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 397/797] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:02.466604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60d850-b50a-4146-955a-38b7b9ff463f None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:02.466604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60d850-b50a-4146-955a-38b7b9ff463f None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:02.466739 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60d850-b50a-4146-955a-38b7b9ff463f None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:02.471548 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b0568-868c-4c6a-9990-7cb94cb82cf3 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:02.472576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 401/798] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:02.473382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60d850-b50a-4146-955a-38b7b9ff463f None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:02.564573 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:02.577292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b0568-868c-4c6a-9990-7cb94cb82cf3 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:02.588822 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60d850-b50a-4146-955a-38b7b9ff463f None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:02.612903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a9df4-4e40-45b0-91ed-df62b0e9af8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:02.613445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a9df4-4e40-45b0-91ed-df62b0e9af8a None admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:02.613730 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a9df4-4e40-45b0-91ed-df62b0e9af8a None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:02.614009 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a9df4-4e40-45b0-91ed-df62b0e9af8a None admin] PATH_INFO: `/v3/projects/12937bc17f02483285f18c492fe237e3/users/462ecbb85c6b4a17a952fb74fa2de65e/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:02.616029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a9df4-4e40-45b0-91ed-df62b0e9af8a None admin] RBAC: Authorizing `identity:create_grant(project_id=12937bc17f02483285f18c492fe237e3, user_id=462ecbb85c6b4a17a952fb74fa2de65e, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:02.617516 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a9df4-4e40-45b0-91ed-df62b0e9af8a None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:02.628954 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23b192-626f-4622-b790-46fdc23762af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:02.629799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23b192-626f-4622-b790-46fdc23762af None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:02.634550 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23b192-626f-4622-b790-46fdc23762af None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:02.634550 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23b192-626f-4622-b790-46fdc23762af None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:02.634550 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23b192-626f-4622-b790-46fdc23762af None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:02.634550 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23b192-626f-4622-b790-46fdc23762af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:02.634550 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23b192-626f-4622-b790-46fdc23762af None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:02.645826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 402/799] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:02.654781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca35e6-9001-4f64-87e1-779c8c81c24e None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:02.654781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca35e6-9001-4f64-87e1-779c8c81c24e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:02.654781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca35e6-9001-4f64-87e1-779c8c81c24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:02.670563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-62ca35e6-9001-4f64-87e1-779c8c81c24e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:02.672013 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-62ca35e6-9001-4f64-87e1-779c8c81c24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:02.699450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:02.705869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 398/800] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:41:02 2022] PUT /identity/v3/projects/12937bc17f02483285f18c492fe237e3/users/462ecbb85c6b4a17a952fb74fa2de65e/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:41:02.707996 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a9df4-4e40-45b0-91ed-df62b0e9af8a None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:02.837759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a9df4-4e40-45b0-91ed-df62b0e9af8a None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:02.840193 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 403/801] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:02.871542 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca35e6-9001-4f64-87e1-779c8c81c24e None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:02.878774 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f36f83-6344-4020-b8bd-a0b312a94a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:02.879729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f36f83-6344-4020-b8bd-a0b312a94a12 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:02.880257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f36f83-6344-4020-b8bd-a0b312a94a12 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:02.880745 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f36f83-6344-4020-b8bd-a0b312a94a12 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:02.891611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f36f83-6344-4020-b8bd-a0b312a94a12 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:02.894183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f36f83-6344-4020-b8bd-a0b312a94a12 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:02.910581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-75f36f83-6344-4020-b8bd-a0b312a94a12 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:41:02.910581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:02.910581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:02.910581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:02.910581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:02.910581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:02.910581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:02.910581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:02.910581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:02.910581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:02.910581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:02.910581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:02.910581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:41:02.910581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:41:02.910581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:41:02.910581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:41:02.911650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:02.911650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:02.911650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:41:02.911650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:02.911650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:41:02.911650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:02.911650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:02.911650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:02.911650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:02.911650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:02.911650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:02.911650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:02.911650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:02.911650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:02.911650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:02.911650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:02.911650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:02.911650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:02.914671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:02.914671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:02.914671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:41:02.914671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:41:02.914671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:41:02.914671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:41:02.914671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:41:02.914671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:41:02.914671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:41:02.914671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:02.914671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 399/802] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jul 26 14:41:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:02.914671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeb454-2e2c-4670-b575-856e9d16dd59 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:02.914671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeb454-2e2c-4670-b575-856e9d16dd59 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:02.915664 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeb454-2e2c-4670-b575-856e9d16dd59 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:02.915664 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 400/803] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:02.920340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeb454-2e2c-4670-b575-856e9d16dd59 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:02.933297 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:03.005894 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca35e6-9001-4f64-87e1-779c8c81c24e None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:03.046561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df122f-9977-42b2-b3f9-439e3f29a636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:03.047213 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df122f-9977-42b2-b3f9-439e3f29a636 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:03.047495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df122f-9977-42b2-b3f9-439e3f29a636 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:03.047772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df122f-9977-42b2-b3f9-439e3f29a636 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:03.059798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df122f-9977-42b2-b3f9-439e3f29a636 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:41:03.061188 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeb454-2e2c-4670-b575-856e9d16dd59 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:03.065057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-32df122f-9977-42b2-b3f9-439e3f29a636 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:41:03.065057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:03.065057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:03.065057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:03.065057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:03.065057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:03.065057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:03.065057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:03.065057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:03.065057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:03.065057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:03.065057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:03.065057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:41:03.065057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:41:03.065057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:41:03.065057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:41:03.065966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:41:03.065966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:41:03.065966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:41:03.065966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:41:03.065966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:03.065966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:03.065966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:03.065966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:03.065966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:03.065966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:03.065966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:03.065966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:03.065966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:03.065966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:03.065966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:03.065966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:03.066909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:03.066909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:03.066909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:03.066909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:03.066909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:41:03.066909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:41:03.066909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:41:03.066909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:41:03.066909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:41:03.066909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:41:03.066909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:41:03.066909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:03.066909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 404/804] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:41:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:03.072947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262ea6-fe10-482f-b786-45d916bbdab1 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:03.073292 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262ea6-fe10-482f-b786-45d916bbdab1 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:03.073580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262ea6-fe10-482f-b786-45d916bbdab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:03.093469 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-d7262ea6-fe10-482f-b786-45d916bbdab1 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:03.094693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d7262ea6-fe10-482f-b786-45d916bbdab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:03.109931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6333b5-274a-4324-9b84-3efcafde9c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:03.110728 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:03.112338 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6333b5-274a-4324-9b84-3efcafde9c9b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:03.112852 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6333b5-274a-4324-9b84-3efcafde9c9b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:03.113544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6333b5-274a-4324-9b84-3efcafde9c9b None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:03.114659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6333b5-274a-4324-9b84-3efcafde9c9b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:03.115125 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6333b5-274a-4324-9b84-3efcafde9c9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:03.117565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6333b5-274a-4324-9b84-3efcafde9c9b None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:03.145074 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 401/805] 10.222.0.86 () {56 vars in 1149 bytes} [Tue Jul 26 14:41:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:03.147717 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6333b5-274a-4324-9b84-3efcafde9c9b None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:03.182959 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 405/806] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:03.182959 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7262ea6-fe10-482f-b786-45d916bbdab1 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:03.237213 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:03.273779 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6333b5-274a-4324-9b84-3efcafde9c9b None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:03.291822 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7262ea6-fe10-482f-b786-45d916bbdab1 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:03.310893 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bd431-078a-490c-b32a-b1d143b1b31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:03.311613 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bd431-078a-490c-b32a-b1d143b1b31a None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:03.311968 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bd431-078a-490c-b32a-b1d143b1b31a None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:03.312316 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bd431-078a-490c-b32a-b1d143b1b31a None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:03.313107 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bd431-078a-490c-b32a-b1d143b1b31a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:03.313424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bd431-078a-490c-b32a-b1d143b1b31a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:03.314824 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bd431-078a-490c-b32a-b1d143b1b31a None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:03.328387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 402/807] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:41:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:03.328387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34de96-b43c-437f-b29d-7519db351f02 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:03.328387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34de96-b43c-437f-b29d-7519db351f02 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:03.328387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34de96-b43c-437f-b29d-7519db351f02 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:03.328387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 403/808] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:03.328387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34de96-b43c-437f-b29d-7519db351f02 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:03.331647 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c1e57-0614-499f-b01a-891ea184eab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:03.332485 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c1e57-0614-499f-b01a-891ea184eab2 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:03.332765 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c1e57-0614-499f-b01a-891ea184eab2 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:03.333044 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c1e57-0614-499f-b01a-891ea184eab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:03.343993 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c1e57-0614-499f-b01a-891ea184eab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:03.345440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c1e57-0614-499f-b01a-891ea184eab2 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:03.357543 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:03.366072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-7d4c1e57-0614-499f-b01a-891ea184eab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:03.366072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:03.366072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:03.366072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:03.366072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:03.366072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:03.366072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:03.366072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:03.366072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:03.366072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:03.366072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:03.366072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:03.366072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:03.366072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:03.366072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:03.367449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:03.367449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:03.367449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:03.367449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:03.367449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:03.367449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:03.367449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:03.367449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:03.367449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:03.367449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:03.367449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:03.367449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:03.367449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:03.367449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:03.367449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:03.367449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:03.367449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:03.368334 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:03.368334 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:03.368334 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:03.368334 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:03.370525 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 406/809] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:03.371563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c1e57-0614-499f-b01a-891ea184eab2 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:03.458398 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34de96-b43c-437f-b29d-7519db351f02 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:03.478921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c1e57-0614-499f-b01a-891ea184eab2 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:03.490641 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:03.499410 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9debb-e68c-4d8d-a28b-3df75b2ac27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:03.500135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9debb-e68c-4d8d-a28b-3df75b2ac27b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:03.500492 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9debb-e68c-4d8d-a28b-3df75b2ac27b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:03.500841 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9debb-e68c-4d8d-a28b-3df75b2ac27b None admin] PATH_INFO: `/v3/services/network` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:03.501536 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9debb-e68c-4d8d-a28b-3df75b2ac27b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:03.503205 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9debb-e68c-4d8d-a28b-3df75b2ac27b None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:03.513357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-09f9debb-e68c-4d8d-a28b-3df75b2ac27b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:41:03.513357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:03.513357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:03.513357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:03.513357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:03.513357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:03.513357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:03.513357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:03.513357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:41:03.513357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:03.513357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:03.513357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:03.513357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:03.513357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:03.513357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:03.513357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:03.513357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:03.514588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:03.514588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:03.514588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:03.514588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:03.514588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:03.514588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:03.514588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:03.514588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:03.514588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:03.514588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:03.514588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:03.514588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:03.514588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:03.514588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:03.514588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:03.514588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:03.515675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:03.515675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:03.515675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:03.515675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:03.515675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:03.515675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:03.515675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:03.515675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:03.515675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:03.515675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:03.515675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:03.515675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:03.515675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:41:03.515675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:03.516575 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e11a96-40bd-4422-b64e-72922755034c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:03.516675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 404/810] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:41:03 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:03.516763 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e11a96-40bd-4422-b64e-72922755034c None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:03.516763 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e11a96-40bd-4422-b64e-72922755034c None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:03.516763 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e11a96-40bd-4422-b64e-72922755034c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:03.516972 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f156c8f-fba4-41e7-be30-675f260d2f4f None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:03.516972 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f156c8f-fba4-41e7-be30-675f260d2f4f None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:03.517122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f156c8f-fba4-41e7-be30-675f260d2f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:03.529594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e11a96-40bd-4422-b64e-72922755034c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:03.531076 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e11a96-40bd-4422-b64e-72922755034c None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:03.538729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-6f156c8f-fba4-41e7-be30-675f260d2f4f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:03.540516 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-6f156c8f-fba4-41e7-be30-675f260d2f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:03.545810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-16e11a96-40bd-4422-b64e-72922755034c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:03.545810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:03.545810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:03.545810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:03.545810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:03.545810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:03.545810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:03.545810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:03.545810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:03.545810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:03.545810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:03.545810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:03.545810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:03.545810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:03.545810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:03.546772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:03.546772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:03.546772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:03.546772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:03.546772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:03.546772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:03.546772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:03.546772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:03.546772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:03.546772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:03.546772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:03.546772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:03.546772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:03.546772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:03.546772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:03.546772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:03.546772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:03.548323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:03.548323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:03.548323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:03.548323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:03.548323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 407/811] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:03.548323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e11a96-40bd-4422-b64e-72922755034c None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:03.605265 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:03.619259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 405/812] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:03.620113 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f156c8f-fba4-41e7-be30-675f260d2f4f None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:03.662687 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e11a96-40bd-4422-b64e-72922755034c None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:03.701140 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfd2bd-810e-428c-afb5-292282792589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:03.701760 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfd2bd-810e-428c-afb5-292282792589 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:03.702044 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfd2bd-810e-428c-afb5-292282792589 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:03.702320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfd2bd-810e-428c-afb5-292282792589 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:03.703039 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfd2bd-810e-428c-afb5-292282792589 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:03.703345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfd2bd-810e-428c-afb5-292282792589 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:03.705397 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfd2bd-810e-428c-afb5-292282792589 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:03.721523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 408/813] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:03.721523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfd2bd-810e-428c-afb5-292282792589 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:03.742486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f156c8f-fba4-41e7-be30-675f260d2f4f None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:03.769013 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:03.781631 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fcf47-017f-40c7-8912-e02784c482c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:03.784683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fcf47-017f-40c7-8912-e02784c482c5 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:03.784683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fcf47-017f-40c7-8912-e02784c482c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:03.784683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fcf47-017f-40c7-8912-e02784c482c5 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:03.784683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fcf47-017f-40c7-8912-e02784c482c5 None admin] RBAC: Adding query filter params (name=network) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:03.784683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fcf47-017f-40c7-8912-e02784c482c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:03.785389 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fcf47-017f-40c7-8912-e02784c482c5 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:03.789810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 406/814] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jul 26 14:41:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:03.790619 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fcf47-017f-40c7-8912-e02784c482c5 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:03.837750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfd2bd-810e-428c-afb5-292282792589 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:03.852535 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:03.876706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e873e0d-b942-471f-9d17-05dfbc94df83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:03.877379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e873e0d-b942-471f-9d17-05dfbc94df83 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:03.877705 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e873e0d-b942-471f-9d17-05dfbc94df83 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:03.878034 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e873e0d-b942-471f-9d17-05dfbc94df83 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:03.878889 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e873e0d-b942-471f-9d17-05dfbc94df83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:03.879358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e873e0d-b942-471f-9d17-05dfbc94df83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:03.880749 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e873e0d-b942-471f-9d17-05dfbc94df83 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:03.899725 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 409/815] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:03.899725 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e873e0d-b942-471f-9d17-05dfbc94df83 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:03.903868 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fcf47-017f-40c7-8912-e02784c482c5 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:03.943365 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142fceb-8014-4d78-a8f7-df42083651dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:03.944264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142fceb-8014-4d78-a8f7-df42083651dc None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:03.944543 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142fceb-8014-4d78-a8f7-df42083651dc None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:03.944814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142fceb-8014-4d78-a8f7-df42083651dc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:03.945505 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142fceb-8014-4d78-a8f7-df42083651dc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:03.946974 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142fceb-8014-4d78-a8f7-df42083651dc None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:03.955976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-c142fceb-8014-4d78-a8f7-df42083651dc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:41:03.955976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:03.955976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:03.955976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:03.955976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:03.955976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:03.955976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:03.955976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:03.955976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:41:03.955976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:03.955976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:03.955976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:03.955976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:03.955976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:03.955976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:03.955976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:03.957156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:03.957156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:03.957156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:03.957156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:03.957156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:03.957156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:03.957156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:03.957156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:03.957156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:03.957156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:03.957156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:03.957156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:03.957156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:03.957156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:03.957156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:03.957156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:03.963377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:03.963377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:03.963377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:03.963377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:03.963377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:03.963377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:03.963377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:03.963377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:03.963377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:03.963377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:03.963377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:03.963377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:03.963377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:03.963377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:41:03.963377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:03.963377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 407/816] 10.222.0.86 () {56 vars in 1129 bytes} [Tue Jul 26 14:41:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:03.964424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142fceb-8014-4d78-a8f7-df42083651dc None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:04.016426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e873e0d-b942-471f-9d17-05dfbc94df83 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:04.017362 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:04.052654 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e751905-971c-4e17-800f-81e9127607b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:04.053438 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e751905-971c-4e17-800f-81e9127607b7 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:04.053786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e751905-971c-4e17-800f-81e9127607b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:04.054065 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e751905-971c-4e17-800f-81e9127607b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:04.061268 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e751905-971c-4e17-800f-81e9127607b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:04.062734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e751905-971c-4e17-800f-81e9127607b7 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:04.069526 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142fceb-8014-4d78-a8f7-df42083651dc None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:04.074693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-0e751905-971c-4e17-800f-81e9127607b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:04.074693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:04.074693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:04.074693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:04.074693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:04.074693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:04.074693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:04.074693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:04.074693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:04.074693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:04.074693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:04.074693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:04.074693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:41:04.074693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:41:04.074693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:41:04.075672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:41:04.075672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:04.075672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:04.075672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:04.075672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:04.075672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:04.075672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:04.075672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:04.075672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:04.075672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:04.075672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:04.075672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:04.075672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:04.075672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:04.075672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:04.075672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:04.075672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:04.076573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:41:04.076573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:41:04.076573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:41:04.076573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:41:04.076573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:41:04.076573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:41:04.076573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:04.076573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:04.076573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 410/817] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:41:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:04.077050 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e751905-971c-4e17-800f-81e9127607b7 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:04.110816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc67791-d495-4c8f-8cf5-865796646458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:04.111499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc67791-d495-4c8f-8cf5-865796646458 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:04.111743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc67791-d495-4c8f-8cf5-865796646458 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:04.112000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc67791-d495-4c8f-8cf5-865796646458 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:04.112669 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc67791-d495-4c8f-8cf5-865796646458 None admin] RBAC: Adding query filter params (type=network) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:04.113172 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc67791-d495-4c8f-8cf5-865796646458 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:04.114500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc67791-d495-4c8f-8cf5-865796646458 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:04.115466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:04.125207 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 408/818] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jul 26 14:41:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:04.125207 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc67791-d495-4c8f-8cf5-865796646458 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:04.187431 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e751905-971c-4e17-800f-81e9127607b7 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:04.221869 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e5ef9-b76d-433e-b8cf-79184bdbceab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:04.222676 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e5ef9-b76d-433e-b8cf-79184bdbceab None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:04.222963 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e5ef9-b76d-433e-b8cf-79184bdbceab None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:04.223246 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e5ef9-b76d-433e-b8cf-79184bdbceab None admin] PATH_INFO: `/v3/users/nova` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:04.231140 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e5ef9-b76d-433e-b8cf-79184bdbceab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:04.232601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e5ef9-b76d-433e-b8cf-79184bdbceab None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:04.236549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc67791-d495-4c8f-8cf5-865796646458 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:04.244460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-175e5ef9-b76d-433e-b8cf-79184bdbceab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:41:04.244460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:04.244460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:04.244460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:04.244460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:04.244460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:04.244460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:04.244460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:04.244460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:04.244460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:04.244460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:04.244460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:04.244460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:41:04.244460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:41:04.244460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:41:04.244460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:41:04.245621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:04.245621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:04.245621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:41:04.245621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:04.245621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:41:04.245621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:04.245621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:04.245621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:04.245621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:04.245621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:04.245621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:04.245621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:04.245621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:04.245621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:04.245621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:04.245621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:04.245621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:04.245621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:04.246814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:04.246814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:04.246814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:41:04.246814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:41:04.246814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:41:04.246814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:41:04.246814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:41:04.246814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:41:04.246814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:41:04.246814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:04.250533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 411/819] 10.222.0.86 () {56 vars in 1093 bytes} [Tue Jul 26 14:41:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:04.251341 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e5ef9-b76d-433e-b8cf-79184bdbceab None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:04.253323 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:04.276627 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4a3f8-724f-4a21-9dd0-3a1a1b463b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:04.277165 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4a3f8-724f-4a21-9dd0-3a1a1b463b0b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:04.277447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4a3f8-724f-4a21-9dd0-3a1a1b463b0b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:04.277726 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4a3f8-724f-4a21-9dd0-3a1a1b463b0b None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:04.278420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4a3f8-724f-4a21-9dd0-3a1a1b463b0b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:04.278725 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4a3f8-724f-4a21-9dd0-3a1a1b463b0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:04.280186 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4a3f8-724f-4a21-9dd0-3a1a1b463b0b None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:04.289788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 409/820] 10.222.0.86 () {56 vars in 1124 bytes} [Tue Jul 26 14:41:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:04.289788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4a3f8-724f-4a21-9dd0-3a1a1b463b0b None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:04.352423 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:04.361951 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e5ef9-b76d-433e-b8cf-79184bdbceab None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:04.398937 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c54ad-6a70-452a-abf5-e202fbbb377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:04.399475 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4a3f8-724f-4a21-9dd0-3a1a1b463b0b None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:04.399590 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c54ad-6a70-452a-abf5-e202fbbb377b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:04.399832 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c54ad-6a70-452a-abf5-e202fbbb377b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:04.400105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c54ad-6a70-452a-abf5-e202fbbb377b None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:04.400858 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c54ad-6a70-452a-abf5-e202fbbb377b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:04.401165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c54ad-6a70-452a-abf5-e202fbbb377b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:04.402614 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c54ad-6a70-452a-abf5-e202fbbb377b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:04.415123 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 412/821] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:41:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:04.416124 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c54ad-6a70-452a-abf5-e202fbbb377b None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:04.447250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db940c30-9e4d-491e-9dcf-3256d1c998bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:04.447878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db940c30-9e4d-491e-9dcf-3256d1c998bd None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:04.448173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db940c30-9e4d-491e-9dcf-3256d1c998bd None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:04.448434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db940c30-9e4d-491e-9dcf-3256d1c998bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:04.449150 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db940c30-9e4d-491e-9dcf-3256d1c998bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:04.452185 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db940c30-9e4d-491e-9dcf-3256d1c998bd None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:04.533620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c54ad-6a70-452a-abf5-e202fbbb377b None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:04.567059 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b75a38-737d-4587-bacb-35792c674a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:04.567672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b75a38-737d-4587-bacb-35792c674a8d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:04.567953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b75a38-737d-4587-bacb-35792c674a8d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:04.568227 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b75a38-737d-4587-bacb-35792c674a8d None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:04.569015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b75a38-737d-4587-bacb-35792c674a8d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:04.569323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b75a38-737d-4587-bacb-35792c674a8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:04.570815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b75a38-737d-4587-bacb-35792c674a8d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:04.598430 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 410/822] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:41:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:41:04.598701 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 413/823] 10.222.0.86 () {56 vars in 1133 bytes} [Tue Jul 26 14:41:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:04.598811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db940c30-9e4d-491e-9dcf-3256d1c998bd None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:04.598897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b75a38-737d-4587-bacb-35792c674a8d None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:04.613992 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:04.634218 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:04.733751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db940c30-9e4d-491e-9dcf-3256d1c998bd None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:04.751771 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b75a38-737d-4587-bacb-35792c674a8d None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:04.784791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16679562-a0fd-4e76-9653-f2e21aeaeafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:04.785346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16679562-a0fd-4e76-9653-f2e21aeaeafb None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:04.785632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16679562-a0fd-4e76-9653-f2e21aeaeafb None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:04.785911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16679562-a0fd-4e76-9653-f2e21aeaeafb None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:04.786629 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16679562-a0fd-4e76-9653-f2e21aeaeafb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:04.786941 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16679562-a0fd-4e76-9653-f2e21aeaeafb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:04.788327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16679562-a0fd-4e76-9653-f2e21aeaeafb None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:04.794937 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 411/824] 10.222.0.86 () {56 vars in 1124 bytes} [Tue Jul 26 14:41:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:04.796127 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16679562-a0fd-4e76-9653-f2e21aeaeafb None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:04.801120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868c252-f648-4469-abf1-3e0f9b389b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:04.802124 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868c252-f648-4469-abf1-3e0f9b389b1e None admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:04.802749 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868c252-f648-4469-abf1-3e0f9b389b1e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:04.803300 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868c252-f648-4469-abf1-3e0f9b389b1e None admin] PATH_INFO: `/v3/projects/12937bc17f02483285f18c492fe237e3/users/0834be7405cd4c968763099251d37154/roles/7f17a5a0295f42e793e343cff968367c` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:04.821075 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868c252-f648-4469-abf1-3e0f9b389b1e None admin] RBAC: Authorizing `identity:create_grant(project_id=12937bc17f02483285f18c492fe237e3, user_id=0834be7405cd4c968763099251d37154, role_id=7f17a5a0295f42e793e343cff968367c)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:04.822641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868c252-f648-4469-abf1-3e0f9b389b1e None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:04.901402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:04.907684 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16679562-a0fd-4e76-9653-f2e21aeaeafb None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:04.924460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 414/825] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:41:04 2022] PUT /identity/v3/projects/12937bc17f02483285f18c492fe237e3/users/0834be7405cd4c968763099251d37154/roles/7f17a5a0295f42e793e343cff968367c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:41:04.925272 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868c252-f648-4469-abf1-3e0f9b389b1e None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:04.940986 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0f521-ad2c-48b7-a11a-407fb8fde042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:04.941844 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0f521-ad2c-48b7-a11a-407fb8fde042 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:04.942112 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0f521-ad2c-48b7-a11a-407fb8fde042 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:04.942377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0f521-ad2c-48b7-a11a-407fb8fde042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:05.002363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:05.019386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0f521-ad2c-48b7-a11a-407fb8fde042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:05.020875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0f521-ad2c-48b7-a11a-407fb8fde042 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:05.046439 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868c252-f648-4469-abf1-3e0f9b389b1e None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:05.091723 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65cd5a-9b92-4641-8af3-9cd573372947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:05.092356 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65cd5a-9b92-4641-8af3-9cd573372947 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:05.092637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65cd5a-9b92-4641-8af3-9cd573372947 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:05.092935 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65cd5a-9b92-4641-8af3-9cd573372947 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:05.093651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65cd5a-9b92-4641-8af3-9cd573372947 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:05.095061 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65cd5a-9b92-4641-8af3-9cd573372947 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:05.127236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:05.139006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 412/826] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:41:04 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:41:05.139006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2ae26-bfe7-4f69-823c-1ec25f57a667 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:05.139006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2ae26-bfe7-4f69-823c-1ec25f57a667 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:05.139006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2ae26-bfe7-4f69-823c-1ec25f57a667 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:05.139006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 413/827] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:05.139872 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2ae26-bfe7-4f69-823c-1ec25f57a667 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:05.199919 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 415/828] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:41:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:41:05.208396 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af4b57-05e4-4b00-a9cc-7305900ff0e4 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:05.208678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af4b57-05e4-4b00-a9cc-7305900ff0e4 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:05.209008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af4b57-05e4-4b00-a9cc-7305900ff0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:05.242219 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-a8af4b57-05e4-4b00-a9cc-7305900ff0e4 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:05.244430 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-a8af4b57-05e4-4b00-a9cc-7305900ff0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:05.255865 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2ae26-bfe7-4f69-823c-1ec25f57a667 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:05.297670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67000b-2a24-43c4-916d-98bdac909db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:05.298256 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67000b-2a24-43c4-916d-98bdac909db4 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:05.298592 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67000b-2a24-43c4-916d-98bdac909db4 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:05.298873 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67000b-2a24-43c4-916d-98bdac909db4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:05.311000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67000b-2a24-43c4-916d-98bdac909db4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:05.312715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67000b-2a24-43c4-916d-98bdac909db4 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:05.329273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-1f67000b-2a24-43c4-916d-98bdac909db4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:05.329273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:05.329273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:05.329273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:05.329273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:05.329273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:05.329273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:05.329273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:05.329273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:05.329273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:05.329273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:05.329273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:05.329273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:05.329273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:05.329273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:05.330222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:05.330222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:05.330222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:05.330222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:05.330222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:05.330222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:05.330222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:05.330222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:05.330222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:05.330222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:05.330222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:05.330222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:05.330222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:05.330222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:05.330222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:05.330222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:05.330222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:05.331122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:05.331122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:05.331122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:05.331122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:05.331122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 414/829] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:05.337042 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67000b-2a24-43c4-916d-98bdac909db4 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:05.351043 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 416/830] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:05.375623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af4b57-05e4-4b00-a9cc-7305900ff0e4 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:05.407396 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:05.431526 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:05.496825 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af4b57-05e4-4b00-a9cc-7305900ff0e4 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:05.506453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67000b-2a24-43c4-916d-98bdac909db4 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:05.537991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32e53c-492f-41ea-a607-0c9f33ef9164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:05.539984 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32e53c-492f-41ea-a607-0c9f33ef9164 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:05.540337 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32e53c-492f-41ea-a607-0c9f33ef9164 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:05.540684 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32e53c-492f-41ea-a607-0c9f33ef9164 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:05.549941 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d415adf-1775-418d-b637-e6e3aadad966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:05.550658 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d415adf-1775-418d-b637-e6e3aadad966 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:05.550952 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d415adf-1775-418d-b637-e6e3aadad966 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:05.551239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d415adf-1775-418d-b637-e6e3aadad966 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:05.551951 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d415adf-1775-418d-b637-e6e3aadad966 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:05.552267 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d415adf-1775-418d-b637-e6e3aadad966 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:05.553230 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32e53c-492f-41ea-a607-0c9f33ef9164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:41:05.553662 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d415adf-1775-418d-b637-e6e3aadad966 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:05.558964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-2c32e53c-492f-41ea-a607-0c9f33ef9164 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:41:05.558964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:05.558964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:05.558964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:05.558964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:05.558964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:05.558964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:05.558964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:05.558964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:05.558964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:05.558964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:05.558964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:05.558964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:41:05.558964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:41:05.558964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:41:05.558964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:41:05.559965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:41:05.559965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:41:05.559965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:41:05.559965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:41:05.559965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:05.559965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:05.559965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:05.559965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:05.559965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:05.559965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:05.559965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:05.559965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:05.559965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:05.559965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:05.559965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:05.559965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:05.560778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:05.560778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:05.560778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:05.560778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:05.560778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:41:05.560778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:41:05.560778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:41:05.560778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:41:05.560778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:41:05.560778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:41:05.560778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:41:05.560778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:05.560778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 417/831] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:41:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:05.566989 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32e53c-492f-41ea-a607-0c9f33ef9164 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:05.576191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 415/832] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:05.577108 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d415adf-1775-418d-b637-e6e3aadad966 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:05.700030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32e53c-492f-41ea-a607-0c9f33ef9164 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:05.701621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d415adf-1775-418d-b637-e6e3aadad966 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:05.708256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:05.732185 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:05.742550 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb6cb3-eef7-438f-8468-5d97df43ac4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:05.743486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb6cb3-eef7-438f-8468-5d97df43ac4f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:05.743987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb6cb3-eef7-438f-8468-5d97df43ac4f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:05.744475 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb6cb3-eef7-438f-8468-5d97df43ac4f None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:05.745392 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb6cb3-eef7-438f-8468-5d97df43ac4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:05.745889 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb6cb3-eef7-438f-8468-5d97df43ac4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:05.747003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fc321-a0da-402c-b773-c6bb54ac7a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:05.747726 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fc321-a0da-402c-b773-c6bb54ac7a06 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:05.747954 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb6cb3-eef7-438f-8468-5d97df43ac4f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:05.748057 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fc321-a0da-402c-b773-c6bb54ac7a06 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:05.748409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fc321-a0da-402c-b773-c6bb54ac7a06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:05.757897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fc321-a0da-402c-b773-c6bb54ac7a06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:05.762421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fc321-a0da-402c-b773-c6bb54ac7a06 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:05.762978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 418/833] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:41:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:05.765020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb6cb3-eef7-438f-8468-5d97df43ac4f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:05.774003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-1b3fc321-a0da-402c-b773-c6bb54ac7a06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:05.774003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:05.774003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:05.774003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:05.774003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:05.774003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:05.774003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:05.774003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:05.774003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:05.774003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:05.774003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:05.774003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:05.774003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:41:05.774003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:41:05.774003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:41:05.775140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:41:05.775140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:05.775140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:05.775140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:05.775140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:05.775140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:05.775140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:05.775140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:05.775140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:05.775140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:05.775140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:05.775140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:05.775140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:05.775140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:05.775140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:05.775140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:05.775140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:05.776033 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:41:05.776033 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:41:05.776033 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:41:05.776033 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:41:05.776033 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:41:05.776033 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:41:05.776033 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:05.776033 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:05.780667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 416/834] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:41:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:05.781530 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fc321-a0da-402c-b773-c6bb54ac7a06 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:05.896812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fc321-a0da-402c-b773-c6bb54ac7a06 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:05.903342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb6cb3-eef7-438f-8468-5d97df43ac4f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:05.938012 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407a176-d49d-43d9-b0e6-00ab27113a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:05.939283 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407a176-d49d-43d9-b0e6-00ab27113a32 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:05.939825 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407a176-d49d-43d9-b0e6-00ab27113a32 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:05.940362 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407a176-d49d-43d9-b0e6-00ab27113a32 None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:05.941359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407a176-d49d-43d9-b0e6-00ab27113a32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:05.941891 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407a176-d49d-43d9-b0e6-00ab27113a32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:05.943875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407a176-d49d-43d9-b0e6-00ab27113a32 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:05.948937 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747550e-e9b7-4d21-9a63-92fea385eda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:05.949589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747550e-e9b7-4d21-9a63-92fea385eda7 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:05.949870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747550e-e9b7-4d21-9a63-92fea385eda7 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:05.950144 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747550e-e9b7-4d21-9a63-92fea385eda7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:05.959294 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 417/835] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:41:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:05.967870 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407a176-d49d-43d9-b0e6-00ab27113a32 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:05.969355 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747550e-e9b7-4d21-9a63-92fea385eda7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:05.971099 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747550e-e9b7-4d21-9a63-92fea385eda7 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:05.987064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-c747550e-e9b7-4d21-9a63-92fea385eda7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:05.987064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:05.987064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:05.987064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:05.987064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:05.987064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:05.987064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:05.987064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:05.987064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:05.987064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:05.987064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:05.987064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:05.987064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:05.987064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:05.987064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:05.988012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:05.988012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:05.988012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:05.988012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:05.988012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:05.988012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:05.988012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:05.988012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:05.988012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:05.988012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:05.988012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:05.988012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:05.988012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:05.988012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:05.988012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:05.988012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:05.988012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:05.988912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:05.988912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:05.988912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:05.988912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:05.995627 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 419/836] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:05.996487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:05.997033 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747550e-e9b7-4d21-9a63-92fea385eda7 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:06.020322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:06.108610 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407a176-d49d-43d9-b0e6-00ab27113a32 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:06.112768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747550e-e9b7-4d21-9a63-92fea385eda7 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:06.150091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb88a58-6610-48ac-9d4d-e542890f251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:06.152109 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb88a58-6610-48ac-9d4d-e542890f251f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:06.152109 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb88a58-6610-48ac-9d4d-e542890f251f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:06.152109 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb88a58-6610-48ac-9d4d-e542890f251f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:06.152520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb88a58-6610-48ac-9d4d-e542890f251f None admin] RBAC: Adding query filter params (role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=d12fc26e640f4337b4a4da60cc4d9adc) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:06.152848 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb88a58-6610-48ac-9d4d-e542890f251f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:06.154083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc3a20-d5df-4c6a-ac0d-86b05b1677db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:06.154375 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb88a58-6610-48ac-9d4d-e542890f251f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:06.155161 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc3a20-d5df-4c6a-ac0d-86b05b1677db None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:06.155662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc3a20-d5df-4c6a-ac0d-86b05b1677db None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:06.156149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc3a20-d5df-4c6a-ac0d-86b05b1677db None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:06.157038 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc3a20-d5df-4c6a-ac0d-86b05b1677db None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:06.157556 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc3a20-d5df-4c6a-ac0d-86b05b1677db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:06.159334 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc3a20-d5df-4c6a-ac0d-86b05b1677db None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:06.166702 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 418/837] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:41:05 2022] GET /identity/v3/role_assignments?user.id=d12fc26e640f4337b4a4da60cc4d9adc&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:06.173722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 420/838] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:06.179891 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb88a58-6610-48ac-9d4d-e542890f251f None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:06.280590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:06.297954 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb88a58-6610-48ac-9d4d-e542890f251f None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:06.335869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762d2f1-6d58-45c7-8ac8-eb82c2d3c918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:06.336511 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762d2f1-6d58-45c7-8ac8-eb82c2d3c918 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:06.336790 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762d2f1-6d58-45c7-8ac8-eb82c2d3c918 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:06.337060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762d2f1-6d58-45c7-8ac8-eb82c2d3c918 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:06.345028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762d2f1-6d58-45c7-8ac8-eb82c2d3c918 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:06.346499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762d2f1-6d58-45c7-8ac8-eb82c2d3c918 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:06.359096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-d762d2f1-6d58-45c7-8ac8-eb82c2d3c918 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:41:06.359096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:06.359096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:06.359096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:06.359096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:06.359096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:06.359096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:06.359096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:06.359096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:06.359096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:06.359096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:06.359096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:06.359096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:41:06.359096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:41:06.359096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:41:06.359096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:41:06.360083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:06.360083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:06.360083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:41:06.360083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:06.360083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:41:06.360083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:06.360083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:06.360083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:06.360083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:06.360083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:06.360083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:06.360083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:06.360083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:06.360083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:06.360083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:06.360083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:06.360083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:06.360083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:06.360998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:06.360998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:06.360998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:41:06.360998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:41:06.360998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:41:06.360998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:41:06.360998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:41:06.360998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:41:06.360998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:41:06.360998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:06.360998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 419/839] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:41:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:06.368474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc3a20-d5df-4c6a-ac0d-86b05b1677db None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:06.469719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:06.493161 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc3a20-d5df-4c6a-ac0d-86b05b1677db None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:06.531175 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b420e2-1199-47bf-9970-5fe76bb65902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:06.532196 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b420e2-1199-47bf-9970-5fe76bb65902 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:06.532756 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b420e2-1199-47bf-9970-5fe76bb65902 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:06.533237 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b420e2-1199-47bf-9970-5fe76bb65902 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:06.534240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b420e2-1199-47bf-9970-5fe76bb65902 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:06.534937 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b420e2-1199-47bf-9970-5fe76bb65902 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:06.536565 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b420e2-1199-47bf-9970-5fe76bb65902 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:06.556057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 421/840] 10.222.0.86 () {56 vars in 1135 bytes} [Tue Jul 26 14:41:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:06.562480 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762d2f1-6d58-45c7-8ac8-eb82c2d3c918 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:06.681172 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762d2f1-6d58-45c7-8ac8-eb82c2d3c918 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:06.709252 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e9b71-3fe2-4e81-92b9-f50f5b38f92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:06.709878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e9b71-3fe2-4e81-92b9-f50f5b38f92e None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:06.710168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e9b71-3fe2-4e81-92b9-f50f5b38f92e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:06.710475 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e9b71-3fe2-4e81-92b9-f50f5b38f92e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:06.728358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:06.783170 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e9b71-3fe2-4e81-92b9-f50f5b38f92e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:06.784935 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e9b71-3fe2-4e81-92b9-f50f5b38f92e None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:06.892434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 420/841] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:41:06 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:41:06.898113 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b420e2-1199-47bf-9970-5fe76bb65902 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:06.974100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477cae9-b0c5-4de2-9490-bf8672b89b9c None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:06.974555 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477cae9-b0c5-4de2-9490-bf8672b89b9c None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:06.974979 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477cae9-b0c5-4de2-9490-bf8672b89b9c None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:06.976802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 421/842] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:06.981976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc11c5-7c62-44e8-8c5a-4d14433cd5b8 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:06.982205 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc11c5-7c62-44e8-8c5a-4d14433cd5b8 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:06.982536 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc11c5-7c62-44e8-8c5a-4d14433cd5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:07.001927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-a7dc11c5-7c62-44e8-8c5a-4d14433cd5b8 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:07.003160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a7dc11c5-7c62-44e8-8c5a-4d14433cd5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:07.010597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b420e2-1199-47bf-9970-5fe76bb65902 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:07.047429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d30151-c8b8-4888-a114-f078af1d90ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:07.048088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d30151-c8b8-4888-a114-f078af1d90ca None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:07.048375 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d30151-c8b8-4888-a114-f078af1d90ca None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:07.048656 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d30151-c8b8-4888-a114-f078af1d90ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:07.049941 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:07.057325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:07.061254 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d30151-c8b8-4888-a114-f078af1d90ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:07.062760 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d30151-c8b8-4888-a114-f078af1d90ca None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:07.078585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-61d30151-c8b8-4888-a114-f078af1d90ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:07.078585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:07.078585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:07.078585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:07.078585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:07.078585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:07.078585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:07.078585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:07.078585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:07.078585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:07.078585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:07.078585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:07.078585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:07.078585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:07.078585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:07.079480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:07.079480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:07.079480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:07.079480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:07.079480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:07.079480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:07.079480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:07.079480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:07.079480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:07.079480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:07.079480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:07.079480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:07.079480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:07.079480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:07.079480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:07.079480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:07.079480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:07.080355 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:07.080355 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:07.080355 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:07.080355 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:07.082698 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 422/844] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:07.084366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 422/844] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:07.085632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc11c5-7c62-44e8-8c5a-4d14433cd5b8 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:07.104032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d30151-c8b8-4888-a114-f078af1d90ca None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:07.194205 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc11c5-7c62-44e8-8c5a-4d14433cd5b8 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:07.213216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d30151-c8b8-4888-a114-f078af1d90ca None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:07.233144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a12c1-18fa-4cad-a56e-08ea8ce1f273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:07.234065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a12c1-18fa-4cad-a56e-08ea8ce1f273 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:07.234693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a12c1-18fa-4cad-a56e-08ea8ce1f273 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:07.235177 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a12c1-18fa-4cad-a56e-08ea8ce1f273 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:07.236071 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a12c1-18fa-4cad-a56e-08ea8ce1f273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:07.236599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a12c1-18fa-4cad-a56e-08ea8ce1f273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:07.238382 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a12c1-18fa-4cad-a56e-08ea8ce1f273 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:07.250449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39a1b6-ce4a-45e2-b66d-8da404840f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:07.251110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39a1b6-ce4a-45e2-b66d-8da404840f96 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:07.251455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39a1b6-ce4a-45e2-b66d-8da404840f96 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:07.251739 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39a1b6-ce4a-45e2-b66d-8da404840f96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:07.253609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 423/845] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:07.261326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a12c1-18fa-4cad-a56e-08ea8ce1f273 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:07.268754 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39a1b6-ce4a-45e2-b66d-8da404840f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:41:07.275035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-6d39a1b6-ce4a-45e2-b66d-8da404840f96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:41:07.275035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:07.275035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:07.275035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:07.275035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:07.275035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:07.275035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:07.275035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:07.275035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:07.275035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:07.275035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:07.275035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:07.275035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:41:07.275035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:41:07.275035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:41:07.275035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:41:07.276186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:41:07.276186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:41:07.276186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:41:07.276186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:41:07.276186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:07.276186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:07.276186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:07.276186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:07.276186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:07.276186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:07.276186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:07.276186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:07.276186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:07.276186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:07.276186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:07.276186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:07.277217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:07.277217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:07.277217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:07.277217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:07.277217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:41:07.277217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:41:07.277217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:41:07.277217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:41:07.277217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:41:07.277217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:41:07.277217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:41:07.277217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:07.279643 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 423/846] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:41:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:07.285497 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39a1b6-ce4a-45e2-b66d-8da404840f96 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:07.312041 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:07.349973 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:07.391314 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a12c1-18fa-4cad-a56e-08ea8ce1f273 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:07.406225 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39a1b6-ce4a-45e2-b66d-8da404840f96 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:07.430474 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67479cb6-5496-424f-abb4-fd3ecd7ba2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:07.431153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67479cb6-5496-424f-abb4-fd3ecd7ba2c6 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:07.431441 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67479cb6-5496-424f-abb4-fd3ecd7ba2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:07.431729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67479cb6-5496-424f-abb4-fd3ecd7ba2c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:07.439284 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67479cb6-5496-424f-abb4-fd3ecd7ba2c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:07.440748 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67479cb6-5496-424f-abb4-fd3ecd7ba2c6 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:07.443564 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0782ab-a122-4caf-ad6c-f291656c28d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:07.444183 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0782ab-a122-4caf-ad6c-f291656c28d2 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:07.444467 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0782ab-a122-4caf-ad6c-f291656c28d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:07.444743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0782ab-a122-4caf-ad6c-f291656c28d2 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:07.445516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0782ab-a122-4caf-ad6c-f291656c28d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:07.445825 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0782ab-a122-4caf-ad6c-f291656c28d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:07.447212 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0782ab-a122-4caf-ad6c-f291656c28d2 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:07.452756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-67479cb6-5496-424f-abb4-fd3ecd7ba2c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:07.452756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:07.452756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:07.452756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:07.452756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:07.452756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:07.452756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:07.452756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:07.452756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:07.452756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:07.452756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:07.452756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:07.452756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:41:07.452756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:41:07.452756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:41:07.453612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:41:07.453612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:07.453612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:07.453612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:07.453612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:07.453612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:07.453612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:07.453612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:07.453612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:07.453612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:07.453612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:07.453612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:07.453612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:07.453612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:07.453612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:07.453612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:07.453612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:07.454540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:41:07.454540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:41:07.454540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:41:07.454540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:41:07.454540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:41:07.454540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:41:07.454540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:07.454540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:07.462417 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 424/847] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:41:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:07.462417 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb93e03-d341-454c-95f9-cdc7d9c4b1c7 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:07.462655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 424/848] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:41:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:07.462730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb93e03-d341-454c-95f9-cdc7d9c4b1c7 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:07.462730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb93e03-d341-454c-95f9-cdc7d9c4b1c7 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:07.462730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 425/849] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:07.463271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67479cb6-5496-424f-abb4-fd3ecd7ba2c6 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:07.465460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb93e03-d341-454c-95f9-cdc7d9c4b1c7 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:07.567534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:07.573763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67479cb6-5496-424f-abb4-fd3ecd7ba2c6 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:07.580345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb93e03-d341-454c-95f9-cdc7d9c4b1c7 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:07.594022 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:07.610440 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1677c3-5418-4223-9841-993f026c0add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:07.611090 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1677c3-5418-4223-9841-993f026c0add None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:07.611374 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1677c3-5418-4223-9841-993f026c0add None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:07.611653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1677c3-5418-4223-9841-993f026c0add None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:07.617629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb73d8-28c0-4117-806c-b64146c03362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:07.618541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb73d8-28c0-4117-806c-b64146c03362 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:07.619126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb73d8-28c0-4117-806c-b64146c03362 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:07.619546 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb73d8-28c0-4117-806c-b64146c03362 None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:07.620478 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb73d8-28c0-4117-806c-b64146c03362 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:07.621041 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb73d8-28c0-4117-806c-b64146c03362 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:07.622664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb73d8-28c0-4117-806c-b64146c03362 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:07.622947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1677c3-5418-4223-9841-993f026c0add None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:07.624631 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1677c3-5418-4223-9841-993f026c0add None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:07.636918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 426/850] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:41:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:07.638131 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1b672-d055-4600-acc3-c6325d66b02d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:07.638435 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1b672-d055-4600-acc3-c6325d66b02d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:07.638723 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1b672-d055-4600-acc3-c6325d66b02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:07.641290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-fc1677c3-5418-4223-9841-993f026c0add None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:07.641290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:07.641290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:07.641290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:07.641290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:07.641290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:07.641290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:07.641290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:07.641290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:07.641290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:07.641290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:07.641290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:07.641290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:07.641290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:07.641290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:07.642237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:07.642237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:07.642237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:07.642237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:07.642237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:07.642237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:07.642237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:07.642237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:07.642237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:07.642237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:07.642237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:07.642237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:07.642237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:07.642237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:07.642237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:07.642237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:07.642237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:07.643146 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:07.643146 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:07.643146 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:07.643146 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:07.643146 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 425/851] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:07.643579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1677c3-5418-4223-9841-993f026c0add None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:07.661137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-8db1b672-d055-4600-acc3-c6325d66b02d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:07.662325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8db1b672-d055-4600-acc3-c6325d66b02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:07.733667 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 427/852] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:07.743598 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1b672-d055-4600-acc3-c6325d66b02d None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:07.765266 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1677c3-5418-4223-9841-993f026c0add None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:07.803493 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041602a0-fac2-4d29-a95c-5d1924af2c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:07.803493 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041602a0-fac2-4d29-a95c-5d1924af2c92 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:07.803792 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041602a0-fac2-4d29-a95c-5d1924af2c92 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:07.803868 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041602a0-fac2-4d29-a95c-5d1924af2c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:07.805188 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041602a0-fac2-4d29-a95c-5d1924af2c92 None admin] RBAC: Adding query filter params (role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=462ecbb85c6b4a17a952fb74fa2de65e) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:07.805502 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041602a0-fac2-4d29-a95c-5d1924af2c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:07.807021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041602a0-fac2-4d29-a95c-5d1924af2c92 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:07.813292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 426/853] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:41:07 2022] GET /identity/v3/role_assignments?user.id=462ecbb85c6b4a17a952fb74fa2de65e&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:07.813292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041602a0-fac2-4d29-a95c-5d1924af2c92 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:07.837133 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:07.869514 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1b672-d055-4600-acc3-c6325d66b02d None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:07.871420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:07.908847 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42134ff7-7752-4b6e-9d26-2628e768d901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:07.909747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42134ff7-7752-4b6e-9d26-2628e768d901 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:07.910133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42134ff7-7752-4b6e-9d26-2628e768d901 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:07.910571 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42134ff7-7752-4b6e-9d26-2628e768d901 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:07.911362 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42134ff7-7752-4b6e-9d26-2628e768d901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:07.911735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42134ff7-7752-4b6e-9d26-2628e768d901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:07.913216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42134ff7-7752-4b6e-9d26-2628e768d901 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:07.927771 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 428/854] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:07.934145 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42134ff7-7752-4b6e-9d26-2628e768d901 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:07.954226 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041602a0-fac2-4d29-a95c-5d1924af2c92 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:07.996361 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67c39a-ca17-4572-b35d-244f0ff05877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:07.997415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67c39a-ca17-4572-b35d-244f0ff05877 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:07.997976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67c39a-ca17-4572-b35d-244f0ff05877 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:07.998481 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67c39a-ca17-4572-b35d-244f0ff05877 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:07.999401 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67c39a-ca17-4572-b35d-244f0ff05877 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:08.000787 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67c39a-ca17-4572-b35d-244f0ff05877 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:08.010245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-ca67c39a-ca17-4572-b35d-244f0ff05877 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:41:08.010245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:08.010245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:08.010245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:08.010245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:08.010245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:08.010245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:08.010245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:08.010245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:41:08.010245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:08.010245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:08.010245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:08.010245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:08.010245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:08.010245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:08.010245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:08.010245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:08.011271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:08.011271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:08.011271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:08.011271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:08.011271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:08.011271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:08.011271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:08.011271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:08.011271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:08.011271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:08.011271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:08.011271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:08.011271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:08.011271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:08.011271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:08.011271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:08.012093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:08.012093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:08.012093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:08.012093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:08.012093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:08.012093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:08.012093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:08.012093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:08.012093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:08.012093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:08.012093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:08.012093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:08.012093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:41:08.012093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:08.012093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 427/855] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:41:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:08.017575 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67c39a-ca17-4572-b35d-244f0ff05877 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:08.051026 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42134ff7-7752-4b6e-9d26-2628e768d901 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:08.086778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a31d5c-47f7-4323-84cf-3e12c3c90094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:08.087119 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a31d5c-47f7-4323-84cf-3e12c3c90094 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:08.089520 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a31d5c-47f7-4323-84cf-3e12c3c90094 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:08.089520 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a31d5c-47f7-4323-84cf-3e12c3c90094 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:08.096082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a31d5c-47f7-4323-84cf-3e12c3c90094 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:08.097592 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a31d5c-47f7-4323-84cf-3e12c3c90094 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:08.110096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-06a31d5c-47f7-4323-84cf-3e12c3c90094 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:41:08.110096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:08.110096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:08.110096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:08.110096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:08.110096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:08.110096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:08.110096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:08.110096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:08.110096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:08.110096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:08.110096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:08.110096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:41:08.110096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:41:08.110096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:41:08.110096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:41:08.111151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:08.111151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:08.111151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:41:08.111151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:08.111151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:41:08.111151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:08.111151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:08.111151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:08.111151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:08.111151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:08.111151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:08.111151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:08.111151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:08.111151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:08.111151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:08.111151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:08.111151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:08.111151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:08.112358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:08.112358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:08.112358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:41:08.112358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:41:08.112358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:41:08.112358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:41:08.112358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:41:08.112358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:41:08.112358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:41:08.112358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:08.112358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 429/856] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jul 26 14:41:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:08.118990 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a31d5c-47f7-4323-84cf-3e12c3c90094 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:08.126640 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:08.144231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:08.157530 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67c39a-ca17-4572-b35d-244f0ff05877 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:08.201973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d32051-ea6b-4d9b-8c49-5acbc3ddbdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:08.203025 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d32051-ea6b-4d9b-8c49-5acbc3ddbdb7 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:08.203460 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d32051-ea6b-4d9b-8c49-5acbc3ddbdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:08.203889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d32051-ea6b-4d9b-8c49-5acbc3ddbdb7 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:08.204740 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d32051-ea6b-4d9b-8c49-5acbc3ddbdb7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:08.205260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d32051-ea6b-4d9b-8c49-5acbc3ddbdb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:08.206953 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d32051-ea6b-4d9b-8c49-5acbc3ddbdb7 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:08.213030 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 428/857] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:41:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:08.222436 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d32051-ea6b-4d9b-8c49-5acbc3ddbdb7 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:08.232416 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a31d5c-47f7-4323-84cf-3e12c3c90094 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:08.270160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb52a95-4bda-4865-8e3b-596a30162bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:08.271182 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb52a95-4bda-4865-8e3b-596a30162bd6 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:08.271646 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb52a95-4bda-4865-8e3b-596a30162bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:08.272110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb52a95-4bda-4865-8e3b-596a30162bd6 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:08.273645 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb52a95-4bda-4865-8e3b-596a30162bd6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:08.274113 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb52a95-4bda-4865-8e3b-596a30162bd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:08.275933 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb52a95-4bda-4865-8e3b-596a30162bd6 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:08.300825 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 430/858] 10.222.0.86 () {56 vars in 1149 bytes} [Tue Jul 26 14:41:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:08.301993 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb52a95-4bda-4865-8e3b-596a30162bd6 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:08.333225 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d32051-ea6b-4d9b-8c49-5acbc3ddbdb7 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:08.371234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ab292-cfb9-473c-a4a9-69da833d7f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:08.371782 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ab292-cfb9-473c-a4a9-69da833d7f8f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:08.372067 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ab292-cfb9-473c-a4a9-69da833d7f8f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:08.372347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ab292-cfb9-473c-a4a9-69da833d7f8f None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:08.373286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ab292-cfb9-473c-a4a9-69da833d7f8f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:08.373605 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ab292-cfb9-473c-a4a9-69da833d7f8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:08.375682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ab292-cfb9-473c-a4a9-69da833d7f8f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:08.380577 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 429/859] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:41:08 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:08.380577 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e92ad8-b282-4fd4-b47b-035dd7b51e0b None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:08.380577 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e92ad8-b282-4fd4-b47b-035dd7b51e0b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:08.380577 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e92ad8-b282-4fd4-b47b-035dd7b51e0b None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:08.388716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 430/860] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:08.390143 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d227ac8-66d4-4052-93f1-0f54e12f2559 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:08.390459 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d227ac8-66d4-4052-93f1-0f54e12f2559 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:08.390745 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d227ac8-66d4-4052-93f1-0f54e12f2559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:08.393085 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:08.399610 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:08.411184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-0d227ac8-66d4-4052-93f1-0f54e12f2559 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:08.412492 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0d227ac8-66d4-4052-93f1-0f54e12f2559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:08.419733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb52a95-4bda-4865-8e3b-596a30162bd6 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:08.470664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29ccec-5c7d-4d59-b162-d3aa7cb9304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:08.471306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29ccec-5c7d-4d59-b162-d3aa7cb9304b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:08.471591 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29ccec-5c7d-4d59-b162-d3aa7cb9304b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:08.472151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29ccec-5c7d-4d59-b162-d3aa7cb9304b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:08.510875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 431/861] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:08.527144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d227ac8-66d4-4052-93f1-0f54e12f2559 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:08.571118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29ccec-5c7d-4d59-b162-d3aa7cb9304b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:08.572576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29ccec-5c7d-4d59-b162-d3aa7cb9304b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:08.642458 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d227ac8-66d4-4052-93f1-0f54e12f2559 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:08.687982 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd9a1d-c3a3-4c35-9a0d-c1df13411aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:08.689314 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:08.689851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9a1d-c3a3-4c35-9a0d-c1df13411aee None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:08.689851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9a1d-c3a3-4c35-9a0d-c1df13411aee None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:08.690011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9a1d-c3a3-4c35-9a0d-c1df13411aee None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:08.690909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd9a1d-c3a3-4c35-9a0d-c1df13411aee None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:08.693147 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd9a1d-c3a3-4c35-9a0d-c1df13411aee None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:08.695766 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:08.705453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-57bd9a1d-c3a3-4c35-9a0d-c1df13411aee None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:41:08.705453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:08.705453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:08.705453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:08.705453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:08.705453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:08.705453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:08.705453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:08.705453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:41:08.705453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:08.705453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:08.705453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:08.705453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:08.705453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:08.705453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:08.705453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:08.711280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:08.711280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:08.711280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:08.711280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:08.711280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:08.711280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:08.711280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:08.711280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:08.711280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:08.711280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:08.711280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:08.711280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:08.711280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:08.711280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:08.711280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:08.711280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:08.712257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:08.712257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:08.712257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:08.712257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:08.712257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:08.712257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:08.712257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:08.712257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:08.712257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:08.712257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:08.712257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:08.712257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:08.712257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:08.712257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:41:08.712257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:08.712257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 432/863] 10.222.0.86 () {56 vars in 1132 bytes} [Tue Jul 26 14:41:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:08.713101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd9a1d-c3a3-4c35-9a0d-c1df13411aee None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:08.713248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 431/863] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:41:08 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:41:08.714746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29ccec-5c7d-4d59-b162-d3aa7cb9304b None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:08.833008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd9a1d-c3a3-4c35-9a0d-c1df13411aee None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:08.855809 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29ccec-5c7d-4d59-b162-d3aa7cb9304b None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:08.870685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a186a4e-1c9b-4d27-a4f0-645864e5a78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:08.871607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a186a4e-1c9b-4d27-a4f0-645864e5a78e None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:08.872088 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a186a4e-1c9b-4d27-a4f0-645864e5a78e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:08.872560 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a186a4e-1c9b-4d27-a4f0-645864e5a78e None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:08.873494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a186a4e-1c9b-4d27-a4f0-645864e5a78e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:08.874320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a186a4e-1c9b-4d27-a4f0-645864e5a78e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:08.875900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a186a4e-1c9b-4d27-a4f0-645864e5a78e None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:08.881427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 433/864] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jul 26 14:41:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:08.888492 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a186a4e-1c9b-4d27-a4f0-645864e5a78e None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:08.904507 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76272b5-7836-42b5-af6b-08eeba466c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:08.905173 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76272b5-7836-42b5-af6b-08eeba466c36 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:08.905572 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76272b5-7836-42b5-af6b-08eeba466c36 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:08.905923 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76272b5-7836-42b5-af6b-08eeba466c36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:08.917432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76272b5-7836-42b5-af6b-08eeba466c36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:08.919044 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76272b5-7836-42b5-af6b-08eeba466c36 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:08.935476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-a76272b5-7836-42b5-af6b-08eeba466c36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:08.935476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:08.935476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:08.935476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:08.935476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:08.935476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:08.935476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:08.935476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:08.935476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:08.935476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:08.935476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:08.935476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:08.935476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:08.935476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:08.935476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:08.936387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:08.936387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:08.936387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:08.936387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:08.936387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:08.936387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:08.936387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:08.936387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:08.936387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:08.936387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:08.936387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:08.936387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:08.936387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:08.936387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:08.936387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:08.936387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:08.936387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:08.937266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:08.937266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:08.937266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:08.937266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:08.941540 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 432/865] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:08.942510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76272b5-7836-42b5-af6b-08eeba466c36 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:08.971256 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:08.977215 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:09.017723 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a186a4e-1c9b-4d27-a4f0-645864e5a78e None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:09.058072 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fad5f-be02-4b2e-947a-8666ccb4bd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:09.059023 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fad5f-be02-4b2e-947a-8666ccb4bd22 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:09.059484 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fad5f-be02-4b2e-947a-8666ccb4bd22 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:09.059965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fad5f-be02-4b2e-947a-8666ccb4bd22 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:09.060442 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76272b5-7836-42b5-af6b-08eeba466c36 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:09.061009 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83fad5f-be02-4b2e-947a-8666ccb4bd22 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:09.061487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83fad5f-be02-4b2e-947a-8666ccb4bd22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:09.063312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83fad5f-be02-4b2e-947a-8666ccb4bd22 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:09.074876 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 434/866] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jul 26 14:41:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:09.100828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb8905-78b4-4c06-a39a-297be4064fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:09.101599 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb8905-78b4-4c06-a39a-297be4064fa2 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:09.101890 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb8905-78b4-4c06-a39a-297be4064fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:09.102172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb8905-78b4-4c06-a39a-297be4064fa2 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:09.102974 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb8905-78b4-4c06-a39a-297be4064fa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:09.103291 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb8905-78b4-4c06-a39a-297be4064fa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:09.104719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb8905-78b4-4c06-a39a-297be4064fa2 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:09.119431 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 433/867] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:09.125553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fad5f-be02-4b2e-947a-8666ccb4bd22 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:09.239763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fad5f-be02-4b2e-947a-8666ccb4bd22 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:09.267940 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:09.277063 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3af06c-e962-409d-b389-123ba081e280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:09.277929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3af06c-e962-409d-b389-123ba081e280 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:09.284887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3af06c-e962-409d-b389-123ba081e280 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:09.284887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3af06c-e962-409d-b389-123ba081e280 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:09.285327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3af06c-e962-409d-b389-123ba081e280 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:09.286805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3af06c-e962-409d-b389-123ba081e280 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:09.298495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-7e3af06c-e962-409d-b389-123ba081e280 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:09.298495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:09.298495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:09.298495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:09.298495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:09.298495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:09.298495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:09.298495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:09.298495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:09.298495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:09.298495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:09.298495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:09.298495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:41:09.298495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:41:09.298495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:41:09.299392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:41:09.299392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:09.299392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:09.299392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:09.299392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:09.299392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:09.299392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:09.299392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:09.299392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:09.299392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:09.299392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:09.299392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:09.299392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:09.299392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:09.299392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:09.299392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:09.299392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:09.300341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:41:09.300341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:41:09.300341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:41:09.300341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:41:09.300341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:41:09.300341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:41:09.300341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:09.300341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:09.300341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 435/868] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:41:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:09.307547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb8905-78b4-4c06-a39a-297be4064fa2 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:09.403623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:09.413031 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb8905-78b4-4c06-a39a-297be4064fa2 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:09.449645 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c14f11-c4ff-43e5-ae1a-9039a219bc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:09.450371 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c14f11-c4ff-43e5-ae1a-9039a219bc62 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:09.450684 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c14f11-c4ff-43e5-ae1a-9039a219bc62 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:09.450969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c14f11-c4ff-43e5-ae1a-9039a219bc62 None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:09.451732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c14f11-c4ff-43e5-ae1a-9039a219bc62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:09.452048 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c14f11-c4ff-43e5-ae1a-9039a219bc62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:09.453484 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c14f11-c4ff-43e5-ae1a-9039a219bc62 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:09.466289 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 434/869] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:41:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:09.472194 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3af06c-e962-409d-b389-123ba081e280 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:09.590621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3af06c-e962-409d-b389-123ba081e280 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:09.625796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3ecd9-7acd-4229-8d01-33a5e762b63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:09.626453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3ecd9-7acd-4229-8d01-33a5e762b63a None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:09.626789 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3ecd9-7acd-4229-8d01-33a5e762b63a None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:09.627072 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3ecd9-7acd-4229-8d01-33a5e762b63a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:09.627864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3ecd9-7acd-4229-8d01-33a5e762b63a None admin] RBAC: Adding query filter params (role.id=7f17a5a0295f42e793e343cff968367c, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=0834be7405cd4c968763099251d37154) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:09.628174 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3ecd9-7acd-4229-8d01-33a5e762b63a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:09.629613 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3ecd9-7acd-4229-8d01-33a5e762b63a None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:09.636524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 436/870] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:41:09 2022] GET /identity/v3/role_assignments?user.id=0834be7405cd4c968763099251d37154&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=7f17a5a0295f42e793e343cff968367c => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:10.057730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0d3aa-52bf-48f2-8cbe-ce386ec1c132 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:10.058282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0d3aa-52bf-48f2-8cbe-ce386ec1c132 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:10.058282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0d3aa-52bf-48f2-8cbe-ce386ec1c132 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:10.059917 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 435/871] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:10.065593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3ee71-f082-4f94-bc87-7ab005adb726 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:10.065889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3ee71-f082-4f94-bc87-7ab005adb726 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:10.066225 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3ee71-f082-4f94-bc87-7ab005adb726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:10.085011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-e3f3ee71-f082-4f94-bc87-7ab005adb726 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:10.086810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e3f3ee71-f082-4f94-bc87-7ab005adb726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:10.136118 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:10.158160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 437/872] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:10.181917 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0d3aa-52bf-48f2-8cbe-ce386ec1c132 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:10.291992 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0d3aa-52bf-48f2-8cbe-ce386ec1c132 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:10.329251 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba107068-e073-4553-964e-4be5a75ea1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:10.329821 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba107068-e073-4553-964e-4be5a75ea1f1 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:10.330110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba107068-e073-4553-964e-4be5a75ea1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:10.330409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba107068-e073-4553-964e-4be5a75ea1f1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:10.331047 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba107068-e073-4553-964e-4be5a75ea1f1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:10.332428 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba107068-e073-4553-964e-4be5a75ea1f1 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:10.342177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-ba107068-e073-4553-964e-4be5a75ea1f1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:41:10.342177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:10.342177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:10.342177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:10.342177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:10.342177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:10.342177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:10.342177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:10.342177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:41:10.342177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:10.342177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:10.342177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:10.342177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:10.342177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:10.342177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:10.342177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:10.342177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:10.343286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:10.343286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:10.343286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:10.343286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:10.343286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:10.343286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:10.343286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:10.343286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:10.343286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:10.343286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:10.343286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:10.343286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:10.343286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:10.343286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:10.343286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:10.343286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:10.344104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:10.344104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:10.344104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:10.344104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:10.344104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:10.344104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:10.344104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:10.344104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:10.344104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:10.344104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:10.344104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:10.344104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:10.344104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:41:10.344104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:10.348905 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 436/873] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jul 26 14:41:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:10.350273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3ee71-f082-4f94-bc87-7ab005adb726 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:10.454158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3ee71-f082-4f94-bc87-7ab005adb726 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:10.466998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458c0f4-6321-46db-a708-94886d5146f0 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:10.467298 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458c0f4-6321-46db-a708-94886d5146f0 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:10.467558 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458c0f4-6321-46db-a708-94886d5146f0 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:10.470705 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 437/874] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:41:10.475309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf78fa-31f4-4e62-a7b7-458f986a2cb3 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:10.475696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf78fa-31f4-4e62-a7b7-458f986a2cb3 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:10.476100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf78fa-31f4-4e62-a7b7-458f986a2cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:10.495578 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60258a38-ecce-4b69-96b6-e5edc17dcc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:10.496198 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-5bbf78fa-31f4-4e62-a7b7-458f986a2cb3 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:10.496926 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60258a38-ecce-4b69-96b6-e5edc17dcc33 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:10.497371 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60258a38-ecce-4b69-96b6-e5edc17dcc33 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:10.497748 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-5bbf78fa-31f4-4e62-a7b7-458f986a2cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:10.497951 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60258a38-ecce-4b69-96b6-e5edc17dcc33 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:10.500414 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60258a38-ecce-4b69-96b6-e5edc17dcc33 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:10.501045 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60258a38-ecce-4b69-96b6-e5edc17dcc33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:10.502597 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60258a38-ecce-4b69-96b6-e5edc17dcc33 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:10.508159 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 438/875] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jul 26 14:41:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:10.515355 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60258a38-ecce-4b69-96b6-e5edc17dcc33 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:10.530787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:10.586313 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:10.588538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 438/876] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:10.615126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf78fa-31f4-4e62-a7b7-458f986a2cb3 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:10.651858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60258a38-ecce-4b69-96b6-e5edc17dcc33 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:10.693407 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3c616-9817-4084-9635-2f88bae879f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:10.694328 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3c616-9817-4084-9635-2f88bae879f3 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:10.694900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3c616-9817-4084-9635-2f88bae879f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:10.695853 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3c616-9817-4084-9635-2f88bae879f3 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:10.696705 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3c616-9817-4084-9635-2f88bae879f3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:10.697186 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3c616-9817-4084-9635-2f88bae879f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:10.698751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3c616-9817-4084-9635-2f88bae879f3 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:10.703998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 439/877] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jul 26 14:41:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:10.745638 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf78fa-31f4-4e62-a7b7-458f986a2cb3 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:10.785088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765dcf9-022e-45ac-806c-3b0881f093e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:10.786075 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765dcf9-022e-45ac-806c-3b0881f093e9 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:10.786595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765dcf9-022e-45ac-806c-3b0881f093e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:10.787070 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765dcf9-022e-45ac-806c-3b0881f093e9 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:10.788011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765dcf9-022e-45ac-806c-3b0881f093e9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:10.790153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765dcf9-022e-45ac-806c-3b0881f093e9 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:10.877045 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 439/878] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jul 26 14:41:10 2022] POST /identity/v3/services => generated 251 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:41:11.307036 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5f263-c7d1-4d74-9d80-890a261c2421 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:11.307652 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5f263-c7d1-4d74-9d80-890a261c2421 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:11.308114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5f263-c7d1-4d74-9d80-890a261c2421 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:11.309885 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 440/879] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:11.315454 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a69620-58f2-4e6c-9405-c85032b5efc7 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:11.316404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a69620-58f2-4e6c-9405-c85032b5efc7 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:11.316918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a69620-58f2-4e6c-9405-c85032b5efc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:11.330268 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:11.337356 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-52a69620-58f2-4e6c-9405-c85032b5efc7 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:11.338861 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-52a69620-58f2-4e6c-9405-c85032b5efc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:11.419128 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 440/880] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:11.445754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5f263-c7d1-4d74-9d80-890a261c2421 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:11.560982 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5f263-c7d1-4d74-9d80-890a261c2421 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:11.572685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:11.598595 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc6b45-4b3b-4eb3-9a48-90668c6a7e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:11.599229 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc6b45-4b3b-4eb3-9a48-90668c6a7e17 None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:11.599516 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc6b45-4b3b-4eb3-9a48-90668c6a7e17 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:11.599793 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc6b45-4b3b-4eb3-9a48-90668c6a7e17 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:11.600495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc6b45-4b3b-4eb3-9a48-90668c6a7e17 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:11.601906 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc6b45-4b3b-4eb3-9a48-90668c6a7e17 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:11.687561 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 441/881] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jul 26 14:41:11 2022] POST /identity/v3/services => generated 269 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:41:11.896999 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13d42-6404-41d0-aa95-2518638bf0d5 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:11.897640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13d42-6404-41d0-aa95-2518638bf0d5 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:11.898278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13d42-6404-41d0-aa95-2518638bf0d5 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:11.900498 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 441/882] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:11.907869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26785b-afbd-4ac7-b1f6-ab62fb8f2717 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:11.908498 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26785b-afbd-4ac7-b1f6-ab62fb8f2717 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:11.909008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26785b-afbd-4ac7-b1f6-ab62fb8f2717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:11.928888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-8a26785b-afbd-4ac7-b1f6-ab62fb8f2717 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:11.930669 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-8a26785b-afbd-4ac7-b1f6-ab62fb8f2717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:12.007845 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 442/883] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:41:12.030944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c13d42-6404-41d0-aa95-2518638bf0d5 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:12.139161 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c13d42-6404-41d0-aa95-2518638bf0d5 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:12.170253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:12.175576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af54c1-82a2-47f0-8aac-cd03cdd73fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:12.176465 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af54c1-82a2-47f0-8aac-cd03cdd73fb2 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:12.176955 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af54c1-82a2-47f0-8aac-cd03cdd73fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:12.177458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af54c1-82a2-47f0-8aac-cd03cdd73fb2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:12.188281 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af54c1-82a2-47f0-8aac-cd03cdd73fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:41:12.193604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-16af54c1-82a2-47f0-8aac-cd03cdd73fb2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:41:12.193604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:12.193604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:12.193604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:12.193604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:12.193604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:12.193604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:12.193604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:12.193604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:12.193604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:12.193604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:12.193604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:12.193604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:41:12.193604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:41:12.193604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:41:12.193604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:41:12.194632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:41:12.194632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:41:12.194632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:41:12.194632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:41:12.194632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:12.194632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:12.194632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:12.194632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:12.194632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:12.194632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:12.194632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:12.194632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:12.194632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:12.194632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:12.194632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:12.194632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:12.195997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:12.195997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:12.195997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:12.195997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:12.195997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:41:12.195997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:41:12.195997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:41:12.195997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:41:12.195997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:41:12.195997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:41:12.195997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:41:12.195997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:12.202641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 442/884] 10.222.0.86 () {56 vars in 1120 bytes} [Tue Jul 26 14:41:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:12.204705 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26785b-afbd-4ac7-b1f6-ab62fb8f2717 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:12.303230 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:12.311600 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26785b-afbd-4ac7-b1f6-ab62fb8f2717 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:12.347557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d759214-a5c4-43b2-93c6-46efcccee1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:12.348189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d759214-a5c4-43b2-93c6-46efcccee1fe None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:12.348477 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d759214-a5c4-43b2-93c6-46efcccee1fe None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:12.348759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d759214-a5c4-43b2-93c6-46efcccee1fe None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:12.349483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d759214-a5c4-43b2-93c6-46efcccee1fe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:12.349795 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d759214-a5c4-43b2-93c6-46efcccee1fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:12.351266 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d759214-a5c4-43b2-93c6-46efcccee1fe None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:12.360747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 443/885] 10.222.0.86 () {56 vars in 1115 bytes} [Tue Jul 26 14:41:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:12.366529 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af54c1-82a2-47f0-8aac-cd03cdd73fb2 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:12.474405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af54c1-82a2-47f0-8aac-cd03cdd73fb2 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:12.511804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be90e37-7770-45bf-9b29-e6d3cdc3619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:12.512834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be90e37-7770-45bf-9b29-e6d3cdc3619f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:12.513365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be90e37-7770-45bf-9b29-e6d3cdc3619f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:12.513851 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be90e37-7770-45bf-9b29-e6d3cdc3619f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:12.525716 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be90e37-7770-45bf-9b29-e6d3cdc3619f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:12.527502 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be90e37-7770-45bf-9b29-e6d3cdc3619f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:12.543456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-1be90e37-7770-45bf-9b29-e6d3cdc3619f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:12.543456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:12.543456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:12.543456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:12.543456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:12.543456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:12.543456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:12.543456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:12.543456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:12.543456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:12.543456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:12.543456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:12.543456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:12.543456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:12.543456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:12.544449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:12.544449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:12.544449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:12.544449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:12.544449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:12.544449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:12.544449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:12.544449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:12.544449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:12.544449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:12.544449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:12.544449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:12.544449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:12.544449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:12.544449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:12.544449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:12.544449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:12.545457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:12.545457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:12.545457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:12.545457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:12.547896 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 443/886] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:12.553720 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d759214-a5c4-43b2-93c6-46efcccee1fe None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:12.662342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d759214-a5c4-43b2-93c6-46efcccee1fe None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:12.708315 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af362129-83f0-4f24-826b-a219b1f3b670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:12.708949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af362129-83f0-4f24-826b-a219b1f3b670 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:12.709237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af362129-83f0-4f24-826b-a219b1f3b670 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:12.709519 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af362129-83f0-4f24-826b-a219b1f3b670 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:12.710220 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af362129-83f0-4f24-826b-a219b1f3b670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:12.711096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af362129-83f0-4f24-826b-a219b1f3b670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:12.712482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af362129-83f0-4f24-826b-a219b1f3b670 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:12.725243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 444/887] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:12.731150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be90e37-7770-45bf-9b29-e6d3cdc3619f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:12.779037 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:12.835152 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be90e37-7770-45bf-9b29-e6d3cdc3619f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:12.873949 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ef31e-2267-40bb-902a-d60993e8ec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:12.874936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ef31e-2267-40bb-902a-d60993e8ec51 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:12.875222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ef31e-2267-40bb-902a-d60993e8ec51 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:12.875546 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ef31e-2267-40bb-902a-d60993e8ec51 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:12.887840 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ef31e-2267-40bb-902a-d60993e8ec51 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:12.889596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ef31e-2267-40bb-902a-d60993e8ec51 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:12.903597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-b19ef31e-2267-40bb-902a-d60993e8ec51 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:41:12.903597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:12.903597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:12.903597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:12.903597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:12.903597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:12.903597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:12.903597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:12.903597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:12.903597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:12.903597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:12.903597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:12.903597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:41:12.903597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:41:12.903597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:41:12.903597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:41:12.904603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:12.904603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:12.904603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:41:12.904603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:12.904603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:41:12.904603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:12.904603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:12.904603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:12.904603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:12.904603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:12.904603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:12.904603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:12.904603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:12.904603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:12.904603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:12.904603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:12.904603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:12.904603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:12.905549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:12.905549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:12.905549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:41:12.905549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:41:12.905549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:41:12.905549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:41:12.905549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:41:12.905549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:41:12.905549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:41:12.905549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:12.908199 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 444/888] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jul 26 14:41:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:12.913988 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af362129-83f0-4f24-826b-a219b1f3b670 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:12.934137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bf5b3-30ca-4de5-a56e-db4e3726e13d None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:12.934507 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bf5b3-30ca-4de5-a56e-db4e3726e13d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:12.934776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bf5b3-30ca-4de5-a56e-db4e3726e13d None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:12.936265 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 445/889] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:41:12.936844 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:12.942509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b289a54-e964-494b-ae19-227b970a23d8 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:12.942795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b289a54-e964-494b-ae19-227b970a23d8 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:12.943070 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b289a54-e964-494b-ae19-227b970a23d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:12.962030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-5b289a54-e964-494b-ae19-227b970a23d8 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:12.963262 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-5b289a54-e964-494b-ae19-227b970a23d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:13.030222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af362129-83f0-4f24-826b-a219b1f3b670 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:13.034363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 446/890] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:41:13.035715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bf5a1-dedb-4737-8f6c-a63daabc7a39 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:13.036005 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bf5a1-dedb-4737-8f6c-a63daabc7a39 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:13.036285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bf5a1-dedb-4737-8f6c-a63daabc7a39 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:13.037801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 447/891] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:13.047571 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a81411-0dc3-4e22-b05f-041bed655229 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:13.047859 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a81411-0dc3-4e22-b05f-041bed655229 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:13.048148 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a81411-0dc3-4e22-b05f-041bed655229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:13.069178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-f5a81411-0dc3-4e22-b05f-041bed655229 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:13.070938 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f5a81411-0dc3-4e22-b05f-041bed655229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:13.071910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b300f-b826-4005-ad72-f4edb05c801a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:13.072534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b300f-b826-4005-ad72-f4edb05c801a None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:13.072823 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b300f-b826-4005-ad72-f4edb05c801a None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:13.073100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b300f-b826-4005-ad72-f4edb05c801a None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:13.073890 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b300f-b826-4005-ad72-f4edb05c801a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:13.074199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b300f-b826-4005-ad72-f4edb05c801a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:13.075675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b300f-b826-4005-ad72-f4edb05c801a None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:13.093798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 445/892] 10.222.0.86 () {56 vars in 1149 bytes} [Tue Jul 26 14:41:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:13.094616 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b300f-b826-4005-ad72-f4edb05c801a None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:13.109490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:13.151088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 448/893] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:13.151933 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a81411-0dc3-4e22-b05f-041bed655229 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:13.181694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:13.208618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b300f-b826-4005-ad72-f4edb05c801a None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:13.244627 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0924b6-6b6c-4c47-b57e-0c1a426c0f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:13.245276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0924b6-6b6c-4c47-b57e-0c1a426c0f85 None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:13.245561 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0924b6-6b6c-4c47-b57e-0c1a426c0f85 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:13.245838 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0924b6-6b6c-4c47-b57e-0c1a426c0f85 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:13.246561 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0924b6-6b6c-4c47-b57e-0c1a426c0f85 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:13.247934 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0924b6-6b6c-4c47-b57e-0c1a426c0f85 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:13.265904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a81411-0dc3-4e22-b05f-041bed655229 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:13.299576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c21848-896c-4768-9f37-c55e33cf9b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:13.300136 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c21848-896c-4768-9f37-c55e33cf9b49 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:13.300479 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c21848-896c-4768-9f37-c55e33cf9b49 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:13.300706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c21848-896c-4768-9f37-c55e33cf9b49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:13.325714 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 446/894] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jul 26 14:41:13 2022] POST /identity/v3/services => generated 241 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:41:13.326862 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0924b6-6b6c-4c47-b57e-0c1a426c0f85 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:13.341034 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:13.395468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c21848-896c-4768-9f37-c55e33cf9b49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:13.398009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c21848-896c-4768-9f37-c55e33cf9b49 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:13.465236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0924b6-6b6c-4c47-b57e-0c1a426c0f85 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:13.503880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:13.513947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032be84-0bc4-41ff-9d4f-11898bbc8eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:13.514643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032be84-0bc4-41ff-9d4f-11898bbc8eb7 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:13.514936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032be84-0bc4-41ff-9d4f-11898bbc8eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:13.515225 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032be84-0bc4-41ff-9d4f-11898bbc8eb7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:13.515868 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032be84-0bc4-41ff-9d4f-11898bbc8eb7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:13.517006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 449/895] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:41:13 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:41:13.517529 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032be84-0bc4-41ff-9d4f-11898bbc8eb7 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:13.523288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c21848-896c-4768-9f37-c55e33cf9b49 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:13.527192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-7032be84-0bc4-41ff-9d4f-11898bbc8eb7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:41:13.527192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:13.527192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:13.527192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:13.527192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:13.527192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:13.527192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:13.527192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:13.527192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:41:13.527192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:13.527192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:13.527192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:13.527192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:13.527192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:13.527192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:13.527192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:13.527192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:13.528299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:13.528299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:13.528299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:13.528299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:13.528299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:13.528299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:13.528299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:13.528299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:13.528299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:13.528299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:13.528299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:13.528299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:13.528299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:13.528299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:13.528299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:13.528299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:13.529154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:13.529154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:13.529154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:13.529154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:13.529154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:13.529154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:13.529154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:13.529154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:13.529154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:13.529154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:13.529154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:13.529154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:13.529154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:41:13.529154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:13.529879 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 447/896] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:41:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:13.536709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032be84-0bc4-41ff-9d4f-11898bbc8eb7 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:13.604209 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:13.654898 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c21848-896c-4768-9f37-c55e33cf9b49 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:13.682462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032be84-0bc4-41ff-9d4f-11898bbc8eb7 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:13.705820 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81f448-e5c0-45a2-b250-da74040814db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:13.706500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81f448-e5c0-45a2-b250-da74040814db None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:13.706864 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81f448-e5c0-45a2-b250-da74040814db None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:13.707143 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81f448-e5c0-45a2-b250-da74040814db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:13.718909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81f448-e5c0-45a2-b250-da74040814db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:13.720349 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81f448-e5c0-45a2-b250-da74040814db None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:13.723278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433173d-ee07-46b5-8070-de0ae35f2f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:13.723914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433173d-ee07-46b5-8070-de0ae35f2f90 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:13.724198 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433173d-ee07-46b5-8070-de0ae35f2f90 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:13.724478 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433173d-ee07-46b5-8070-de0ae35f2f90 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:13.725164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433173d-ee07-46b5-8070-de0ae35f2f90 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:13.725471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433173d-ee07-46b5-8070-de0ae35f2f90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:13.727526 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433173d-ee07-46b5-8070-de0ae35f2f90 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:13.736156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-1f81f448-e5c0-45a2-b250-da74040814db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:13.736156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:13.736156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:13.736156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:13.736156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:13.736156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:13.736156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:13.736156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:13.736156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:13.736156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:13.736156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:13.736156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:13.736156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:13.736156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:13.736156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:13.737607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:13.737607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:13.737607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:13.737607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:13.737607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:13.737607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:13.737607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:13.737607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:13.737607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:13.737607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:13.737607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:13.737607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:13.737607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:13.737607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:13.737607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:13.737607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:13.737607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:13.738920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:13.738920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:13.738920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:13.738920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:13.739189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 448/898] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:41:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:13.739297 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 450/898] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:13.742383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433173d-ee07-46b5-8070-de0ae35f2f90 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:13.743863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81f448-e5c0-45a2-b250-da74040814db None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:13.805532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:13.852958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433173d-ee07-46b5-8070-de0ae35f2f90 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:13.854527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81f448-e5c0-45a2-b250-da74040814db None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:13.872122 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:13.893067 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a7331-2bdd-4d1f-9b3a-7ea2bccf5aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:13.893695 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a7331-2bdd-4d1f-9b3a-7ea2bccf5aec None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:13.894095 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a7331-2bdd-4d1f-9b3a-7ea2bccf5aec None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:13.894371 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a7331-2bdd-4d1f-9b3a-7ea2bccf5aec None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:13.895088 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a7331-2bdd-4d1f-9b3a-7ea2bccf5aec None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:13.895300 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356e60f-db69-4161-aa3e-7a7d9b663813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:13.897086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a7331-2bdd-4d1f-9b3a-7ea2bccf5aec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:13.897202 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356e60f-db69-4161-aa3e-7a7d9b663813 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:13.897202 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356e60f-db69-4161-aa3e-7a7d9b663813 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:13.897202 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356e60f-db69-4161-aa3e-7a7d9b663813 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:13.897402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a7331-2bdd-4d1f-9b3a-7ea2bccf5aec None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:13.897470 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356e60f-db69-4161-aa3e-7a7d9b663813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:13.897470 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356e60f-db69-4161-aa3e-7a7d9b663813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:13.899620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356e60f-db69-4161-aa3e-7a7d9b663813 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:13.903230 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 449/899] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:41:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:13.904391 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b562682-3dbc-41f1-86cd-14bdc3acd882 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:13.904678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b562682-3dbc-41f1-86cd-14bdc3acd882 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:13.905065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b562682-3dbc-41f1-86cd-14bdc3acd882 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:13.910278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 450/900] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:13.911685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b562682-3dbc-41f1-86cd-14bdc3acd882 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:13.918042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 451/901] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:13.919619 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b31b18-22ac-4b4e-93f6-6b93f52b9e4d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:13.920103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b31b18-22ac-4b4e-93f6-6b93f52b9e4d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:13.920549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b31b18-22ac-4b4e-93f6-6b93f52b9e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:13.940536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-17b31b18-22ac-4b4e-93f6-6b93f52b9e4d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:13.941757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-17b31b18-22ac-4b4e-93f6-6b93f52b9e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:14.011701 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 452/902] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:14.012546 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b31b18-22ac-4b4e-93f6-6b93f52b9e4d None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:14.045591 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b562682-3dbc-41f1-86cd-14bdc3acd882 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:14.070256 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:14.082945 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40581518-1e0e-4698-b674-51c7d20024c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:14.083575 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40581518-1e0e-4698-b674-51c7d20024c1 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:14.087157 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40581518-1e0e-4698-b674-51c7d20024c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:14.087157 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40581518-1e0e-4698-b674-51c7d20024c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:14.087157 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40581518-1e0e-4698-b674-51c7d20024c1 None admin] RBAC: Adding query filter params (interface=public, service_id=3d04257d7caa4e89a75eb17eeff7d23f, region_id=RegionOne) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:14.087157 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40581518-1e0e-4698-b674-51c7d20024c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:14.087157 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40581518-1e0e-4698-b674-51c7d20024c1 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:14.096532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 451/903] 10.222.0.86 () {56 vars in 1251 bytes} [Tue Jul 26 14:41:13 2022] GET /identity/v3/endpoints?service_id=3d04257d7caa4e89a75eb17eeff7d23f&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:14.096532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40581518-1e0e-4698-b674-51c7d20024c1 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:14.128890 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b31b18-22ac-4b4e-93f6-6b93f52b9e4d None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:14.137370 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:14.167042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ddd4c-e652-44bb-8cb4-f6975f2e53bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:14.167693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ddd4c-e652-44bb-8cb4-f6975f2e53bd None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:14.168067 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ddd4c-e652-44bb-8cb4-f6975f2e53bd None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:14.168309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ddd4c-e652-44bb-8cb4-f6975f2e53bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:14.175766 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ddd4c-e652-44bb-8cb4-f6975f2e53bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:14.177211 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ddd4c-e652-44bb-8cb4-f6975f2e53bd None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:14.188772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-646ddd4c-e652-44bb-8cb4-f6975f2e53bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:14.188772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:14.188772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:14.188772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:14.188772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:14.188772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:14.188772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:14.188772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:14.188772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:14.188772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:14.188772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:14.188772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:14.188772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:41:14.188772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:41:14.188772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:41:14.189685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:41:14.189685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:14.189685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:14.189685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:14.189685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:14.189685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:14.189685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:14.189685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:14.189685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:14.189685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:14.189685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:14.189685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:14.189685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:14.189685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:14.189685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:14.189685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:14.189685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:14.190589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:41:14.190589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:41:14.190589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:41:14.190589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:41:14.190589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:41:14.190589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:41:14.190589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:14.190589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:14.190589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 453/904] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:41:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:14.191249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ddd4c-e652-44bb-8cb4-f6975f2e53bd None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:14.211469 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40581518-1e0e-4698-b674-51c7d20024c1 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:14.252373 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2966f-8d5e-41d1-bc37-6cd99be028be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:14.253036 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2966f-8d5e-41d1-bc37-6cd99be028be None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:14.253469 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2966f-8d5e-41d1-bc37-6cd99be028be None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:14.253603 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2966f-8d5e-41d1-bc37-6cd99be028be None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:14.254340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2966f-8d5e-41d1-bc37-6cd99be028be None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:14.255772 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2966f-8d5e-41d1-bc37-6cd99be028be None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:14.265544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-daa2966f-8d5e-41d1-bc37-6cd99be028be None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:41:14.265544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:14.265544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:14.265544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:14.265544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:14.265544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:14.265544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:14.265544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:14.265544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:41:14.265544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:14.265544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:14.265544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:14.265544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:14.265544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:14.265544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:14.265544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:14.266715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:14.266715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:14.266715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:14.266715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:14.266715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:14.266715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:14.266715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:14.266715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:14.266715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:14.266715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:14.266715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:14.266715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:14.266715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:14.266715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:14.266715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:14.266715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:14.273554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:14.273554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:14.273554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:14.273554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:14.273554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:14.273554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:14.273554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:14.273554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:14.273554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:14.273554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:14.273554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:14.273554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:14.273554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:14.273554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:41:14.273554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:14.273554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 452/905] 10.222.0.86 () {56 vars in 1132 bytes} [Tue Jul 26 14:41:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:14.274408 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2966f-8d5e-41d1-bc37-6cd99be028be None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:14.325756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:14.328083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ddd4c-e652-44bb-8cb4-f6975f2e53bd None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:14.372239 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6ddf9-38c7-41a6-9e31-b07f33e76146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:14.372877 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6ddf9-38c7-41a6-9e31-b07f33e76146 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:14.373243 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6ddf9-38c7-41a6-9e31-b07f33e76146 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:14.373434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6ddf9-38c7-41a6-9e31-b07f33e76146 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:14.374345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6ddf9-38c7-41a6-9e31-b07f33e76146 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:14.375794 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6ddf9-38c7-41a6-9e31-b07f33e76146 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:14.379216 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2966f-8d5e-41d1-bc37-6cd99be028be None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:14.390424 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 454/906] 10.222.0.86 () {56 vars in 1087 bytes} [Tue Jul 26 14:41:14 2022] GET /identity/v3/services => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:41:14.390424 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6ddf9-38c7-41a6-9e31-b07f33e76146 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:14.423773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:14.426064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c91a84-a6aa-4900-8560-c37750042bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:14.427013 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c91a84-a6aa-4900-8560-c37750042bc8 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:14.427296 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c91a84-a6aa-4900-8560-c37750042bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:14.427570 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c91a84-a6aa-4900-8560-c37750042bc8 None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:14.428347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c91a84-a6aa-4900-8560-c37750042bc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:14.428654 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c91a84-a6aa-4900-8560-c37750042bc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:14.431334 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c91a84-a6aa-4900-8560-c37750042bc8 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:14.449293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 453/907] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:41:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:14.455860 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c91a84-a6aa-4900-8560-c37750042bc8 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:14.527159 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6ddf9-38c7-41a6-9e31-b07f33e76146 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:14.579411 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026c1a0-ad24-44de-b669-1460ddf7d16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:14.580636 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026c1a0-ad24-44de-b669-1460ddf7d16d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:14.580927 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026c1a0-ad24-44de-b669-1460ddf7d16d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:14.581210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026c1a0-ad24-44de-b669-1460ddf7d16d None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:14.582306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026c1a0-ad24-44de-b669-1460ddf7d16d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:14.582685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026c1a0-ad24-44de-b669-1460ddf7d16d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:14.584707 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026c1a0-ad24-44de-b669-1460ddf7d16d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:14.595264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 455/908] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jul 26 14:41:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:14.600740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026c1a0-ad24-44de-b669-1460ddf7d16d None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:14.607247 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c91a84-a6aa-4900-8560-c37750042bc8 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:14.621053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:14.663918 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b68ea-fbf3-44f8-b3db-f2af6c816dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:14.664727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b68ea-fbf3-44f8-b3db-f2af6c816dc7 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:14.665030 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b68ea-fbf3-44f8-b3db-f2af6c816dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:14.665315 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b68ea-fbf3-44f8-b3db-f2af6c816dc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:14.666463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b68ea-fbf3-44f8-b3db-f2af6c816dc7 None admin] RBAC: Adding query filter params (role.id=392e2ed96a59406fb49190dce5ee2a85, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=0834be7405cd4c968763099251d37154) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:14.667186 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b68ea-fbf3-44f8-b3db-f2af6c816dc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:14.668704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b68ea-fbf3-44f8-b3db-f2af6c816dc7 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:14.676369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 454/909] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:41:14 2022] GET /identity/v3/role_assignments?user.id=0834be7405cd4c968763099251d37154&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=392e2ed96a59406fb49190dce5ee2a85 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:14.726403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:14.734278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026c1a0-ad24-44de-b669-1460ddf7d16d None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:14.776618 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e9db8-70a0-4f85-92b8-ffd28402e67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:14.777259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e9db8-70a0-4f85-92b8-ffd28402e67c None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:14.777545 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e9db8-70a0-4f85-92b8-ffd28402e67c None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:14.777823 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e9db8-70a0-4f85-92b8-ffd28402e67c None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:14.778633 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e9db8-70a0-4f85-92b8-ffd28402e67c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:14.778950 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e9db8-70a0-4f85-92b8-ffd28402e67c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:14.780393 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e9db8-70a0-4f85-92b8-ffd28402e67c None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:14.786685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 456/910] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jul 26 14:41:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:14.793143 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b68ea-fbf3-44f8-b3db-f2af6c816dc7 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:14.903147 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b68ea-fbf3-44f8-b3db-f2af6c816dc7 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:14.945450 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833519c-4160-4901-99c7-42b3111430ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:14.946006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833519c-4160-4901-99c7-42b3111430ce None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:14.946295 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833519c-4160-4901-99c7-42b3111430ce None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:14.946613 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833519c-4160-4901-99c7-42b3111430ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:14.947388 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833519c-4160-4901-99c7-42b3111430ce None admin] RBAC: Adding query filter params (interface=public, service_id=94745594985e499fb2d1770b55b826e0, region_id=RegionOne) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:14.947705 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833519c-4160-4901-99c7-42b3111430ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:14.949091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833519c-4160-4901-99c7-42b3111430ce None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:14.955163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 455/911] 10.222.0.86 () {56 vars in 1251 bytes} [Tue Jul 26 14:41:14 2022] GET /identity/v3/endpoints?service_id=94745594985e499fb2d1770b55b826e0&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:14.963500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e9db8-70a0-4f85-92b8-ffd28402e67c None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:15.069366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e9db8-70a0-4f85-92b8-ffd28402e67c None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:15.106096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baed45-0502-4d33-a839-4f1785363b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:15.107217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baed45-0502-4d33-a839-4f1785363b5d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:15.107701 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baed45-0502-4d33-a839-4f1785363b5d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:15.108222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baed45-0502-4d33-a839-4f1785363b5d None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:15.109074 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3baed45-0502-4d33-a839-4f1785363b5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:15.110697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3baed45-0502-4d33-a839-4f1785363b5d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:15.117735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 457/912] 10.222.0.86 () {56 vars in 1087 bytes} [Tue Jul 26 14:41:14 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:41:15.520356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b96eb6-05fb-4b97-a22c-dda1fd9726fd None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:15.520645 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b96eb6-05fb-4b97-a22c-dda1fd9726fd None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:15.520930 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b96eb6-05fb-4b97-a22c-dda1fd9726fd None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:15.522304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 456/913] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:15.527706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096ad56-29d3-4884-82a6-83c0d11a4782 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:15.528137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096ad56-29d3-4884-82a6-83c0d11a4782 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:15.528274 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096ad56-29d3-4884-82a6-83c0d11a4782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:15.546370 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-b096ad56-29d3-4884-82a6-83c0d11a4782 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:15.547603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b096ad56-29d3-4884-82a6-83c0d11a4782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:15.565652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:15.623380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 458/914] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:15.646310 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b96eb6-05fb-4b97-a22c-dda1fd9726fd None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:15.697441 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:15.760915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b96eb6-05fb-4b97-a22c-dda1fd9726fd None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:15.799092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af0c2e-7769-4697-8477-4ab6cf937f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:15.799706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af0c2e-7769-4697-8477-4ab6cf937f99 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:15.799987 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af0c2e-7769-4697-8477-4ab6cf937f99 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:15.800268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af0c2e-7769-4697-8477-4ab6cf937f99 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:15.800981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af0c2e-7769-4697-8477-4ab6cf937f99 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:15.802350 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af0c2e-7769-4697-8477-4ab6cf937f99 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:15.812191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-b6af0c2e-7769-4697-8477-4ab6cf937f99 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:41:15.812191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:15.812191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:15.812191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:15.812191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:15.812191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:15.812191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:15.812191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:15.812191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:41:15.812191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:15.812191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:15.812191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:15.812191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:15.812191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:15.812191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:15.812191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:15.812191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:15.813164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:15.813164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:15.813164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:15.813164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:15.813164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:15.813164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:15.813164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:15.813164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:15.813164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:15.813164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:15.813164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:15.813164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:15.813164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:15.813164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:15.813164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:15.813164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:15.813975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:15.813975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:15.813975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:15.813975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:15.813975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:15.813975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:15.813975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:15.813975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:15.813975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:15.813975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:15.813975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:15.813975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:15.813975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:41:15.813975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:15.813975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 457/915] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jul 26 14:41:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:15.819463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096ad56-29d3-4884-82a6-83c0d11a4782 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:15.922561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096ad56-29d3-4884-82a6-83c0d11a4782 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:15.958496 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ccfa0-10db-4c7a-b6bf-ea00f3d168a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:15.959125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ccfa0-10db-4c7a-b6bf-ea00f3d168a7 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:15.959410 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ccfa0-10db-4c7a-b6bf-ea00f3d168a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:15.959687 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ccfa0-10db-4c7a-b6bf-ea00f3d168a7 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:15.960404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ccfa0-10db-4c7a-b6bf-ea00f3d168a7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:15.960720 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ccfa0-10db-4c7a-b6bf-ea00f3d168a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:15.962108 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ccfa0-10db-4c7a-b6bf-ea00f3d168a7 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:15.971762 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 459/916] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jul 26 14:41:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:15.973373 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af0c2e-7769-4697-8477-4ab6cf937f99 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:16.078291 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af0c2e-7769-4697-8477-4ab6cf937f99 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:16.079757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:16.117504 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493212cc-49c2-471d-95fa-112f5d16c110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:16.118121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493212cc-49c2-471d-95fa-112f5d16c110 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:16.118431 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493212cc-49c2-471d-95fa-112f5d16c110 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:16.118705 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493212cc-49c2-471d-95fa-112f5d16c110 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:16.119389 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493212cc-49c2-471d-95fa-112f5d16c110 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:16.119694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493212cc-49c2-471d-95fa-112f5d16c110 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:16.121082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493212cc-49c2-471d-95fa-112f5d16c110 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:16.126725 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 458/917] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jul 26 14:41:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:16.132411 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ccfa0-10db-4c7a-b6bf-ea00f3d168a7 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:16.151094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:16.246920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ccfa0-10db-4c7a-b6bf-ea00f3d168a7 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:16.283447 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6aac93-ddcb-4b10-83f2-c26642fcbcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:16.284073 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aac93-ddcb-4b10-83f2-c26642fcbcf2 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:16.284400 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aac93-ddcb-4b10-83f2-c26642fcbcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:16.284685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aac93-ddcb-4b10-83f2-c26642fcbcf2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:16.285454 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6aac93-ddcb-4b10-83f2-c26642fcbcf2 None admin] RBAC: Adding query filter params (interface=public, service_id=5ebaafdd08f442c59a3f0e4192e59548, region_id=RegionOne) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:16.285764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6aac93-ddcb-4b10-83f2-c26642fcbcf2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:16.287190 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6aac93-ddcb-4b10-83f2-c26642fcbcf2 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:16.296776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 460/918] 10.222.0.86 () {56 vars in 1251 bytes} [Tue Jul 26 14:41:16 2022] GET /identity/v3/endpoints?service_id=5ebaafdd08f442c59a3f0e4192e59548&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:16.302440 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493212cc-49c2-471d-95fa-112f5d16c110 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:16.414709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493212cc-49c2-471d-95fa-112f5d16c110 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:16.450112 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d35b53-8718-4170-9db2-6dabf4508586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:16.450770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d35b53-8718-4170-9db2-6dabf4508586 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:16.451057 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d35b53-8718-4170-9db2-6dabf4508586 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:16.451336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d35b53-8718-4170-9db2-6dabf4508586 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:16.451989 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d35b53-8718-4170-9db2-6dabf4508586 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:16.453353 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d35b53-8718-4170-9db2-6dabf4508586 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:16.459975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 459/919] 10.222.0.86 () {56 vars in 1087 bytes} [Tue Jul 26 14:41:16 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:41:16.620479 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bdead-b6e6-4e17-8b34-2c460cf07def None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:16.620990 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bdead-b6e6-4e17-8b34-2c460cf07def None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:16.621180 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bdead-b6e6-4e17-8b34-2c460cf07def None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:16.622404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 461/920] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:16.628251 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbe60b-4912-4496-b793-af8e9f94719d None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:16.628563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbe60b-4912-4496-b793-af8e9f94719d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:16.628827 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbe60b-4912-4496-b793-af8e9f94719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:16.649193 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-affbe60b-4912-4496-b793-af8e9f94719d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:16.650426 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-affbe60b-4912-4496-b793-af8e9f94719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:16.683148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:16.731698 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 460/921] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:16.754709 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bdead-b6e6-4e17-8b34-2c460cf07def None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:16.842995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:16.865359 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bdead-b6e6-4e17-8b34-2c460cf07def None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:16.884804 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7628ca1-ce5e-4e5d-8993-bdc5d9d559dd None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:16.885330 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7628ca1-ce5e-4e5d-8993-bdc5d9d559dd None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:16.885410 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7628ca1-ce5e-4e5d-8993-bdc5d9d559dd None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:16.888030 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 461/922] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:41:16.892104 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bd5d1-065f-4167-acf2-ee328ed892a1 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:16.892394 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bd5d1-065f-4167-acf2-ee328ed892a1 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:16.892675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bd5d1-065f-4167-acf2-ee328ed892a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:16.904008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feedbee-37c9-445e-af45-cd073ab57dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:16.904664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feedbee-37c9-445e-af45-cd073ab57dbc None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:16.904950 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feedbee-37c9-445e-af45-cd073ab57dbc None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:16.905224 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feedbee-37c9-445e-af45-cd073ab57dbc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:16.905966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feedbee-37c9-445e-af45-cd073ab57dbc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:16.907942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feedbee-37c9-445e-af45-cd073ab57dbc None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:16.913090 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-6c5bd5d1-065f-4167-acf2-ee328ed892a1 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:16.914905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-6c5bd5d1-065f-4167-acf2-ee328ed892a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:16.919528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-3feedbee-37c9-445e-af45-cd073ab57dbc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:41:16.919528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:16.919528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:16.919528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:16.919528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:16.919528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:16.919528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:16.919528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:16.919528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:41:16.919528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:16.919528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:16.919528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:16.919528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:16.919528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:16.919528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:16.919528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:16.919528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:16.921009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:16.921009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:16.921009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:16.921009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:16.921009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:16.921009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:16.921009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:16.921009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:16.921009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:16.921009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:16.921009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:16.921009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:16.921009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:16.921009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:16.921009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:16.921009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:16.922105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:16.922105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:16.922105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:16.922105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:16.922105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:16.922105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:16.922105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:16.922105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:16.922105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:16.922105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:16.922105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:16.922105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:16.922105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:41:16.922105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:16.922105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 462/923] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:41:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:16.928752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feedbee-37c9-445e-af45-cd073ab57dbc None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:17.009458 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 462/924] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:41:17.032265 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bd5d1-065f-4167-acf2-ee328ed892a1 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:17.058511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feedbee-37c9-445e-af45-cd073ab57dbc None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:17.102042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c45d8e-d88b-46b9-8641-fd0f23883d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:17.102706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c45d8e-d88b-46b9-8641-fd0f23883d74 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:17.102993 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c45d8e-d88b-46b9-8641-fd0f23883d74 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:17.103277 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c45d8e-d88b-46b9-8641-fd0f23883d74 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:17.104448 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c45d8e-d88b-46b9-8641-fd0f23883d74 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:17.104765 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c45d8e-d88b-46b9-8641-fd0f23883d74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:17.106463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c45d8e-d88b-46b9-8641-fd0f23883d74 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:17.112715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 463/925] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:41:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:17.117841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c45d8e-d88b-46b9-8641-fd0f23883d74 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:17.132078 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:17.132908 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:17.142420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bd5d1-065f-4167-acf2-ee328ed892a1 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:17.180735 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca2377-ef14-4da5-9819-61f9dcd02766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:17.181389 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca2377-ef14-4da5-9819-61f9dcd02766 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:17.181671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca2377-ef14-4da5-9819-61f9dcd02766 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:17.181948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca2377-ef14-4da5-9819-61f9dcd02766 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:17.193171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca2377-ef14-4da5-9819-61f9dcd02766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:41:17.198911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-93ca2377-ef14-4da5-9819-61f9dcd02766 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:41:17.198911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:17.198911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:17.198911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:17.198911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:17.198911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:17.198911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:17.198911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:17.198911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:17.198911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:17.198911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:17.198911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:17.198911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:41:17.198911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:41:17.198911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:41:17.198911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:41:17.199878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:41:17.199878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:41:17.199878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:41:17.199878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:41:17.199878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:17.199878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:17.199878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:17.199878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:17.199878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:17.199878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:17.199878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:17.199878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:17.199878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:17.199878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:17.199878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:17.199878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:17.200713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:17.200713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:17.200713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:17.200713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:17.200713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:41:17.200713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:41:17.200713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:41:17.200713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:41:17.200713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:41:17.200713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:41:17.200713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:41:17.200713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:17.200713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 463/926] 10.222.0.86 () {56 vars in 1120 bytes} [Tue Jul 26 14:41:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:17.205750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca2377-ef14-4da5-9819-61f9dcd02766 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:17.235274 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c45d8e-d88b-46b9-8641-fd0f23883d74 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:17.278566 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14422a9a-e3d7-45ec-a5a1-f720d0a7d329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:17.279207 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14422a9a-e3d7-45ec-a5a1-f720d0a7d329 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:17.279496 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14422a9a-e3d7-45ec-a5a1-f720d0a7d329 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:17.279773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14422a9a-e3d7-45ec-a5a1-f720d0a7d329 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:17.280456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14422a9a-e3d7-45ec-a5a1-f720d0a7d329 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:17.280797 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14422a9a-e3d7-45ec-a5a1-f720d0a7d329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:17.282173 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14422a9a-e3d7-45ec-a5a1-f720d0a7d329 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:17.287264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 464/927] 10.222.0.86 () {56 vars in 1114 bytes} [Tue Jul 26 14:41:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:17.288599 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c658a53-02d7-4d26-b525-7c0b9fff6526 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:17.288868 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c658a53-02d7-4d26-b525-7c0b9fff6526 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:17.289147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c658a53-02d7-4d26-b525-7c0b9fff6526 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:17.290529 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 465/928] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:17.292882 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c658a53-02d7-4d26-b525-7c0b9fff6526 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:17.331517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca2377-ef14-4da5-9819-61f9dcd02766 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:17.368698 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:17.377966 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35829e-cd9d-4c0a-a6ca-ec7328bf745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:17.385922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35829e-cd9d-4c0a-a6ca-ec7328bf745b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:17.385922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35829e-cd9d-4c0a-a6ca-ec7328bf745b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:17.385922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35829e-cd9d-4c0a-a6ca-ec7328bf745b None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:17.385922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35829e-cd9d-4c0a-a6ca-ec7328bf745b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:17.385922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35829e-cd9d-4c0a-a6ca-ec7328bf745b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:17.385922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35829e-cd9d-4c0a-a6ca-ec7328bf745b None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:17.399710 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 464/929] 10.222.0.86 () {56 vars in 1115 bytes} [Tue Jul 26 14:41:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:17.399710 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946f7db-0337-4094-b34a-2ebc06a6f4e9 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:17.399710 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946f7db-0337-4094-b34a-2ebc06a6f4e9 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:17.399710 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946f7db-0337-4094-b34a-2ebc06a6f4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:17.404233 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c658a53-02d7-4d26-b525-7c0b9fff6526 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:17.416925 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-8946f7db-0337-4094-b34a-2ebc06a6f4e9 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:17.418379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-8946f7db-0337-4094-b34a-2ebc06a6f4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:17.425974 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:17.440373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54a93e-a55d-4004-9087-3fafb91da24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:17.440928 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54a93e-a55d-4004-9087-3fafb91da24f None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:17.441208 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54a93e-a55d-4004-9087-3fafb91da24f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:17.441477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54a93e-a55d-4004-9087-3fafb91da24f None admin] PATH_INFO: `/v3/endpoints` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:17.442171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54a93e-a55d-4004-9087-3fafb91da24f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:17.443568 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54a93e-a55d-4004-9087-3fafb91da24f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:17.485864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 465/930] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:17.486733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946f7db-0337-4094-b34a-2ebc06a6f4e9 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:17.526413 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 466/931] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:41:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:41:17.526413 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54a93e-a55d-4004-9087-3fafb91da24f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:17.648325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946f7db-0337-4094-b34a-2ebc06a6f4e9 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:17.661337 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54a93e-a55d-4004-9087-3fafb91da24f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:17.697798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91d9a3-15be-4d21-9b40-f342386a80d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:17.698736 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91d9a3-15be-4d21-9b40-f342386a80d4 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:17.699300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91d9a3-15be-4d21-9b40-f342386a80d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:17.700078 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91d9a3-15be-4d21-9b40-f342386a80d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:17.700214 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:17.712023 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ab47b-b3d4-4d2a-a699-4acc59110b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:17.713547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ab47b-b3d4-4d2a-a699-4acc59110b24 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:17.713547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ab47b-b3d4-4d2a-a699-4acc59110b24 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:17.713547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ab47b-b3d4-4d2a-a699-4acc59110b24 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:17.713824 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91d9a3-15be-4d21-9b40-f342386a80d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:17.713902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ab47b-b3d4-4d2a-a699-4acc59110b24 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:17.715093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91d9a3-15be-4d21-9b40-f342386a80d4 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:17.717040 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ab47b-b3d4-4d2a-a699-4acc59110b24 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:17.718539 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:17.729110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-e22ab47b-b3d4-4d2a-a699-4acc59110b24 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:41:17.729110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:17.729110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:17.729110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:17.729110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:17.729110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:17.729110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:17.729110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:17.729110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:41:17.729110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:17.729110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:17.729110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:17.729110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:17.729110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:17.729110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:17.729110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:17.730221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:17.730221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:17.730221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:17.730221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:17.730221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:17.730221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:17.730221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:17.730221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:17.730221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:17.730221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:17.730221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:17.730221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:17.730221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:17.730221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:17.730221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:17.730221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:17.731107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:17.731107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:17.731107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:17.731107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:17.731107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:17.731107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:17.731107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:17.731107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:17.731107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:17.731107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:17.731107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:17.731107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:17.731107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:17.731107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:41:17.731107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:17.731107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 467/932] 10.222.0.86 () {56 vars in 1132 bytes} [Tue Jul 26 14:41:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:17.736583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ab47b-b3d4-4d2a-a699-4acc59110b24 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:17.741444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-cb91d9a3-15be-4d21-9b40-f342386a80d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:17.741444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:17.741444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:17.741444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:17.741444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:17.741444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:17.741444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:17.741444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:17.741444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:17.741444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:17.741444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:17.741444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:17.741444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:17.741444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:17.741444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:17.742903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:17.742903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:17.742903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:17.742903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:17.742903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:17.742903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:17.742903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:17.742903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:17.742903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:17.742903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:17.742903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:17.742903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:17.742903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:17.742903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:17.742903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:17.742903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:17.742903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:17.743757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:17.743757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:17.743757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:17.743757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:17.743757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 466/933] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:17.745743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91d9a3-15be-4d21-9b40-f342386a80d4 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:17.860116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ab47b-b3d4-4d2a-a699-4acc59110b24 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:17.883361 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91d9a3-15be-4d21-9b40-f342386a80d4 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:17.899546 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9d767-eab4-49bd-9591-26d2961722b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:17.900307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9d767-eab4-49bd-9591-26d2961722b0 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:17.900775 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9d767-eab4-49bd-9591-26d2961722b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:17.901136 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9d767-eab4-49bd-9591-26d2961722b0 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:17.901973 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9d767-eab4-49bd-9591-26d2961722b0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:17.902354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9d767-eab4-49bd-9591-26d2961722b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:17.904078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9d767-eab4-49bd-9591-26d2961722b0 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:17.909819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 468/934] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jul 26 14:41:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:17.915707 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9d767-eab4-49bd-9591-26d2961722b0 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:17.924787 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02b883-f55a-4004-a90d-d6a6abdc5dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:17.925429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02b883-f55a-4004-a90d-d6a6abdc5dd8 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:17.925685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02b883-f55a-4004-a90d-d6a6abdc5dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:17.926501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02b883-f55a-4004-a90d-d6a6abdc5dd8 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:17.927213 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02b883-f55a-4004-a90d-d6a6abdc5dd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:17.927522 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02b883-f55a-4004-a90d-d6a6abdc5dd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:17.929981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02b883-f55a-4004-a90d-d6a6abdc5dd8 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:17.944122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 467/935] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:17.949448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02b883-f55a-4004-a90d-d6a6abdc5dd8 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:17.981477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:18.013638 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:18.034087 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9d767-eab4-49bd-9591-26d2961722b0 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:18.074800 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02b883-f55a-4004-a90d-d6a6abdc5dd8 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:18.079292 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b678ff1-9212-4aa3-a67c-2fd7a27fd2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:18.079917 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b678ff1-9212-4aa3-a67c-2fd7a27fd2d6 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:18.080196 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b678ff1-9212-4aa3-a67c-2fd7a27fd2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:18.080466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b678ff1-9212-4aa3-a67c-2fd7a27fd2d6 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:18.081146 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b678ff1-9212-4aa3-a67c-2fd7a27fd2d6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:18.081602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b678ff1-9212-4aa3-a67c-2fd7a27fd2d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:18.083083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b678ff1-9212-4aa3-a67c-2fd7a27fd2d6 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:18.089879 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 469/936] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jul 26 14:41:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:18.095837 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b678ff1-9212-4aa3-a67c-2fd7a27fd2d6 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:18.118965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e4216-8f25-46dd-a7e0-2da408fd6ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:18.119668 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e4216-8f25-46dd-a7e0-2da408fd6ab4 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:18.119948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e4216-8f25-46dd-a7e0-2da408fd6ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:18.120221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e4216-8f25-46dd-a7e0-2da408fd6ab4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:18.128681 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e4216-8f25-46dd-a7e0-2da408fd6ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:18.130240 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e4216-8f25-46dd-a7e0-2da408fd6ab4 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:18.143320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-407e4216-8f25-46dd-a7e0-2da408fd6ab4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:41:18.143320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:18.143320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:18.143320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:18.143320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:18.143320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:18.143320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:18.143320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:18.143320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:18.143320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:18.143320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:18.143320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:18.143320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:41:18.143320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:41:18.143320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:41:18.143320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:41:18.145501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:18.145501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:18.145501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:41:18.145501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:18.145501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:41:18.145501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:18.145501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:18.145501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:18.145501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:18.145501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:18.145501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:18.145501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:18.145501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:18.145501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:18.145501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:18.145501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:18.145501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:18.145501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:18.148439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:18.148439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:18.148439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:41:18.148439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:41:18.148439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:41:18.148439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:41:18.148439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:41:18.148439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:41:18.148439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:41:18.148439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:18.158426 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 468/937] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jul 26 14:41:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:18.158426 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e4216-8f25-46dd-a7e0-2da408fd6ab4 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:18.207179 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b678ff1-9212-4aa3-a67c-2fd7a27fd2d6 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:18.225429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:18.246058 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbc91d-08bd-427b-977c-33bdfa5a2756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:18.246744 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbc91d-08bd-427b-977c-33bdfa5a2756 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:18.247029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbc91d-08bd-427b-977c-33bdfa5a2756 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:18.247414 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbc91d-08bd-427b-977c-33bdfa5a2756 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:18.248140 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbc91d-08bd-427b-977c-33bdfa5a2756 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:18.249883 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbc91d-08bd-427b-977c-33bdfa5a2756 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:18.257993 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e4216-8f25-46dd-a7e0-2da408fd6ab4 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:18.273063 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:18.293595 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7dfdc-b764-4b0c-896f-1554789ae6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:18.294217 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7dfdc-b764-4b0c-896f-1554789ae6c7 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:18.294540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7dfdc-b764-4b0c-896f-1554789ae6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:18.294819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7dfdc-b764-4b0c-896f-1554789ae6c7 None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:18.295603 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7dfdc-b764-4b0c-896f-1554789ae6c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:18.295914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7dfdc-b764-4b0c-896f-1554789ae6c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:18.297413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7dfdc-b764-4b0c-896f-1554789ae6c7 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:18.316003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 469/938] 10.222.0.86 () {56 vars in 1149 bytes} [Tue Jul 26 14:41:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:18.321731 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7dfdc-b764-4b0c-896f-1554789ae6c7 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:18.342814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 470/939] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:41:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:41:18.444491 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7dfdc-b764-4b0c-896f-1554789ae6c7 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:18.491609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa257185-829e-47ba-968c-60bda38277e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:18.492201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa257185-829e-47ba-968c-60bda38277e5 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:18.492491 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa257185-829e-47ba-968c-60bda38277e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:18.492772 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa257185-829e-47ba-968c-60bda38277e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:18.505572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa257185-829e-47ba-968c-60bda38277e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:18.507087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa257185-829e-47ba-968c-60bda38277e5 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:18.525244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-aa257185-829e-47ba-968c-60bda38277e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:18.525244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:18.525244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:18.525244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:18.525244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:18.525244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:18.525244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:18.525244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:18.525244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:18.525244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:18.525244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:18.525244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:18.525244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:18.525244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:18.525244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:18.527406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:18.527406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:18.527406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:18.527406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:18.527406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:18.527406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:18.527406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:18.527406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:18.527406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:18.527406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:18.527406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:18.527406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:18.527406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:18.527406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:18.527406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:18.527406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:18.527406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:18.529530 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:18.529530 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:18.529530 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:18.529530 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:18.530674 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 470/940] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:18.532931 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbc91d-08bd-427b-977c-33bdfa5a2756 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:18.641305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb02cc2-5f9b-4c3c-b845-b3988c7b13bf None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:18.641305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb02cc2-5f9b-4c3c-b845-b3988c7b13bf None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:18.641305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb02cc2-5f9b-4c3c-b845-b3988c7b13bf None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:18.641305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 471/941] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:41:18.647613 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbc91d-08bd-427b-977c-33bdfa5a2756 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:18.648379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c1b99-d8cb-4d07-b805-2cce071cbea3 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:18.648379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c1b99-d8cb-4d07-b805-2cce071cbea3 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:18.648379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c1b99-d8cb-4d07-b805-2cce071cbea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:18.670011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-5f3c1b99-d8cb-4d07-b805-2cce071cbea3 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:18.670011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5f3c1b99-d8cb-4d07-b805-2cce071cbea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:18.688246 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:18.696494 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4ab47-5227-445b-803b-a655166b3b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:18.697734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4ab47-5227-445b-803b-a655166b3b7d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:18.698017 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4ab47-5227-445b-803b-a655166b3b7d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:18.698292 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4ab47-5227-445b-803b-a655166b3b7d None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:18.699081 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4ab47-5227-445b-803b-a655166b3b7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:18.710936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4ab47-5227-445b-803b-a655166b3b7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:18.710936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4ab47-5227-445b-803b-a655166b3b7d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:18.716233 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 471/942] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:18.723753 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4ab47-5227-445b-803b-a655166b3b7d None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:18.762880 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:18.763080 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 472/943] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:41:18.781659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c1b99-d8cb-4d07-b805-2cce071cbea3 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:18.844018 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4ab47-5227-445b-803b-a655166b3b7d None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:18.881494 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfc81b-08ee-4b45-8ac0-d75da7c3ca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:18.882813 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfc81b-08ee-4b45-8ac0-d75da7c3ca99 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:18.883097 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfc81b-08ee-4b45-8ac0-d75da7c3ca99 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:18.883372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfc81b-08ee-4b45-8ac0-d75da7c3ca99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:18.890649 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfc81b-08ee-4b45-8ac0-d75da7c3ca99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:18.892112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfc81b-08ee-4b45-8ac0-d75da7c3ca99 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:18.899783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c1b99-d8cb-4d07-b805-2cce071cbea3 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:18.904810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-79bfc81b-08ee-4b45-8ac0-d75da7c3ca99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:18.904810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:18.904810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:18.904810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:18.904810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:18.904810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:18.904810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:18.904810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:18.904810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:18.904810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:18.904810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:18.904810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:18.904810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:41:18.904810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:41:18.904810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:41:18.905710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:41:18.905710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:18.905710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:18.905710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:18.905710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:18.905710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:18.905710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:18.905710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:18.905710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:18.905710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:18.905710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:18.905710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:18.905710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:18.905710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:18.905710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:18.905710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:18.905710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:18.907093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:41:18.907093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:41:18.907093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:41:18.907093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:41:18.907093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:41:18.907093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:41:18.907093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:18.907093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:18.907093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 472/944] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:41:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:18.915856 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfc81b-08ee-4b45-8ac0-d75da7c3ca99 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:18.940750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbda0f-5165-492a-9e6b-88d4bdd17f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:18.942111 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbda0f-5165-492a-9e6b-88d4bdd17f43 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:18.942639 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbda0f-5165-492a-9e6b-88d4bdd17f43 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:18.943136 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbda0f-5165-492a-9e6b-88d4bdd17f43 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:18.943971 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbda0f-5165-492a-9e6b-88d4bdd17f43 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:18.946080 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbda0f-5165-492a-9e6b-88d4bdd17f43 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:18.955435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-42fbda0f-5165-492a-9e6b-88d4bdd17f43 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:41:18.955435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:18.955435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:18.955435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:18.955435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:18.955435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:18.955435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:18.955435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:18.955435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:41:18.955435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:18.955435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:18.955435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:18.955435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:18.955435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:18.955435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:18.955435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:18.955435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:18.956417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:18.956417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:18.956417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:18.956417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:18.956417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:18.956417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:18.956417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:18.956417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:18.956417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:18.956417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:18.956417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:18.956417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:18.956417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:18.956417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:18.956417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:18.956417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:18.957305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:18.957305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:18.957305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:18.957305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:18.957305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:18.957305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:18.957305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:18.957305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:18.957305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:18.957305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:18.957305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:18.957305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:18.957305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:41:18.957305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:18.961411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 473/945] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jul 26 14:41:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:18.970422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbda0f-5165-492a-9e6b-88d4bdd17f43 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:18.985426 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:19.032082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:19.043834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfc81b-08ee-4b45-8ac0-d75da7c3ca99 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:19.095078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f63b84-26d3-44d8-a3fc-b7bb76de997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:19.095710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f63b84-26d3-44d8-a3fc-b7bb76de997a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:19.095996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f63b84-26d3-44d8-a3fc-b7bb76de997a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:19.096279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f63b84-26d3-44d8-a3fc-b7bb76de997a None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:19.097041 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f63b84-26d3-44d8-a3fc-b7bb76de997a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:19.097429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f63b84-26d3-44d8-a3fc-b7bb76de997a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:19.098904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f63b84-26d3-44d8-a3fc-b7bb76de997a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:19.105983 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbda0f-5165-492a-9e6b-88d4bdd17f43 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:19.117518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 473/946] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:41:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:19.118426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f63b84-26d3-44d8-a3fc-b7bb76de997a None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:19.144496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381890a7-6380-4fb5-97a8-6cb53ed0417c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:19.145518 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381890a7-6380-4fb5-97a8-6cb53ed0417c None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:19.146283 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381890a7-6380-4fb5-97a8-6cb53ed0417c None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:19.146693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381890a7-6380-4fb5-97a8-6cb53ed0417c None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:19.148244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381890a7-6380-4fb5-97a8-6cb53ed0417c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:19.148664 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381890a7-6380-4fb5-97a8-6cb53ed0417c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:19.150883 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381890a7-6380-4fb5-97a8-6cb53ed0417c None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:19.158852 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 474/947] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jul 26 14:41:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:19.164768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381890a7-6380-4fb5-97a8-6cb53ed0417c None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:19.231063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f63b84-26d3-44d8-a3fc-b7bb76de997a None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:19.267139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11041d-b208-4893-a711-18a89a26b3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:19.268222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11041d-b208-4893-a711-18a89a26b3a8 None admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:19.268724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11041d-b208-4893-a711-18a89a26b3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:19.269221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11041d-b208-4893-a711-18a89a26b3a8 None admin] PATH_INFO: `/v3/projects/12937bc17f02483285f18c492fe237e3/users/0834be7405cd4c968763099251d37154/roles/392e2ed96a59406fb49190dce5ee2a85` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:19.271684 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11041d-b208-4893-a711-18a89a26b3a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=12937bc17f02483285f18c492fe237e3, user_id=0834be7405cd4c968763099251d37154, role_id=392e2ed96a59406fb49190dce5ee2a85)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:19.273891 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11041d-b208-4893-a711-18a89a26b3a8 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:19.280799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:19.303104 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381890a7-6380-4fb5-97a8-6cb53ed0417c None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:19.336162 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25ea03-fe22-49e7-a268-f5cb74f2d359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:19.336780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25ea03-fe22-49e7-a268-f5cb74f2d359 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:19.337065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25ea03-fe22-49e7-a268-f5cb74f2d359 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:19.337345 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25ea03-fe22-49e7-a268-f5cb74f2d359 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:19.338017 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25ea03-fe22-49e7-a268-f5cb74f2d359 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:19.338324 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25ea03-fe22-49e7-a268-f5cb74f2d359 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:19.339765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25ea03-fe22-49e7-a268-f5cb74f2d359 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:19.345322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 475/948] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jul 26 14:41:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:19.350274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25ea03-fe22-49e7-a268-f5cb74f2d359 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:19.370636 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 474/949] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:41:19 2022] PUT /identity/v3/projects/12937bc17f02483285f18c492fe237e3/users/0834be7405cd4c968763099251d37154/roles/392e2ed96a59406fb49190dce5ee2a85 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:41:19.470956 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25ea03-fe22-49e7-a268-f5cb74f2d359 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:19.511107 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f376783-0225-402c-9f74-30ed8c7cb176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:19.512112 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f376783-0225-402c-9f74-30ed8c7cb176 None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:19.512599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f376783-0225-402c-9f74-30ed8c7cb176 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:19.513079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f376783-0225-402c-9f74-30ed8c7cb176 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:19.514041 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f376783-0225-402c-9f74-30ed8c7cb176 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:19.515688 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f376783-0225-402c-9f74-30ed8c7cb176 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:19.605143 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:19.611910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 476/950] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:41:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:41:19.688940 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f861d7-c556-4bfe-952b-84d2d3c93ffe None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:19.689283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f861d7-c556-4bfe-952b-84d2d3c93ffe None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:19.689506 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f861d7-c556-4bfe-952b-84d2d3c93ffe None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:19.691245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 475/951] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:19.696999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c549197-be18-42d7-9035-ad248a4c6fc4 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:19.697299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c549197-be18-42d7-9035-ad248a4c6fc4 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:19.697577 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c549197-be18-42d7-9035-ad248a4c6fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:19.718048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-7c549197-be18-42d7-9035-ad248a4c6fc4 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:19.719322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-7c549197-be18-42d7-9035-ad248a4c6fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:19.803488 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 477/952] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:19.826848 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f861d7-c556-4bfe-952b-84d2d3c93ffe None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:19.843579 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:19.937671 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f861d7-c556-4bfe-952b-84d2d3c93ffe None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:19.974002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e518656-94f0-4ca1-b1fe-8aab7bb8705a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:19.974666 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e518656-94f0-4ca1-b1fe-8aab7bb8705a None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:19.975006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e518656-94f0-4ca1-b1fe-8aab7bb8705a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:19.975372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e518656-94f0-4ca1-b1fe-8aab7bb8705a None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:19.976647 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e518656-94f0-4ca1-b1fe-8aab7bb8705a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:19.978100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e518656-94f0-4ca1-b1fe-8aab7bb8705a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:19.980891 dv-cinder-850668-2-smb devstack@keystone.service[92030]: WARNING keystone.server.flask.common [None req-4e518656-94f0-4ca1-b1fe-8aab7bb8705a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 14:41:20.027226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.sql.core [None req-4e518656-94f0-4ca1-b1fe-8aab7bb8705a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 14:41:20.027226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 14:41:20.027226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [parameters: {'id': '14db2381deea4a89a875e990b3327d53', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 14:41:20.027226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92030) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 14:41:20.045276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-4e518656-94f0-4ca1-b1fe-8aab7bb8705a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 14db2381deea4a89a875e990b3327d53.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 14db2381deea4a89a875e990b3327d53. Jul 26 14:41:20.045276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:20.045276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:41:20.045276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 14:41:20.045276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:41:20.045276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 14:41:20.045276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:41:20.045276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 14:41:20.045276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:41:20.045276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application conn.query(q) Jul 26 14:41:20.045276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:41:20.045276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:41:20.045276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:41:20.046169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application result.read() Jul 26 14:41:20.046169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:41:20.046169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 14:41:20.046169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:41:20.046169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 14:41:20.046169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:41:20.046169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 14:41:20.046169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:41:20.046169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 14:41:20.046169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 14:41:20.046169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:20.046169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 14:41:20.046169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:20.046169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:20.046169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 14:41:20.046169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 14:41:20.046169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 26 14:41:20.046169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 26 14:41:20.047157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 14:41:20.047157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application next(self.gen) Jul 26 14:41:20.047157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 14:41:20.047157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application yield resource Jul 26 14:41:20.047157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 14:41:20.047157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application next(self.gen) Jul 26 14:41:20.047157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 14:41:20.047157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 14:41:20.047157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:41:20.047157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 14:41:20.047157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:41:20.047157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise self.value Jul 26 14:41:20.047157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 14:41:20.047157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 14:41:20.047157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 14:41:20.047157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application session.commit() Jul 26 14:41:20.047157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 14:41:20.048030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 14:41:20.048030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 14:41:20.048030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 14:41:20.048030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 14:41:20.048030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self.session.flush() Jul 26 14:41:20.048030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 14:41:20.048030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 14:41:20.048030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 14:41:20.048030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 14:41:20.048030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 14:41:20.048030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application compat.raise_( Jul 26 14:41:20.048030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:41:20.048030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception Jul 26 14:41:20.048030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 14:41:20.048030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 14:41:20.048030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 14:41:20.048030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 14:41:20.048901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 14:41:20.048901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 14:41:20.048901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 14:41:20.048901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 14:41:20.048901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 14:41:20.048901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 14:41:20.048901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 14:41:20.048901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 14:41:20.048901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 14:41:20.048901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 14:41:20.048901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 14:41:20.048901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 14:41:20.048901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 14:41:20.048901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 14:41:20.048901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 14:41:20.049704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 14:41:20.049704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:41:20.049704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception Jul 26 14:41:20.049704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:41:20.049704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 14:41:20.049704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:41:20.049704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 14:41:20.049704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:41:20.049704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 14:41:20.049704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:41:20.049704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application conn.query(q) Jul 26 14:41:20.049704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:41:20.049704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:41:20.049704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:41:20.049704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application result.read() Jul 26 14:41:20.049704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:41:20.049704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 14:41:20.051751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:41:20.051751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 14:41:20.051751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:41:20.051751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 14:41:20.051751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:41:20.051751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 14:41:20.051751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 14:41:20.051751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 14:41:20.051751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [parameters: {'id': '14db2381deea4a89a875e990b3327d53', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 14:41:20.051751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 14:41:20.051751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:20.051751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:20.051751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:20.051751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:20.051751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 26 14:41:20.053637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 26 14:41:20.053637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 14:41:20.053637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 14:41:20.053637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 26 14:41:20.053637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:20.053637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:20.053637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:20.053637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:20.053637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:20.053637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:20.053637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:20.053637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:20.053637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:20.053637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:20.053637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:20.053637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:20.053637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:20.056103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:20.056103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 26 14:41:20.056103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 26 14:41:20.056103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:20.056103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:20.056103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 26 14:41:20.056103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 26 14:41:20.056103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 14db2381deea4a89a875e990b3327d53. Jul 26 14:41:20.056103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:20.056103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 476/953] 10.222.0.86 () {60 vars in 1140 bytes} [Tue Jul 26 14:41:19 2022] POST /identity/v3/projects => generated 262 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:20.063677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c549197-be18-42d7-9035-ad248a4c6fc4 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:20.172660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c549197-be18-42d7-9035-ad248a4c6fc4 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:20.197707 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:20.208319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78367953-5790-4eba-9e3b-d69c2a0700e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:20.208983 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78367953-5790-4eba-9e3b-d69c2a0700e4 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:20.214334 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78367953-5790-4eba-9e3b-d69c2a0700e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:20.214334 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78367953-5790-4eba-9e3b-d69c2a0700e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:20.217312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78367953-5790-4eba-9e3b-d69c2a0700e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:20.218800 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78367953-5790-4eba-9e3b-d69c2a0700e4 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:20.231119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-78367953-5790-4eba-9e3b-d69c2a0700e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:20.231119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:20.231119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:20.231119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:20.231119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:20.231119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:20.231119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:20.231119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:20.231119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:20.231119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:20.231119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:20.231119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:20.231119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:41:20.231119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:41:20.231119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:41:20.232047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:41:20.232047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:20.232047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:20.232047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:20.232047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:20.232047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:20.232047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:20.232047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:20.232047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:20.232047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:20.232047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:20.232047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:20.232047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:20.232047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:20.232047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:20.232047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:20.232047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:20.232958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:41:20.232958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:41:20.232958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:41:20.232958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:41:20.232958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:41:20.232958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:41:20.232958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:20.232958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:20.232958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 478/954] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:41:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:20.238661 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e518656-94f0-4ca1-b1fe-8aab7bb8705a None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:20.308990 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:20.344962 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e518656-94f0-4ca1-b1fe-8aab7bb8705a None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:20.384159 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad276f-46af-45a6-95eb-e11188ab73e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:20.384790 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad276f-46af-45a6-95eb-e11188ab73e6 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:20.385078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad276f-46af-45a6-95eb-e11188ab73e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:20.385356 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad276f-46af-45a6-95eb-e11188ab73e6 None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:20.386086 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad276f-46af-45a6-95eb-e11188ab73e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:20.386487 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad276f-46af-45a6-95eb-e11188ab73e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:20.388193 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad276f-46af-45a6-95eb-e11188ab73e6 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:20.412746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 477/955] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jul 26 14:41:20 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:20.564420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afbec7-11ea-4da4-8705-ac43c837b1b6 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:20.565138 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afbec7-11ea-4da4-8705-ac43c837b1b6 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:20.565634 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afbec7-11ea-4da4-8705-ac43c837b1b6 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:20.567501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 479/956] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:20.573645 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afcfef-5d30-421f-b30b-6e75d7fa019f None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:20.574189 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afcfef-5d30-421f-b30b-6e75d7fa019f None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:20.574728 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afcfef-5d30-421f-b30b-6e75d7fa019f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:20.596525 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-82afcfef-5d30-421f-b30b-6e75d7fa019f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:20.598070 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-82afcfef-5d30-421f-b30b-6e75d7fa019f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:20.669431 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 478/957] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:20.695878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afbec7-11ea-4da4-8705-ac43c837b1b6 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:20.807031 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afbec7-11ea-4da4-8705-ac43c837b1b6 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:20.847616 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa4862-3bd8-457e-b09e-4c51c3943b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:20.848188 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa4862-3bd8-457e-b09e-4c51c3943b20 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:20.848473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa4862-3bd8-457e-b09e-4c51c3943b20 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:20.848757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa4862-3bd8-457e-b09e-4c51c3943b20 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:20.849394 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa4862-3bd8-457e-b09e-4c51c3943b20 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:20.850794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa4862-3bd8-457e-b09e-4c51c3943b20 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:20.860038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-60fa4862-3bd8-457e-b09e-4c51c3943b20 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:41:20.860038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:20.860038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:20.860038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:20.860038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:20.860038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:20.860038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:20.860038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:20.860038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:41:20.860038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:20.860038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:20.860038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:20.860038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:20.860038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:20.860038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:20.860038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:20.860038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:20.861148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:20.861148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:20.861148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:20.861148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:20.861148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:20.861148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:20.861148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:20.861148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:20.861148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:20.861148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:20.861148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:20.861148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:20.861148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:20.861148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:20.861148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:20.861148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:20.861999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:20.861999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:20.861999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:20.861999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:20.861999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:20.861999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:20.861999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:20.861999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:20.861999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:20.861999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:20.861999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:20.861999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:20.861999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:41:20.861999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:20.861999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 480/958] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:41:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:20.870064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afcfef-5d30-421f-b30b-6e75d7fa019f None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:20.932555 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:20.975232 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afcfef-5d30-421f-b30b-6e75d7fa019f None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:21.016540 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b90c16-e842-49dd-a4ee-683e4c29f720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:21.017524 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b90c16-e842-49dd-a4ee-683e4c29f720 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:21.018015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b90c16-e842-49dd-a4ee-683e4c29f720 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:21.018550 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b90c16-e842-49dd-a4ee-683e4c29f720 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:21.019446 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b90c16-e842-49dd-a4ee-683e4c29f720 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:21.019981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b90c16-e842-49dd-a4ee-683e4c29f720 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:21.021561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b90c16-e842-49dd-a4ee-683e4c29f720 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:21.027589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 479/959] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jul 26 14:41:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:21.033945 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa4862-3bd8-457e-b09e-4c51c3943b20 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:21.090969 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:21.149251 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa4862-3bd8-457e-b09e-4c51c3943b20 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:21.186290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6b654-2a71-40bc-9114-2a06bc79e5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:21.186947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b654-2a71-40bc-9114-2a06bc79e5cc None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:21.187232 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b654-2a71-40bc-9114-2a06bc79e5cc None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:21.187513 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b654-2a71-40bc-9114-2a06bc79e5cc None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:21.188196 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6b654-2a71-40bc-9114-2a06bc79e5cc None admin] RBAC: Adding query filter params (type=compute) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:21.188503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6b654-2a71-40bc-9114-2a06bc79e5cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:21.189883 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6b654-2a71-40bc-9114-2a06bc79e5cc None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:21.195208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 481/960] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jul 26 14:41:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:21.512515 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a98f76-0020-4445-93c9-cb30072af20d None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:21.512926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a98f76-0020-4445-93c9-cb30072af20d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:21.513108 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a98f76-0020-4445-93c9-cb30072af20d None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:21.514728 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 480/961] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:21.519934 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fac07-15ba-4bbd-ae9c-43a85117bcdc None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:21.520337 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fac07-15ba-4bbd-ae9c-43a85117bcdc None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:21.520710 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fac07-15ba-4bbd-ae9c-43a85117bcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:21.540272 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-655fac07-15ba-4bbd-ae9c-43a85117bcdc None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:21.541604 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-655fac07-15ba-4bbd-ae9c-43a85117bcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:21.611153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 482/962] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:41:21.634421 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a98f76-0020-4445-93c9-cb30072af20d None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:21.749410 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a98f76-0020-4445-93c9-cb30072af20d None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:21.781382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:21.787395 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a33227-da54-4cb8-b5d9-3be565cccde8 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:21.787691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a33227-da54-4cb8-b5d9-3be565cccde8 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:21.787969 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a33227-da54-4cb8-b5d9-3be565cccde8 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:21.789595 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 483/963] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:21.794646 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc1aa6-73cc-4917-8a83-48b32357bfb1 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:21.794944 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc1aa6-73cc-4917-8a83-48b32357bfb1 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:21.795222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc1aa6-73cc-4917-8a83-48b32357bfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:21.797697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2e301-79c1-46cf-a751-f4d65664081e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:21.802225 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2e301-79c1-46cf-a751-f4d65664081e None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:21.802225 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2e301-79c1-46cf-a751-f4d65664081e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:21.802225 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2e301-79c1-46cf-a751-f4d65664081e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:21.810832 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2e301-79c1-46cf-a751-f4d65664081e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:41:21.813774 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-c4bc1aa6-73cc-4917-8a83-48b32357bfb1 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:21.815052 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c4bc1aa6-73cc-4917-8a83-48b32357bfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:21.816681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-75b2e301-79c1-46cf-a751-f4d65664081e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:41:21.816681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:21.816681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:21.816681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:21.816681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:21.816681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:21.816681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:21.816681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:21.816681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:21.816681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:21.816681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:21.816681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:21.816681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:41:21.816681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:41:21.816681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:41:21.816681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:41:21.817586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:41:21.817586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:41:21.817586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:41:21.817586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:41:21.817586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:21.817586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:21.817586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:21.817586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:21.817586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:21.817586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:21.817586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:21.817586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:21.817586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:21.817586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:21.817586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:21.817586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:21.818460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:21.818460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:21.818460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:21.818460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:21.818460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:41:21.818460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:41:21.818460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:41:21.818460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:41:21.818460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:41:21.818460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:41:21.818460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:41:21.818460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:21.822427 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 481/964] 10.222.0.86 () {56 vars in 1120 bytes} [Tue Jul 26 14:41:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:21.829555 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2e301-79c1-46cf-a751-f4d65664081e None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:21.864035 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:21.918704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 484/965] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:41:21.933786 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc1aa6-73cc-4917-8a83-48b32357bfb1 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:21.952613 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2e301-79c1-46cf-a751-f4d65664081e None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:21.987663 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522d197-00a4-4590-90bf-c9f87c0f2a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:21.988354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522d197-00a4-4590-90bf-c9f87c0f2a2a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:21.988643 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522d197-00a4-4590-90bf-c9f87c0f2a2a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:21.988905 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522d197-00a4-4590-90bf-c9f87c0f2a2a None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:21.989833 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522d197-00a4-4590-90bf-c9f87c0f2a2a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:21.989944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522d197-00a4-4590-90bf-c9f87c0f2a2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:21.991307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522d197-00a4-4590-90bf-c9f87c0f2a2a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:22.004881 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 482/966] 10.222.0.86 () {56 vars in 1115 bytes} [Tue Jul 26 14:41:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:22.005681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522d197-00a4-4590-90bf-c9f87c0f2a2a None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:22.063195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc1aa6-73cc-4917-8a83-48b32357bfb1 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:22.067831 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:22.116086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe10f96-a260-43d8-9fc2-183f4d3c7ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:22.117866 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe10f96-a260-43d8-9fc2-183f4d3c7ded None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:22.118154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe10f96-a260-43d8-9fc2-183f4d3c7ded None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:22.118461 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe10f96-a260-43d8-9fc2-183f4d3c7ded None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:22.119098 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe10f96-a260-43d8-9fc2-183f4d3c7ded None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:22.121636 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe10f96-a260-43d8-9fc2-183f4d3c7ded None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:22.133001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-afe10f96-a260-43d8-9fc2-183f4d3c7ded None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:41:22.133001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:22.133001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:22.133001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:22.133001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:22.133001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:22.133001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:22.133001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:22.133001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:41:22.133001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:22.133001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:22.133001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:22.133001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:22.133001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:22.133001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:22.133001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:22.133001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:22.134060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:22.134060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:22.134060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:22.134060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:22.134060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:22.134060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:22.134060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:22.134060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:22.134060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:22.134060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:22.134060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:22.134060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:22.134060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:22.134060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:22.134060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:22.134060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:22.134929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:22.134929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:22.134929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:22.134929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:22.134929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:22.134929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:22.134929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:22.134929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:22.134929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:22.134929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:22.134929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:22.134929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:22.134929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:41:22.134929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:22.139529 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 485/967] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jul 26 14:41:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:22.144317 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522d197-00a4-4590-90bf-c9f87c0f2a2a None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:22.147088 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe10f96-a260-43d8-9fc2-183f4d3c7ded None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:22.189108 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e18a9-c4a0-4cf5-b1fd-a2578e831084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:22.190165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e18a9-c4a0-4cf5-b1fd-a2578e831084 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:22.190927 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e18a9-c4a0-4cf5-b1fd-a2578e831084 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:22.191895 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e18a9-c4a0-4cf5-b1fd-a2578e831084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:22.200268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:22.209334 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e18a9-c4a0-4cf5-b1fd-a2578e831084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:22.211429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e18a9-c4a0-4cf5-b1fd-a2578e831084 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:22.231147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-cb2e18a9-c4a0-4cf5-b1fd-a2578e831084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:22.231147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:22.231147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:22.231147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:22.231147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:22.231147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:22.231147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:22.231147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:22.231147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:22.231147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:22.231147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:22.231147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:22.231147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:22.231147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:22.231147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:22.232089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:22.232089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:22.232089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:22.232089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:22.232089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:22.232089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:22.232089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:22.232089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:22.232089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:22.232089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:22.232089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:22.232089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:22.232089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:22.232089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:22.232089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:22.232089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:22.232089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:22.232943 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:22.232943 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:22.232943 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:22.232943 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:22.239771 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 483/968] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:22.241154 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e18a9-c4a0-4cf5-b1fd-a2578e831084 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:22.280776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe10f96-a260-43d8-9fc2-183f4d3c7ded None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:22.317246 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57760010-274f-4032-ab1e-ee39a3538590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:22.317817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760010-274f-4032-ab1e-ee39a3538590 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:22.318105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760010-274f-4032-ab1e-ee39a3538590 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:22.318403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760010-274f-4032-ab1e-ee39a3538590 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:22.319110 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57760010-274f-4032-ab1e-ee39a3538590 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:22.319423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57760010-274f-4032-ab1e-ee39a3538590 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:22.321434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57760010-274f-4032-ab1e-ee39a3538590 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:22.332517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 486/969] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jul 26 14:41:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:22.333148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57760010-274f-4032-ab1e-ee39a3538590 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:22.367971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:22.375484 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e18a9-c4a0-4cf5-b1fd-a2578e831084 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:22.414910 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d295c79-e735-4b01-9621-c2301f15ecf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:22.415976 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d295c79-e735-4b01-9621-c2301f15ecf4 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:22.416461 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d295c79-e735-4b01-9621-c2301f15ecf4 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:22.416935 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d295c79-e735-4b01-9621-c2301f15ecf4 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:22.417974 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d295c79-e735-4b01-9621-c2301f15ecf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:22.418528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d295c79-e735-4b01-9621-c2301f15ecf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:22.420180 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d295c79-e735-4b01-9621-c2301f15ecf4 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:22.438186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 484/970] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:22.439413 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d295c79-e735-4b01-9621-c2301f15ecf4 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:22.444473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:22.448840 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57760010-274f-4032-ab1e-ee39a3538590 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:22.488726 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3509ef-eb8b-42b1-8cf5-fed634694fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:22.489252 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3509ef-eb8b-42b1-8cf5-fed634694fe0 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:22.489535 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3509ef-eb8b-42b1-8cf5-fed634694fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:22.489808 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3509ef-eb8b-42b1-8cf5-fed634694fe0 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:22.490553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3509ef-eb8b-42b1-8cf5-fed634694fe0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:22.490874 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3509ef-eb8b-42b1-8cf5-fed634694fe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:22.492819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3509ef-eb8b-42b1-8cf5-fed634694fe0 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:22.498157 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 487/971] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jul 26 14:41:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:22.505780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3509ef-eb8b-42b1-8cf5-fed634694fe0 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:22.552639 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d295c79-e735-4b01-9621-c2301f15ecf4 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:22.589223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7b6f0-2f46-412b-901a-7343d9e6b05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:22.590210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7b6f0-2f46-412b-901a-7343d9e6b05e None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:22.590724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7b6f0-2f46-412b-901a-7343d9e6b05e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:22.591204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7b6f0-2f46-412b-901a-7343d9e6b05e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:22.600280 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7b6f0-2f46-412b-901a-7343d9e6b05e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:22.602634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7b6f0-2f46-412b-901a-7343d9e6b05e None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:22.615755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-60a7b6f0-2f46-412b-901a-7343d9e6b05e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:41:22.615755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:22.615755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:22.615755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:22.615755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:22.615755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:22.615755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:22.615755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:22.615755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:22.615755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:22.615755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:22.615755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:22.615755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:41:22.615755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:41:22.615755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:41:22.615755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:41:22.618137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:22.618137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:22.618137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:41:22.618137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:22.618137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:41:22.618137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:22.618137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:22.618137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:22.618137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:22.618137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:22.618137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:22.618137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:22.618137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:22.618137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:22.618137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:22.618137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:22.618137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:22.618137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:22.620052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:22.620052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:22.620052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:41:22.620052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:41:22.620052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:41:22.620052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:41:22.620052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:41:22.620052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:41:22.620052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:41:22.620052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:22.621018 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3509ef-eb8b-42b1-8cf5-fed634694fe0 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:22.626674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 485/972] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jul 26 14:41:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:22.626674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a683408-6dd8-407e-a666-235af0ae23a8 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:22.626674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a683408-6dd8-407e-a666-235af0ae23a8 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:22.626674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a683408-6dd8-407e-a666-235af0ae23a8 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:22.627668 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 486/973] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:22.631379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a683408-6dd8-407e-a666-235af0ae23a8 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:22.650362 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:22.661016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554fb8c-c3c6-4ad3-b494-54d8b27d3025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:22.662067 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554fb8c-c3c6-4ad3-b494-54d8b27d3025 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:22.662533 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554fb8c-c3c6-4ad3-b494-54d8b27d3025 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:22.663244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554fb8c-c3c6-4ad3-b494-54d8b27d3025 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:22.664542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554fb8c-c3c6-4ad3-b494-54d8b27d3025 None admin] RBAC: Adding query filter params (interface=admin, service_id=5ebaafdd08f442c59a3f0e4192e59548, region_id=RegionOne) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:22.666354 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554fb8c-c3c6-4ad3-b494-54d8b27d3025 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:22.667043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554fb8c-c3c6-4ad3-b494-54d8b27d3025 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:22.675766 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 488/974] 10.222.0.86 () {56 vars in 1249 bytes} [Tue Jul 26 14:41:22 2022] GET /identity/v3/endpoints?service_id=5ebaafdd08f442c59a3f0e4192e59548&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:22.677072 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fba24-7eda-4d15-a6ee-b9b4fd1ab640 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:22.677356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fba24-7eda-4d15-a6ee-b9b4fd1ab640 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:22.677679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fba24-7eda-4d15-a6ee-b9b4fd1ab640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:22.696814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-e42fba24-7eda-4d15-a6ee-b9b4fd1ab640 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:22.698745 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e42fba24-7eda-4d15-a6ee-b9b4fd1ab640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:22.724178 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:22.759640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a683408-6dd8-407e-a666-235af0ae23a8 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:22.769753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 489/975] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:22.770814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fba24-7eda-4d15-a6ee-b9b4fd1ab640 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:22.809219 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751596c7-4a7c-4f6c-b3cd-0192e64e7a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:22.809844 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751596c7-4a7c-4f6c-b3cd-0192e64e7a01 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:22.810130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751596c7-4a7c-4f6c-b3cd-0192e64e7a01 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:22.810427 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751596c7-4a7c-4f6c-b3cd-0192e64e7a01 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:22.811259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751596c7-4a7c-4f6c-b3cd-0192e64e7a01 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:22.811572 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751596c7-4a7c-4f6c-b3cd-0192e64e7a01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:22.812997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751596c7-4a7c-4f6c-b3cd-0192e64e7a01 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:22.836308 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 487/976] 10.222.0.86 () {56 vars in 1149 bytes} [Tue Jul 26 14:41:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:22.836308 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751596c7-4a7c-4f6c-b3cd-0192e64e7a01 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:22.889620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fba24-7eda-4d15-a6ee-b9b4fd1ab640 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:22.912654 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:22.925265 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee497d0a-a00d-4e0f-a8c4-68629feb2ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:22.925899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee497d0a-a00d-4e0f-a8c4-68629feb2ac9 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:22.926182 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee497d0a-a00d-4e0f-a8c4-68629feb2ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:22.926485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee497d0a-a00d-4e0f-a8c4-68629feb2ac9 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:22.927192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee497d0a-a00d-4e0f-a8c4-68629feb2ac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:22.928630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee497d0a-a00d-4e0f-a8c4-68629feb2ac9 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:22.942425 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 490/977] 10.222.0.86 () {56 vars in 1087 bytes} [Tue Jul 26 14:41:22 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:41:22.942425 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee497d0a-a00d-4e0f-a8c4-68629feb2ac9 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:22.947900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751596c7-4a7c-4f6c-b3cd-0192e64e7a01 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:22.973714 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:23.003157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46ddfd-c7d7-4e37-98da-b6d8b1f1dd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:23.003846 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46ddfd-c7d7-4e37-98da-b6d8b1f1dd71 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:23.004078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46ddfd-c7d7-4e37-98da-b6d8b1f1dd71 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:23.004352 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46ddfd-c7d7-4e37-98da-b6d8b1f1dd71 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:23.005058 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46ddfd-c7d7-4e37-98da-b6d8b1f1dd71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:23.006592 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46ddfd-c7d7-4e37-98da-b6d8b1f1dd71 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:23.061309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.sql.core [None req-7d46ddfd-c7d7-4e37-98da-b6d8b1f1dd71 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 14:41:23.061309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 14:41:23.061309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [parameters: {'user_id': '94597578f77448b3a414984026cf1960', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 14:41:23.061309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92030) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 14:41:23.071788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-7d46ddfd-c7d7-4e37-98da-b6d8b1f1dd71 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 14:41:23.071788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:23.071788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:41:23.071788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 14:41:23.071788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:41:23.071788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 14:41:23.071788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:41:23.071788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 14:41:23.071788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:41:23.071788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application conn.query(q) Jul 26 14:41:23.071788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:41:23.071788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:41:23.071788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:41:23.071788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application result.read() Jul 26 14:41:23.071788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:41:23.072751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 14:41:23.072751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:41:23.072751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 14:41:23.072751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:41:23.072751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 14:41:23.072751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:41:23.072751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 14:41:23.072751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 14:41:23.072751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:23.072751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 14:41:23.072751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:23.072751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:23.072751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 14:41:23.072751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 14:41:23.072751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 26 14:41:23.072751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 26 14:41:23.072751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 14:41:23.072751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application next(self.gen) Jul 26 14:41:23.073660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 14:41:23.073660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application yield resource Jul 26 14:41:23.073660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 14:41:23.073660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application next(self.gen) Jul 26 14:41:23.073660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 14:41:23.073660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 14:41:23.073660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:41:23.073660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 14:41:23.073660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:41:23.073660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise self.value Jul 26 14:41:23.073660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 14:41:23.073660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 14:41:23.073660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 14:41:23.073660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application session.commit() Jul 26 14:41:23.073660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 14:41:23.073660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 14:41:23.073660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 14:41:23.074585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 14:41:23.074585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 14:41:23.074585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self.session.flush() Jul 26 14:41:23.074585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 14:41:23.074585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 14:41:23.074585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 14:41:23.074585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 14:41:23.074585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 14:41:23.074585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application compat.raise_( Jul 26 14:41:23.074585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:41:23.074585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception Jul 26 14:41:23.074585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 14:41:23.074585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 14:41:23.074585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 14:41:23.074585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 14:41:23.074585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 14:41:23.074585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 14:41:23.076969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 14:41:23.076969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 14:41:23.076969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 14:41:23.076969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 26 14:41:23.076969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 14:41:23.076969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 14:41:23.076969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 14:41:23.076969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 14:41:23.076969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 14:41:23.076969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 14:41:23.076969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 14:41:23.076969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 14:41:23.076969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 14:41:23.076969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 14:41:23.076969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:41:23.076969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception Jul 26 14:41:23.079422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:41:23.079422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 14:41:23.079422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:41:23.079422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 14:41:23.079422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:41:23.079422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 14:41:23.079422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:41:23.079422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application conn.query(q) Jul 26 14:41:23.079422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:41:23.079422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:41:23.079422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:41:23.079422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application result.read() Jul 26 14:41:23.079422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:41:23.079422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 14:41:23.079422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:41:23.079422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 14:41:23.082751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:41:23.082751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 14:41:23.082751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:41:23.082751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 14:41:23.082751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 14:41:23.082751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 14:41:23.082751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [parameters: {'user_id': '94597578f77448b3a414984026cf1960', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 14:41:23.082751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 14:41:23.082751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:23.082751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:23.082751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:23.082751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:23.082751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:23.082751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:23.082751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:23.084706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:23.084706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:23.084706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:23.084706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:23.084706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:23.084706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:23.084706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:23.084706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 26 14:41:23.084706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 26 14:41:23.084706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:23.084706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:23.084706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:41:23.084706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:23.084706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:41:23.084706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:23.084706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 26 14:41:23.084706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 26 14:41:23.087498 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 26 14:41:23.087498 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 26 14:41:23.087498 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 14:41:23.087498 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 14:41:23.087498 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 14:41:23.087498 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:23.087498 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 488/978] 10.222.0.86 () {60 vars in 1131 bytes} [Tue Jul 26 14:41:22 2022] POST /identity/v3/users => generated 160 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:23.088402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee497d0a-a00d-4e0f-a8c4-68629feb2ac9 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:23.088568 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46ddfd-c7d7-4e37-98da-b6d8b1f1dd71 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:23.126035 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882cf64-4153-4308-b7c9-d5d49b91195f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:23.126035 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882cf64-4153-4308-b7c9-d5d49b91195f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:23.126035 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882cf64-4153-4308-b7c9-d5d49b91195f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:23.127797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882cf64-4153-4308-b7c9-d5d49b91195f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:23.212304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882cf64-4153-4308-b7c9-d5d49b91195f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:23.213688 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882cf64-4153-4308-b7c9-d5d49b91195f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:23.220506 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46ddfd-c7d7-4e37-98da-b6d8b1f1dd71 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:23.250754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:23.264424 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d20572-3039-4d8e-b993-ecfd227e1356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:23.265075 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d20572-3039-4d8e-b993-ecfd227e1356 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:23.265350 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d20572-3039-4d8e-b993-ecfd227e1356 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:23.265622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d20572-3039-4d8e-b993-ecfd227e1356 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:23.269690 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:23.276157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d20572-3039-4d8e-b993-ecfd227e1356 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:23.278365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d20572-3039-4d8e-b993-ecfd227e1356 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:23.292072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-30d20572-3039-4d8e-b993-ecfd227e1356 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:41:23.292072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:23.292072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:23.292072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:23.292072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:23.292072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:23.292072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:23.292072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:23.292072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:23.292072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:23.292072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:23.292072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:23.292072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:41:23.292072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:41:23.292072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:41:23.292072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:41:23.293103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:23.293103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:23.293103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:41:23.293103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:23.293103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:41:23.293103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:23.293103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:23.293103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:23.293103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:23.293103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:23.293103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:23.293103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:23.293103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:23.293103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:23.293103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:23.293103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:23.293103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:23.293103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:23.294063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:23.294063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:23.294063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:41:23.294063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:41:23.294063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:41:23.294063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:41:23.294063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:41:23.294063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:41:23.294063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:41:23.294063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:23.294063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 489/979] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:41:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:23.300711 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d20572-3039-4d8e-b993-ecfd227e1356 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:23.344976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 491/980] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:41:22 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:41:23.346375 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eeb141-9e0f-4891-81cb-40515aa61804 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:23.346696 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eeb141-9e0f-4891-81cb-40515aa61804 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:23.346975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eeb141-9e0f-4891-81cb-40515aa61804 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:23.349030 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 492/981] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:23.350895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eeb141-9e0f-4891-81cb-40515aa61804 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:23.414008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d20572-3039-4d8e-b993-ecfd227e1356 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:23.449587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12764f-6f13-4ada-80d5-a89f0910f2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:23.450239 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12764f-6f13-4ada-80d5-a89f0910f2d7 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:23.450557 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12764f-6f13-4ada-80d5-a89f0910f2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:23.450833 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12764f-6f13-4ada-80d5-a89f0910f2d7 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:23.451600 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12764f-6f13-4ada-80d5-a89f0910f2d7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:23.451904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12764f-6f13-4ada-80d5-a89f0910f2d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:23.453320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12764f-6f13-4ada-80d5-a89f0910f2d7 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:23.466593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eeb141-9e0f-4891-81cb-40515aa61804 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:23.492435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:23.492730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 490/982] 10.222.0.86 () {56 vars in 1101 bytes} [Tue Jul 26 14:41:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:23.494076 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa9786-e5ef-42af-87cf-9ce79829fe71 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:23.494371 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa9786-e5ef-42af-87cf-9ce79829fe71 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:23.494670 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa9786-e5ef-42af-87cf-9ce79829fe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:23.516856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7935f93-7109-4900-a44d-21275a54b094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:23.517586 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7935f93-7109-4900-a44d-21275a54b094 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:23.517873 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7935f93-7109-4900-a44d-21275a54b094 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:23.518151 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7935f93-7109-4900-a44d-21275a54b094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:23.521109 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-56fa9786-e5ef-42af-87cf-9ce79829fe71 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:23.524585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-56fa9786-e5ef-42af-87cf-9ce79829fe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:23.532747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7935f93-7109-4900-a44d-21275a54b094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:23.534231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7935f93-7109-4900-a44d-21275a54b094 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:23.551913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-c7935f93-7109-4900-a44d-21275a54b094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:23.551913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:23.551913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:23.551913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:23.551913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:23.551913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:23.551913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:23.551913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:23.551913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:23.551913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:23.551913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:23.551913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:23.551913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:23.551913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:23.551913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:23.552920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:23.552920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:23.552920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:23.552920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:23.552920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:23.552920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:23.552920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:23.552920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:23.552920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:23.552920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:23.552920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:23.552920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:23.552920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:23.552920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:23.552920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:23.552920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:23.552920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:23.559326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:23.559326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:23.559326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:23.559326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:23.559326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 493/983] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:23.559326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7935f93-7109-4900-a44d-21275a54b094 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:23.599210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:23.626554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 491/984] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:23.650009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa9786-e5ef-42af-87cf-9ce79829fe71 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:23.708065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7935f93-7109-4900-a44d-21275a54b094 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:23.751747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b3c64-3182-474d-bb60-cd27ecd1e58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:23.752400 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b3c64-3182-474d-bb60-cd27ecd1e58e None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:23.752687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b3c64-3182-474d-bb60-cd27ecd1e58e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:23.752970 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b3c64-3182-474d-bb60-cd27ecd1e58e None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:23.753681 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b3c64-3182-474d-bb60-cd27ecd1e58e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:23.754021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b3c64-3182-474d-bb60-cd27ecd1e58e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:23.755498 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b3c64-3182-474d-bb60-cd27ecd1e58e None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:23.771467 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 494/985] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:23.777207 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b3c64-3182-474d-bb60-cd27ecd1e58e None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:23.783766 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa9786-e5ef-42af-87cf-9ce79829fe71 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:23.815501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:23.822150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560ec1c-1917-4859-ab6e-85dfb9037425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:23.822831 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560ec1c-1917-4859-ab6e-85dfb9037425 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:23.823116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560ec1c-1917-4859-ab6e-85dfb9037425 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:23.823389 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560ec1c-1917-4859-ab6e-85dfb9037425 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:23.824099 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560ec1c-1917-4859-ab6e-85dfb9037425 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:23.825518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560ec1c-1917-4859-ab6e-85dfb9037425 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:23.885226 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b3c64-3182-474d-bb60-cd27ecd1e58e None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:23.913588 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 492/986] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jul 26 14:41:23 2022] POST /identity/v3/services => generated 242 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:41:23.937797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9b09d-2e40-4add-a826-88e7b9f11a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:23.938632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9b09d-2e40-4add-a826-88e7b9f11a74 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:23.938915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9b09d-2e40-4add-a826-88e7b9f11a74 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:23.939228 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9b09d-2e40-4add-a826-88e7b9f11a74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:23.948383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9b09d-2e40-4add-a826-88e7b9f11a74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:23.949877 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9b09d-2e40-4add-a826-88e7b9f11a74 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:23.962769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-62b9b09d-2e40-4add-a826-88e7b9f11a74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:23.962769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:23.962769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:23.962769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:23.962769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:23.962769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:23.962769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:23.962769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:23.962769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:23.962769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:23.962769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:23.962769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:23.962769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:41:23.962769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:41:23.962769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:41:23.963887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:41:23.963887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:23.963887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:23.963887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:23.963887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:23.963887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:23.963887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:23.963887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:23.963887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:23.963887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:23.963887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:23.963887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:23.963887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:23.963887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:23.963887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:23.963887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:23.963887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:23.964759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:41:23.964759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:41:23.964759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:41:23.964759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:41:23.964759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:41:23.964759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:41:23.964759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:23.964759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:23.964759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 495/987] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:41:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:23.969952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560ec1c-1917-4859-ab6e-85dfb9037425 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:24.021936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:24.085538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560ec1c-1917-4859-ab6e-85dfb9037425 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:24.121761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa02597-e2c4-4b40-a387-5569acb93d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:24.122430 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa02597-e2c4-4b40-a387-5569acb93d87 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:24.122704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa02597-e2c4-4b40-a387-5569acb93d87 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:24.122985 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa02597-e2c4-4b40-a387-5569acb93d87 None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:24.123742 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa02597-e2c4-4b40-a387-5569acb93d87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:24.124053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa02597-e2c4-4b40-a387-5569acb93d87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:24.125740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa02597-e2c4-4b40-a387-5569acb93d87 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:24.138626 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 493/988] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:41:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:24.144407 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9b09d-2e40-4add-a826-88e7b9f11a74 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:24.243365 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:24.253169 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9b09d-2e40-4add-a826-88e7b9f11a74 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:24.287635 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ef648-1397-417e-8f6e-0231b391c665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:24.288786 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ef648-1397-417e-8f6e-0231b391c665 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:24.289142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ef648-1397-417e-8f6e-0231b391c665 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:24.289521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ef648-1397-417e-8f6e-0231b391c665 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:24.290344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ef648-1397-417e-8f6e-0231b391c665 None admin] RBAC: Adding query filter params (role.id=392e2ed96a59406fb49190dce5ee2a85, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=0834be7405cd4c968763099251d37154) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:24.290749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ef648-1397-417e-8f6e-0231b391c665 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:24.292237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ef648-1397-417e-8f6e-0231b391c665 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:24.298382 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 496/989] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:41:24 2022] GET /identity/v3/role_assignments?user.id=0834be7405cd4c968763099251d37154&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=392e2ed96a59406fb49190dce5ee2a85 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:25.105674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9f6b9-7bf3-4ccd-aaa5-973cee82219c None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:25.106201 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9f6b9-7bf3-4ccd-aaa5-973cee82219c None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:25.106279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9f6b9-7bf3-4ccd-aaa5-973cee82219c None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:25.107818 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 494/990] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:25.112800 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187125e-ed7e-4f67-9bde-55124bfc8842 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:25.113096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187125e-ed7e-4f67-9bde-55124bfc8842 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:25.113380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187125e-ed7e-4f67-9bde-55124bfc8842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:25.131545 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-f187125e-ed7e-4f67-9bde-55124bfc8842 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:25.132763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-f187125e-ed7e-4f67-9bde-55124bfc8842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:25.200839 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 497/991] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:25.223702 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9f6b9-7bf3-4ccd-aaa5-973cee82219c None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:25.326741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9f6b9-7bf3-4ccd-aaa5-973cee82219c None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:25.329077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:25.362276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6272254-cc74-4342-aeea-7f687f876980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:25.362980 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6272254-cc74-4342-aeea-7f687f876980 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:25.363256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6272254-cc74-4342-aeea-7f687f876980 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:25.363538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6272254-cc74-4342-aeea-7f687f876980 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:25.364172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6272254-cc74-4342-aeea-7f687f876980 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:25.365547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6272254-cc74-4342-aeea-7f687f876980 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:25.375003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-b6272254-cc74-4342-aeea-7f687f876980 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:41:25.375003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:25.375003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:25.375003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:25.375003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:25.375003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:25.375003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:25.375003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:25.375003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:41:25.375003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:25.375003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:25.375003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:25.375003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:25.375003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:25.375003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:25.375003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:25.375003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:25.375952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:25.375952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:25.375952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:25.375952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:25.375952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:25.375952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:25.375952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:25.375952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:25.375952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:25.375952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:25.375952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:25.375952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:25.375952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:25.375952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:25.375952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:25.375952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:25.376773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:25.376773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:25.376773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:25.376773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:25.376773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:25.376773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:25.376773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:25.376773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:25.376773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:25.376773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:25.376773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:25.376773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:25.376773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:41:25.376773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:25.378756 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 495/992] 10.222.0.86 () {56 vars in 1126 bytes} [Tue Jul 26 14:41:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:25.382288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187125e-ed7e-4f67-9bde-55124bfc8842 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:25.471850 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:25.487889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187125e-ed7e-4f67-9bde-55124bfc8842 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:25.523597 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f3be8-7f52-41f8-9e22-556a1ff75247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:25.524225 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f3be8-7f52-41f8-9e22-556a1ff75247 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:25.524507 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f3be8-7f52-41f8-9e22-556a1ff75247 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:25.524783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f3be8-7f52-41f8-9e22-556a1ff75247 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:25.525454 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f3be8-7f52-41f8-9e22-556a1ff75247 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:25.525763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f3be8-7f52-41f8-9e22-556a1ff75247 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:25.527149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f3be8-7f52-41f8-9e22-556a1ff75247 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:25.535591 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 498/993] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jul 26 14:41:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:25.538143 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6272254-cc74-4342-aeea-7f687f876980 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:25.638898 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6272254-cc74-4342-aeea-7f687f876980 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:25.677077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9a5aa-74ad-4e5c-9cb0-7ee1f65f01b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:25.680483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9a5aa-74ad-4e5c-9cb0-7ee1f65f01b7 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:25.680483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9a5aa-74ad-4e5c-9cb0-7ee1f65f01b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:25.680483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9a5aa-74ad-4e5c-9cb0-7ee1f65f01b7 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:25.680483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9a5aa-74ad-4e5c-9cb0-7ee1f65f01b7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:25.680483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9a5aa-74ad-4e5c-9cb0-7ee1f65f01b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:25.680857 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9a5aa-74ad-4e5c-9cb0-7ee1f65f01b7 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:25.691776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 496/994] 10.222.0.86 () {56 vars in 1122 bytes} [Tue Jul 26 14:41:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:25.693090 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f3be8-7f52-41f8-9e22-556a1ff75247 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:25.802463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f3be8-7f52-41f8-9e22-556a1ff75247 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:25.837966 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11311cc-fb02-4e1e-9626-56d1ef966903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:25.838623 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11311cc-fb02-4e1e-9626-56d1ef966903 None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:25.838916 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11311cc-fb02-4e1e-9626-56d1ef966903 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:25.839195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11311cc-fb02-4e1e-9626-56d1ef966903 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:25.839911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11311cc-fb02-4e1e-9626-56d1ef966903 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:25.841284 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11311cc-fb02-4e1e-9626-56d1ef966903 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:25.943234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 499/995] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:41:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:41:25.953870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6b19-d3d0-4a92-92fe-bb98b28c49f3 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:25.954169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6b19-d3d0-4a92-92fe-bb98b28c49f3 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:25.954635 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6b19-d3d0-4a92-92fe-bb98b28c49f3 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:25.956439 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 497/996] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:41:25.962382 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364b5be-7541-4da8-bb4d-2268e254e19b None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:25.967116 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364b5be-7541-4da8-bb4d-2268e254e19b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:25.967116 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364b5be-7541-4da8-bb4d-2268e254e19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:25.982428 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-d364b5be-7541-4da8-bb4d-2268e254e19b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:25.983653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d364b5be-7541-4da8-bb4d-2268e254e19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:25.985955 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:26.066805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 500/997] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:26.089643 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e6b19-d3d0-4a92-92fe-bb98b28c49f3 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:26.125369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:26.202883 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e6b19-d3d0-4a92-92fe-bb98b28c49f3 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:26.246296 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a40f53-2660-472d-a86b-347108cbc9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:26.246975 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a40f53-2660-472d-a86b-347108cbc9e6 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:26.247265 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a40f53-2660-472d-a86b-347108cbc9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:26.247544 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a40f53-2660-472d-a86b-347108cbc9e6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:26.248180 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a40f53-2660-472d-a86b-347108cbc9e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:26.249840 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a40f53-2660-472d-a86b-347108cbc9e6 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:26.259042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-08a40f53-2660-472d-a86b-347108cbc9e6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:41:26.259042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:26.259042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:26.259042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:26.259042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:26.259042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:26.259042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:26.259042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:26.259042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:41:26.259042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:26.259042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:26.259042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:26.259042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:26.259042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:26.259042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:26.259042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:26.259042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:26.260107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:26.260107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:26.260107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:26.260107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:26.260107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:26.260107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:26.260107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:26.260107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:26.260107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:26.260107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:26.260107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:26.260107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:26.260107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:26.260107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:26.260107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:26.260107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:26.261583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:26.261583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:26.261583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:26.261583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:26.261583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:26.261583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:26.261583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:26.261583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:26.261583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:26.261583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:26.261583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:26.261583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:26.261583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:41:26.261583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:26.261583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 498/998] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:41:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:26.266078 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364b5be-7541-4da8-bb4d-2268e254e19b None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:26.367500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364b5be-7541-4da8-bb4d-2268e254e19b None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:26.371082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec7596-bf20-432c-a7b3-1e29a221026d None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:26.371370 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec7596-bf20-432c-a7b3-1e29a221026d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:26.371650 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec7596-bf20-432c-a7b3-1e29a221026d None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:26.373318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 499/999] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:26.378281 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b476361-0471-48e5-9394-1e9c5c36d612 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:26.378615 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b476361-0471-48e5-9394-1e9c5c36d612 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:26.378900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b476361-0471-48e5-9394-1e9c5c36d612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:26.396736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-2b476361-0471-48e5-9394-1e9c5c36d612 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:26.397935 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2b476361-0471-48e5-9394-1e9c5c36d612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:26.403509 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f333346-e452-473c-b36b-5fbac830e720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:26.404154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f333346-e452-473c-b36b-5fbac830e720 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:26.404439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f333346-e452-473c-b36b-5fbac830e720 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:26.404718 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f333346-e452-473c-b36b-5fbac830e720 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:26.405400 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f333346-e452-473c-b36b-5fbac830e720 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:26.405733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f333346-e452-473c-b36b-5fbac830e720 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:26.407106 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f333346-e452-473c-b36b-5fbac830e720 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:26.408221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:26.414052 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 501/1000] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jul 26 14:41:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:26.419670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f333346-e452-473c-b36b-5fbac830e720 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:26.473361 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 500/1001] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:26 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:41:26.495312 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b476361-0471-48e5-9394-1e9c5c36d612 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:26.528136 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:26.530565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f333346-e452-473c-b36b-5fbac830e720 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:26.567957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dd4b7-d164-41d0-86dd-e62d98e14a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:26.568574 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dd4b7-d164-41d0-86dd-e62d98e14a00 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:26.568884 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dd4b7-d164-41d0-86dd-e62d98e14a00 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:26.569134 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dd4b7-d164-41d0-86dd-e62d98e14a00 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:26.569843 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dd4b7-d164-41d0-86dd-e62d98e14a00 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:26.570150 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dd4b7-d164-41d0-86dd-e62d98e14a00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:26.571549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dd4b7-d164-41d0-86dd-e62d98e14a00 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:26.581101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 502/1002] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jul 26 14:41:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:26.582420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dd4b7-d164-41d0-86dd-e62d98e14a00 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:26.619793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b476361-0471-48e5-9394-1e9c5c36d612 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:26.656803 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:26.664919 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82388c2d-636f-458e-9a4f-072815eefe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:26.666454 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82388c2d-636f-458e-9a4f-072815eefe8b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:26.673768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82388c2d-636f-458e-9a4f-072815eefe8b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:26.673768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82388c2d-636f-458e-9a4f-072815eefe8b None admin] PATH_INFO: `/v3/services/image` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:26.673768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82388c2d-636f-458e-9a4f-072815eefe8b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:26.673768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82388c2d-636f-458e-9a4f-072815eefe8b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:26.683996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-82388c2d-636f-458e-9a4f-072815eefe8b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:41:26.683996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:26.683996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:26.683996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:26.683996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:26.683996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:26.683996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:26.683996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:26.683996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:41:26.683996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:26.683996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:26.683996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:26.683996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:26.683996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:26.683996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:26.683996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:26.683996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:26.685079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:26.685079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:26.685079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:26.685079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:26.685079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:26.685079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:26.685079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:26.685079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:26.685079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:26.685079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:26.685079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:26.685079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:26.685079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:26.685079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:26.685079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:26.685079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:26.686168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:26.686168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:26.686168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:26.686168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:26.686168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:26.686168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:26.686168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:26.686168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:26.686168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:26.686168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:26.686168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:26.686168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:26.686168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:41:26.686168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:26.686168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 501/1003] 10.222.0.86 () {56 vars in 1105 bytes} [Tue Jul 26 14:41:26 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:26.691731 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82388c2d-636f-458e-9a4f-072815eefe8b None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:26.706953 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dd4b7-d164-41d0-86dd-e62d98e14a00 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:26.745364 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b2586-3c07-40fa-a0ac-e8bd7b8a7f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:26.745941 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b2586-3c07-40fa-a0ac-e8bd7b8a7f40 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:26.746512 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b2586-3c07-40fa-a0ac-e8bd7b8a7f40 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:26.746793 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b2586-3c07-40fa-a0ac-e8bd7b8a7f40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:26.747552 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b2586-3c07-40fa-a0ac-e8bd7b8a7f40 None admin] RBAC: Adding query filter params (interface=public, service_id=b79c9bb985da493f8c885a2676ac4f69, region_id=RegionOne) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:26.747866 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b2586-3c07-40fa-a0ac-e8bd7b8a7f40 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:26.749676 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b2586-3c07-40fa-a0ac-e8bd7b8a7f40 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:26.755909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 503/1004] 10.222.0.86 () {56 vars in 1251 bytes} [Tue Jul 26 14:41:26 2022] GET /identity/v3/endpoints?service_id=b79c9bb985da493f8c885a2676ac4f69&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:26.761301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b2586-3c07-40fa-a0ac-e8bd7b8a7f40 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:26.798654 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:26.811936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82388c2d-636f-458e-9a4f-072815eefe8b None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:26.849435 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c2380-8666-4d05-86e9-72d1c3e55ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:26.850053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c2380-8666-4d05-86e9-72d1c3e55ceb None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:26.850331 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c2380-8666-4d05-86e9-72d1c3e55ceb None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:26.850632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c2380-8666-4d05-86e9-72d1c3e55ceb None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:26.852090 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c2380-8666-4d05-86e9-72d1c3e55ceb None admin] RBAC: Adding query filter params (name=image) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:26.852436 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c2380-8666-4d05-86e9-72d1c3e55ceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:26.853792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c2380-8666-4d05-86e9-72d1c3e55ceb None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:26.858711 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 502/1005] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:26.864267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c2380-8666-4d05-86e9-72d1c3e55ceb None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:26.889457 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b2586-3c07-40fa-a0ac-e8bd7b8a7f40 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:26.918689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:26.930733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34e11e-1d16-47e1-9be0-e255067185b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:26.931391 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34e11e-1d16-47e1-9be0-e255067185b2 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:26.931676 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34e11e-1d16-47e1-9be0-e255067185b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:26.931952 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34e11e-1d16-47e1-9be0-e255067185b2 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:26.932618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34e11e-1d16-47e1-9be0-e255067185b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:26.933999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34e11e-1d16-47e1-9be0-e255067185b2 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:26.940482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 504/1006] 10.222.0.86 () {56 vars in 1087 bytes} [Tue Jul 26 14:41:26 2022] GET /identity/v3/services => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 14:41:26.984889 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c2380-8666-4d05-86e9-72d1c3e55ceb None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:27.026413 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252cc7c-e0b4-4060-806a-fa482d7d2a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:27.027054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252cc7c-e0b4-4060-806a-fa482d7d2a7d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:27.027341 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252cc7c-e0b4-4060-806a-fa482d7d2a7d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:27.027620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252cc7c-e0b4-4060-806a-fa482d7d2a7d None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:27.028334 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252cc7c-e0b4-4060-806a-fa482d7d2a7d None admin] RBAC: Adding query filter params (type=image) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:27.028642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252cc7c-e0b4-4060-806a-fa482d7d2a7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:27.030038 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252cc7c-e0b4-4060-806a-fa482d7d2a7d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:27.036142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 503/1007] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:26 2022] GET /identity/v3/services?type=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:28.033751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947492ec-923a-41ec-9014-3019b213aaca None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:28.034282 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947492ec-923a-41ec-9014-3019b213aaca None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:28.034360 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947492ec-923a-41ec-9014-3019b213aaca None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:28.038456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 505/1008] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:28.041006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1359207-b0dc-4ab8-a329-430c04d5042b None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:28.041451 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1359207-b0dc-4ab8-a329-430c04d5042b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:28.041620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1359207-b0dc-4ab8-a329-430c04d5042b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:28.061344 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-a1359207-b0dc-4ab8-a329-430c04d5042b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:28.062587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-a1359207-b0dc-4ab8-a329-430c04d5042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:28.077308 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:28.135229 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 504/1009] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:28 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:28.157300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947492ec-923a-41ec-9014-3019b213aaca None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:28.265120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947492ec-923a-41ec-9014-3019b213aaca None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:28.298864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcedab-51b8-4cf9-a26e-e3503d3d22f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:28.299439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcedab-51b8-4cf9-a26e-e3503d3d22f0 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:28.299728 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcedab-51b8-4cf9-a26e-e3503d3d22f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:28.300013 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcedab-51b8-4cf9-a26e-e3503d3d22f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:28.301169 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcedab-51b8-4cf9-a26e-e3503d3d22f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:28.302653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcedab-51b8-4cf9-a26e-e3503d3d22f0 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:28.304993 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 506/1010] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:28.310655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1359207-b0dc-4ab8-a329-430c04d5042b None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:28.411036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1359207-b0dc-4ab8-a329-430c04d5042b None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:28.445581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a1605-7395-4664-95fe-856857fb80f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:28.446202 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a1605-7395-4664-95fe-856857fb80f9 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:28.446521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a1605-7395-4664-95fe-856857fb80f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:28.446798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a1605-7395-4664-95fe-856857fb80f9 None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:28.447489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a1605-7395-4664-95fe-856857fb80f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:28.448931 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a1605-7395-4664-95fe-856857fb80f9 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:28.537058 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:28.549614 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 505/1011] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jul 26 14:41:28 2022] POST /identity/v3/projects => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:41:29.009498 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc97afc-e623-4641-abbb-3d189c3b4316 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:29.009865 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc97afc-e623-4641-abbb-3d189c3b4316 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:29.010048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc97afc-e623-4641-abbb-3d189c3b4316 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:29.011447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 507/1012] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:29.016679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747851-fc6e-4483-be3b-df239083cc7d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:29.016977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747851-fc6e-4483-be3b-df239083cc7d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:29.017260 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747851-fc6e-4483-be3b-df239083cc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:29.036733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-ad747851-fc6e-4483-be3b-df239083cc7d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:29.037934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ad747851-fc6e-4483-be3b-df239083cc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:29.079124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc875f-1129-428e-ad1c-03df15bcae4f None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:29.079674 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc875f-1129-428e-ad1c-03df15bcae4f None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:29.079674 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc875f-1129-428e-ad1c-03df15bcae4f None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:29.081332 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 508/1013] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:41:29.086814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee626759-282a-4d71-9693-c38a51ff68b2 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:29.087110 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee626759-282a-4d71-9693-c38a51ff68b2 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:29.087393 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee626759-282a-4d71-9693-c38a51ff68b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:29.106081 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-ee626759-282a-4d71-9693-c38a51ff68b2 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:29.107319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ee626759-282a-4d71-9693-c38a51ff68b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:29.110751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 506/1014] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:29 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:29.132973 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad747851-fc6e-4483-be3b-df239083cc7d None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:29.166449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:29.182516 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 509/1015] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:29 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:41:29.202525 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee626759-282a-4d71-9693-c38a51ff68b2 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:29.236679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad747851-fc6e-4483-be3b-df239083cc7d None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:29.267307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:29.274087 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbc3e5-2779-48a1-8e52-2d8bfe7bfea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:29.274770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbc3e5-2779-48a1-8e52-2d8bfe7bfea4 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:29.275056 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbc3e5-2779-48a1-8e52-2d8bfe7bfea4 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:29.275330 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbc3e5-2779-48a1-8e52-2d8bfe7bfea4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:29.276087 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbc3e5-2779-48a1-8e52-2d8bfe7bfea4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:29.277590 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbc3e5-2779-48a1-8e52-2d8bfe7bfea4 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:29.286915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-14fbc3e5-2779-48a1-8e52-2d8bfe7bfea4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:41:29.286915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:29.286915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:29.286915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:29.286915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:29.286915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:29.286915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:29.286915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:29.286915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:41:29.286915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:29.286915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:29.286915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:29.286915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:29.286915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:29.286915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:29.286915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:29.286915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:29.287944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:29.287944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:29.287944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:29.287944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:29.287944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:29.287944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:29.287944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:29.287944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:29.287944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:29.287944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:29.287944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:29.287944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:29.287944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:29.287944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:29.287944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:29.287944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:29.288843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:29.288843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:29.288843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:29.288843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:29.288843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:29.288843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:29.288843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:29.288843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:29.288843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:29.288843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:29.288843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:29.288843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:29.288843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:41:29.288843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:29.288843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 507/1016] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:41:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:29.294134 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbc3e5-2779-48a1-8e52-2d8bfe7bfea4 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:29.314047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee626759-282a-4d71-9693-c38a51ff68b2 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:29.353806 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b7843-7320-43bb-99c6-1ef06ba70d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:29.354470 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b7843-7320-43bb-99c6-1ef06ba70d02 None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:29.354760 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b7843-7320-43bb-99c6-1ef06ba70d02 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:29.355041 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b7843-7320-43bb-99c6-1ef06ba70d02 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:29.355737 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b7843-7320-43bb-99c6-1ef06ba70d02 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:29.357207 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b7843-7320-43bb-99c6-1ef06ba70d02 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:29.397931 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbc3e5-2779-48a1-8e52-2d8bfe7bfea4 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:29.431382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2edcc-bf0e-48d4-af40-4b66d0bbccb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:29.431996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2edcc-bf0e-48d4-af40-4b66d0bbccb9 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:29.432278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2edcc-bf0e-48d4-af40-4b66d0bbccb9 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:29.432548 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2edcc-bf0e-48d4-af40-4b66d0bbccb9 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:29.433214 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2edcc-bf0e-48d4-af40-4b66d0bbccb9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:29.433517 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2edcc-bf0e-48d4-af40-4b66d0bbccb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:29.434944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2edcc-bf0e-48d4-af40-4b66d0bbccb9 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:29.444246 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 508/1017] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jul 26 14:41:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:29.445254 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2edcc-bf0e-48d4-af40-4b66d0bbccb9 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:29.479440 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 510/1018] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jul 26 14:41:29 2022] POST /identity/v3/services => generated 242 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:41:29.513430 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:29.561240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2edcc-bf0e-48d4-af40-4b66d0bbccb9 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:29.604588 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4298cd-3476-4411-ab64-c2fa207121d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:29.605228 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4298cd-3476-4411-ab64-c2fa207121d3 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:29.605509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4298cd-3476-4411-ab64-c2fa207121d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:29.605784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4298cd-3476-4411-ab64-c2fa207121d3 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:29.606507 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4298cd-3476-4411-ab64-c2fa207121d3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:29.606822 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4298cd-3476-4411-ab64-c2fa207121d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:29.608199 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4298cd-3476-4411-ab64-c2fa207121d3 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:29.613937 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 509/1019] 10.222.0.86 () {56 vars in 1112 bytes} [Tue Jul 26 14:41:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:29.619722 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b7843-7320-43bb-99c6-1ef06ba70d02 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:29.686545 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:29.739814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b7843-7320-43bb-99c6-1ef06ba70d02 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:29.791243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be923c0-3cb8-4b38-a809-ed320a28b0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:29.791876 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be923c0-3cb8-4b38-a809-ed320a28b0e2 None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:29.792164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be923c0-3cb8-4b38-a809-ed320a28b0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:29.792444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be923c0-3cb8-4b38-a809-ed320a28b0e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:29.793175 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be923c0-3cb8-4b38-a809-ed320a28b0e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:29.794587 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be923c0-3cb8-4b38-a809-ed320a28b0e2 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:29.879886 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 511/1020] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:41:29 2022] POST /identity/v3/endpoints => generated 334 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:41:30.643420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48970326-2615-4b53-aa7d-448874b01879 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:30.644132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48970326-2615-4b53-aa7d-448874b01879 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:30.644132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48970326-2615-4b53-aa7d-448874b01879 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:30.645660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 510/1021] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:30.651288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880a425-2ba0-4dbb-acc4-76d842a4f825 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:30.651707 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880a425-2ba0-4dbb-acc4-76d842a4f825 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:30.651862 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880a425-2ba0-4dbb-acc4-76d842a4f825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:30.674341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-a880a425-2ba0-4dbb-acc4-76d842a4f825 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:30.675563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a880a425-2ba0-4dbb-acc4-76d842a4f825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:30.753767 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 512/1022] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:41:30.787273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48970326-2615-4b53-aa7d-448874b01879 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:30.907433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48970326-2615-4b53-aa7d-448874b01879 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:30.925010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:30.942240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6563d30-ecc7-44fc-9b3b-982fd8ef7254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:30.942905 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6563d30-ecc7-44fc-9b3b-982fd8ef7254 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:30.943185 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6563d30-ecc7-44fc-9b3b-982fd8ef7254 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:30.943461 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6563d30-ecc7-44fc-9b3b-982fd8ef7254 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:30.944624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6563d30-ecc7-44fc-9b3b-982fd8ef7254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:30.946041 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6563d30-ecc7-44fc-9b3b-982fd8ef7254 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:30.952540 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 511/1023] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:30.953508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880a425-2ba0-4dbb-acc4-76d842a4f825 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:30.986849 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:31.059927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880a425-2ba0-4dbb-acc4-76d842a4f825 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:31.097195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e84a1-304f-4fcf-a451-078cb6ae09d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:31.097823 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e84a1-304f-4fcf-a451-078cb6ae09d2 None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:31.098101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e84a1-304f-4fcf-a451-078cb6ae09d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:31.098370 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e84a1-304f-4fcf-a451-078cb6ae09d2 None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:31.099458 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e84a1-304f-4fcf-a451-078cb6ae09d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:31.101453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e84a1-304f-4fcf-a451-078cb6ae09d2 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:31.214551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 513/1024] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jul 26 14:41:30 2022] POST /identity/v3/users => generated 285 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:41:31.536807 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb6e50-904f-4b13-b0c4-10414d5b4ab7 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:31.537140 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb6e50-904f-4b13-b0c4-10414d5b4ab7 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:31.537373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb6e50-904f-4b13-b0c4-10414d5b4ab7 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:31.539440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 512/1025] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:31.544488 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43266e51-9c55-413d-a628-7187707f5074 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:31.544790 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43266e51-9c55-413d-a628-7187707f5074 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:31.545073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43266e51-9c55-413d-a628-7187707f5074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:31.563608 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-43266e51-9c55-413d-a628-7187707f5074 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:31.564802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-43266e51-9c55-413d-a628-7187707f5074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:31.635441 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 514/1026] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:31.657553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb6e50-904f-4b13-b0c4-10414d5b4ab7 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:31.772004 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb6e50-904f-4b13-b0c4-10414d5b4ab7 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:31.807918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810383b-3335-4ac3-870a-91d199fee756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:31.808487 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810383b-3335-4ac3-870a-91d199fee756 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:31.808769 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810383b-3335-4ac3-870a-91d199fee756 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:31.809044 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810383b-3335-4ac3-870a-91d199fee756 None admin] PATH_INFO: `/v3/services/image` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:31.809667 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810383b-3335-4ac3-870a-91d199fee756 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:31.811057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810383b-3335-4ac3-870a-91d199fee756 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:31.819804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-a810383b-3335-4ac3-870a-91d199fee756 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:41:31.819804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:31.819804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:31.819804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:31.819804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:31.819804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:31.819804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:31.819804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:31.819804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:41:31.819804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:31.819804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:31.819804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:31.819804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:31.819804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:31.819804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:31.819804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:31.819804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:31.820788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:31.820788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:31.820788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:31.820788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:31.820788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:31.820788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:31.820788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:31.820788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:31.820788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:31.820788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:31.820788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:31.820788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:31.820788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:31.820788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:31.820788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:31.820788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:31.821606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:31.821606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:31.821606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:31.821606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:31.821606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:31.821606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:31.821606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:31.821606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:31.821606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:31.821606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:31.821606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:31.821606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:31.821606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:41:31.821606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:31.821606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 513/1027] 10.222.0.86 () {56 vars in 1105 bytes} [Tue Jul 26 14:41:31 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:31.827071 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43266e51-9c55-413d-a628-7187707f5074 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:31.845179 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:31.933873 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43266e51-9c55-413d-a628-7187707f5074 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:31.969660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac4bea-d466-4f5a-b564-848f4f0964a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:31.970287 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac4bea-d466-4f5a-b564-848f4f0964a0 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:31.970594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac4bea-d466-4f5a-b564-848f4f0964a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:31.970875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac4bea-d466-4f5a-b564-848f4f0964a0 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:31.971555 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac4bea-d466-4f5a-b564-848f4f0964a0 None admin] RBAC: Adding query filter params (name=image) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:31.971862 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac4bea-d466-4f5a-b564-848f4f0964a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:31.973229 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac4bea-d466-4f5a-b564-848f4f0964a0 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:31.983577 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 515/1028] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:31.985013 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810383b-3335-4ac3-870a-91d199fee756 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:32.032337 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477c2a8-08ec-4019-9f03-6b8978dc1476 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:32.032652 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477c2a8-08ec-4019-9f03-6b8978dc1476 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:32.032897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477c2a8-08ec-4019-9f03-6b8978dc1476 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:32.034265 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 516/1029] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:32.036761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:32.039776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d542-c01f-4b52-b4db-c663f744c27d None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:32.040066 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d542-c01f-4b52-b4db-c663f744c27d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:32.040344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d542-c01f-4b52-b4db-c663f744c27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:32.058197 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-4062d542-c01f-4b52-b4db-c663f744c27d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:32.059349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4062d542-c01f-4b52-b4db-c663f744c27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:32.093139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810383b-3335-4ac3-870a-91d199fee756 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:32.129157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf15de-146a-4b99-85ad-df9637aec97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:32.129785 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf15de-146a-4b99-85ad-df9637aec97b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:32.130069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf15de-146a-4b99-85ad-df9637aec97b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:32.130350 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf15de-146a-4b99-85ad-df9637aec97b None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:32.131082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf15de-146a-4b99-85ad-df9637aec97b None admin] RBAC: Adding query filter params (type=image) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:32.131361 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf15de-146a-4b99-85ad-df9637aec97b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:32.132757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf15de-146a-4b99-85ad-df9637aec97b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:32.136237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 517/1030] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:32.138429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 514/1031] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:32.143496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062d542-c01f-4b52-b4db-c663f744c27d None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:32.155500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:32.161674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf15de-146a-4b99-85ad-df9637aec97b None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:32.247833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062d542-c01f-4b52-b4db-c663f744c27d None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:32.270139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf15de-146a-4b99-85ad-df9637aec97b None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:32.283409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea17f57-5a5c-4cac-90a5-8ae638c6eba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:32.284035 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea17f57-5a5c-4cac-90a5-8ae638c6eba0 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:32.284368 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea17f57-5a5c-4cac-90a5-8ae638c6eba0 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:32.284641 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea17f57-5a5c-4cac-90a5-8ae638c6eba0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:32.284880 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:32.285402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea17f57-5a5c-4cac-90a5-8ae638c6eba0 None admin] RBAC: Adding query filter params (interface=public, service_id=91421b60d84246f29777396a07883ec4, region_id=RegionOne) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:32.285716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea17f57-5a5c-4cac-90a5-8ae638c6eba0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:32.287130 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea17f57-5a5c-4cac-90a5-8ae638c6eba0 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:32.292461 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 518/1032] 10.222.0.86 () {56 vars in 1251 bytes} [Tue Jul 26 14:41:32 2022] GET /identity/v3/endpoints?service_id=91421b60d84246f29777396a07883ec4&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:32.297811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea17f57-5a5c-4cac-90a5-8ae638c6eba0 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:32.310880 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537f31e-61d1-4f47-9176-b3ff26298bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:32.311606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537f31e-61d1-4f47-9176-b3ff26298bb0 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:32.311893 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537f31e-61d1-4f47-9176-b3ff26298bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:32.312195 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537f31e-61d1-4f47-9176-b3ff26298bb0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:32.323885 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537f31e-61d1-4f47-9176-b3ff26298bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:41:32.329782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-e537f31e-61d1-4f47-9176-b3ff26298bb0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:41:32.329782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:32.329782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:32.329782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:32.329782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:32.329782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:32.329782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:32.329782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:32.329782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:32.329782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:32.329782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:32.329782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:32.329782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:41:32.329782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:41:32.329782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:41:32.329782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:41:32.330930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:41:32.330930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:41:32.330930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:41:32.330930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:41:32.330930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:32.330930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:32.330930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:32.330930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:32.330930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:32.330930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:32.330930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:32.330930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:32.330930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:32.330930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:32.330930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:32.330930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:32.331850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:32.331850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:32.331850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:32.331850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:32.331850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:41:32.331850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:41:32.331850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:41:32.331850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:41:32.331850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:41:32.331850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:41:32.331850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:41:32.331850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:32.331850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 515/1033] 10.222.0.86 () {56 vars in 1120 bytes} [Tue Jul 26 14:41:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:32.337662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537f31e-61d1-4f47-9176-b3ff26298bb0 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:32.379855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:32.406407 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea17f57-5a5c-4cac-90a5-8ae638c6eba0 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:32.442200 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13b83f-7192-40ba-9a76-c98d82e8c637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:32.442823 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13b83f-7192-40ba-9a76-c98d82e8c637 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:32.443111 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13b83f-7192-40ba-9a76-c98d82e8c637 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:32.443389 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13b83f-7192-40ba-9a76-c98d82e8c637 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:32.444037 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13b83f-7192-40ba-9a76-c98d82e8c637 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:32.445949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13b83f-7192-40ba-9a76-c98d82e8c637 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:32.450479 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537f31e-61d1-4f47-9176-b3ff26298bb0 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:32.452706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 519/1034] 10.222.0.86 () {56 vars in 1087 bytes} [Tue Jul 26 14:41:32 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 14:41:32.488723 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c33c56-2a68-4824-818e-f480893879c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:32.489361 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c33c56-2a68-4824-818e-f480893879c4 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:32.489642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c33c56-2a68-4824-818e-f480893879c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:32.489916 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c33c56-2a68-4824-818e-f480893879c4 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:32.490711 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c33c56-2a68-4824-818e-f480893879c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:32.491015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c33c56-2a68-4824-818e-f480893879c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:32.492428 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c33c56-2a68-4824-818e-f480893879c4 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:32.506493 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 516/1035] 10.222.0.86 () {56 vars in 1115 bytes} [Tue Jul 26 14:41:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:32.509452 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13b83f-7192-40ba-9a76-c98d82e8c637 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:32.621067 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13b83f-7192-40ba-9a76-c98d82e8c637 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:32.655794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdf6d1-23e6-4f4b-953c-f27f74f062e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:32.656441 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdf6d1-23e6-4f4b-953c-f27f74f062e5 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:32.656728 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdf6d1-23e6-4f4b-953c-f27f74f062e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:32.657005 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdf6d1-23e6-4f4b-953c-f27f74f062e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:32.663754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:32.671347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdf6d1-23e6-4f4b-953c-f27f74f062e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:32.673212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdf6d1-23e6-4f4b-953c-f27f74f062e5 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:32.691092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-34bdf6d1-23e6-4f4b-953c-f27f74f062e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:32.691092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:32.691092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:32.691092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:32.691092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:32.691092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:32.691092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:32.691092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:32.691092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:32.691092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:32.691092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:32.691092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:32.691092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:32.691092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:32.691092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:32.692029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:32.692029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:32.692029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:32.692029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:32.692029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:32.692029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:32.692029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:32.692029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:32.692029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:32.692029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:32.692029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:32.692029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:32.692029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:32.692029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:32.692029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:32.692029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:32.692029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:32.693350 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:32.693350 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:32.693350 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:32.693350 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:32.693350 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 520/1036] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:32.698980 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c33c56-2a68-4824-818e-f480893879c4 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:32.737132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:32.807274 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c33c56-2a68-4824-818e-f480893879c4 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:32.846842 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca037a0-2b03-4a1d-8ba4-baf8e8a8deb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:32.847430 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca037a0-2b03-4a1d-8ba4-baf8e8a8deb2 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:32.847717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca037a0-2b03-4a1d-8ba4-baf8e8a8deb2 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:32.848000 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca037a0-2b03-4a1d-8ba4-baf8e8a8deb2 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:32.848699 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca037a0-2b03-4a1d-8ba4-baf8e8a8deb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:32.849006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca037a0-2b03-4a1d-8ba4-baf8e8a8deb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:32.850380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca037a0-2b03-4a1d-8ba4-baf8e8a8deb2 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:32.865908 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 517/1037] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:32.872320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdf6d1-23e6-4f4b-953c-f27f74f062e5 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:32.980014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdf6d1-23e6-4f4b-953c-f27f74f062e5 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:33.014275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22c4d5-b057-4d22-b22c-dda6eacaafd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:33.014941 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22c4d5-b057-4d22-b22c-dda6eacaafd1 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:33.015224 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22c4d5-b057-4d22-b22c-dda6eacaafd1 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:33.015500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22c4d5-b057-4d22-b22c-dda6eacaafd1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:33.024056 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22c4d5-b057-4d22-b22c-dda6eacaafd1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:33.025503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22c4d5-b057-4d22-b22c-dda6eacaafd1 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:33.036878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-db22c4d5-b057-4d22-b22c-dda6eacaafd1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:41:33.036878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:33.036878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:33.036878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:33.036878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:33.036878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:33.036878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:33.036878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:33.036878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:33.036878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:33.036878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:33.036878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:33.036878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:41:33.036878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:41:33.036878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:41:33.036878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:41:33.037907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:33.037907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:33.037907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:41:33.037907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:33.037907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:41:33.037907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:33.037907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:33.037907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:33.037907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:33.037907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:33.037907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:33.037907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:33.037907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:33.037907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:33.037907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:33.037907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:33.037907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:33.037907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:33.039456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:33.039456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:33.039456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:41:33.039456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:41:33.039456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:41:33.039456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:41:33.039456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:41:33.039456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:41:33.039456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:41:33.039456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:33.040395 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 521/1038] 10.222.0.86 () {56 vars in 1093 bytes} [Tue Jul 26 14:41:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:33.044216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca037a0-2b03-4a1d-8ba4-baf8e8a8deb2 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:33.147350 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:33.159406 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca037a0-2b03-4a1d-8ba4-baf8e8a8deb2 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:33.195930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832636d-c8a6-4227-a723-c857448aacda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:33.196558 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832636d-c8a6-4227-a723-c857448aacda None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:33.196843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832636d-c8a6-4227-a723-c857448aacda None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:33.197122 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832636d-c8a6-4227-a723-c857448aacda None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:33.197923 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832636d-c8a6-4227-a723-c857448aacda None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:33.198235 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832636d-c8a6-4227-a723-c857448aacda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:33.199693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832636d-c8a6-4227-a723-c857448aacda None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:33.222977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 518/1039] 10.222.0.86 () {56 vars in 1133 bytes} [Tue Jul 26 14:41:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:33.224379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22c4d5-b057-4d22-b22c-dda6eacaafd1 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:33.277817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:33.294824 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eb80f-3258-46d7-95f7-8e50b5a8f9a8 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:33.295133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eb80f-3258-46d7-95f7-8e50b5a8f9a8 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:33.295384 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eb80f-3258-46d7-95f7-8e50b5a8f9a8 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:33.296932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 519/1040] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:41:33.301593 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86673357-2a3d-41c2-9b1f-4665fa614e59 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:33.301863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86673357-2a3d-41c2-9b1f-4665fa614e59 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:33.302141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86673357-2a3d-41c2-9b1f-4665fa614e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:33.321540 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-86673357-2a3d-41c2-9b1f-4665fa614e59 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:33.322827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-86673357-2a3d-41c2-9b1f-4665fa614e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:33.330093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22c4d5-b057-4d22-b22c-dda6eacaafd1 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:33.368134 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadc9b2-3636-497e-a262-880bf0d16578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:33.368949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadc9b2-3636-497e-a262-880bf0d16578 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:33.369060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadc9b2-3636-497e-a262-880bf0d16578 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:33.369280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadc9b2-3636-497e-a262-880bf0d16578 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:33.398516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 520/1041] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:41:33.417936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86673357-2a3d-41c2-9b1f-4665fa614e59 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:33.445732 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadc9b2-3636-497e-a262-880bf0d16578 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:33.447230 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadc9b2-3636-497e-a262-880bf0d16578 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:33.499083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:33.506029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:33.522700 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86673357-2a3d-41c2-9b1f-4665fa614e59 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:33.560171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 522/1042] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:41:33 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:41:33.565559 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadc9b2-3636-497e-a262-880bf0d16578 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:33.568205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ff2d8-f31b-483e-bd3e-beb0157c4f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:33.568942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ff2d8-f31b-483e-bd3e-beb0157c4f16 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:33.569359 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ff2d8-f31b-483e-bd3e-beb0157c4f16 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:33.570225 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ff2d8-f31b-483e-bd3e-beb0157c4f16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:33.588411 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ff2d8-f31b-483e-bd3e-beb0157c4f16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:41:33.594815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-390ff2d8-f31b-483e-bd3e-beb0157c4f16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:41:33.594815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:33.594815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:33.594815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:33.594815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:33.594815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:33.594815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:33.594815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:33.594815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:33.594815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:33.594815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:33.594815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:33.594815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:41:33.594815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:41:33.594815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:41:33.594815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:41:33.595752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:41:33.595752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:41:33.595752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:41:33.595752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:41:33.595752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:33.595752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:33.595752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:33.595752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:33.595752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:33.595752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:33.595752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:33.595752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:33.595752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:33.595752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:33.595752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:33.595752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:33.596835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:33.596835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:33.596835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:33.596835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:33.596835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:41:33.596835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:41:33.596835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:41:33.596835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:41:33.596835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:41:33.596835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:41:33.596835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:41:33.596835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:33.596835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 521/1043] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:41:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:33.602226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ff2d8-f31b-483e-bd3e-beb0157c4f16 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:33.681005 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadc9b2-3636-497e-a262-880bf0d16578 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:33.713385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ff2d8-f31b-483e-bd3e-beb0157c4f16 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:33.718812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb13aa-b55c-416f-8916-85fe1ae6c0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:33.719527 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb13aa-b55c-416f-8916-85fe1ae6c0e9 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:33.719876 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb13aa-b55c-416f-8916-85fe1ae6c0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:33.720244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb13aa-b55c-416f-8916-85fe1ae6c0e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:33.731446 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb13aa-b55c-416f-8916-85fe1ae6c0e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:33.732982 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb13aa-b55c-416f-8916-85fe1ae6c0e9 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:33.748703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-a6bb13aa-b55c-416f-8916-85fe1ae6c0e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:33.748703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:33.748703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:33.748703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:33.748703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:33.748703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:33.748703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:33.748703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:33.748703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:33.748703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:33.748703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:33.748703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:33.748703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:33.748703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:33.748703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:33.749864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:33.749864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:33.749864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:33.749864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:33.749864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:33.749864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:33.749864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:33.749864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:33.749864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:33.749864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:33.749864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:33.749864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:33.749864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:33.749864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:33.749864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:33.749864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:33.749864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:33.750811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:33.750811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:33.750811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:33.750811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:33.751032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21919582-8aed-4c41-b9a4-6183d6aa5228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:33.751032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21919582-8aed-4c41-b9a4-6183d6aa5228 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:33.751032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21919582-8aed-4c41-b9a4-6183d6aa5228 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:33.751032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21919582-8aed-4c41-b9a4-6183d6aa5228 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:33.751292 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21919582-8aed-4c41-b9a4-6183d6aa5228 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:33.751292 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21919582-8aed-4c41-b9a4-6183d6aa5228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:33.752922 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21919582-8aed-4c41-b9a4-6183d6aa5228 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:33.754540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 523/1044] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:33.755927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb13aa-b55c-416f-8916-85fe1ae6c0e9 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:33.758899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:33.766998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 522/1045] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:41:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:33.771422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21919582-8aed-4c41-b9a4-6183d6aa5228 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:33.777310 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:33.859404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb13aa-b55c-416f-8916-85fe1ae6c0e9 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:33.878256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21919582-8aed-4c41-b9a4-6183d6aa5228 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:33.901277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391d5e0-52d2-46ee-a5eb-a2a697e2b74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:33.902551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391d5e0-52d2-46ee-a5eb-a2a697e2b74b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:33.903070 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391d5e0-52d2-46ee-a5eb-a2a697e2b74b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:33.903586 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391d5e0-52d2-46ee-a5eb-a2a697e2b74b None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:33.905043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391d5e0-52d2-46ee-a5eb-a2a697e2b74b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:33.905757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391d5e0-52d2-46ee-a5eb-a2a697e2b74b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:33.908032 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391d5e0-52d2-46ee-a5eb-a2a697e2b74b None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:33.916967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970bac9-c384-4807-92f3-dcbeecb1c782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:33.917681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970bac9-c384-4807-92f3-dcbeecb1c782 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:33.920334 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970bac9-c384-4807-92f3-dcbeecb1c782 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:33.920334 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970bac9-c384-4807-92f3-dcbeecb1c782 None admin] PATH_INFO: `/v3/users/68c24e9c4a0541f4ba5264f7a0995b94` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:33.931650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 524/1046] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:33.932298 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391d5e0-52d2-46ee-a5eb-a2a697e2b74b None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:33.933382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970bac9-c384-4807-92f3-dcbeecb1c782 None admin] RBAC: Authorizing `identity:get_user(user_id=68c24e9c4a0541f4ba5264f7a0995b94)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:33.934887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970bac9-c384-4807-92f3-dcbeecb1c782 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:33.936604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 523/1047] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:41:33 2022] GET /identity/v3/users/68c24e9c4a0541f4ba5264f7a0995b94 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:33.942071 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970bac9-c384-4807-92f3-dcbeecb1c782 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:34.005947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:34.009447 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:34.047526 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970bac9-c384-4807-92f3-dcbeecb1c782 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:34.048609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391d5e0-52d2-46ee-a5eb-a2a697e2b74b None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:34.085357 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0a40b-94cc-4e12-a7ac-8773cc755a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:34.085999 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0a40b-94cc-4e12-a7ac-8773cc755a41 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:34.086286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0a40b-94cc-4e12-a7ac-8773cc755a41 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:34.086592 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0a40b-94cc-4e12-a7ac-8773cc755a41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:34.087714 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a536459-af59-44ec-876c-c0ecb71f2f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:34.088556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a536459-af59-44ec-876c-c0ecb71f2f2c None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:34.089032 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a536459-af59-44ec-876c-c0ecb71f2f2c None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:34.089312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a536459-af59-44ec-876c-c0ecb71f2f2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:34.097030 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a536459-af59-44ec-876c-c0ecb71f2f2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:34.098561 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a536459-af59-44ec-876c-c0ecb71f2f2c None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:34.111011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-6a536459-af59-44ec-876c-c0ecb71f2f2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:34.111011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:34.111011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:34.111011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:34.111011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:34.111011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:34.111011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:34.111011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:34.111011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:34.111011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:34.111011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:34.111011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:34.111011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:41:34.111011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:41:34.111011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:41:34.111905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:41:34.111905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:34.111905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:34.111905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:34.111905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:34.111905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:34.111905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:34.111905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:34.111905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:34.111905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:34.111905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:34.111905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:34.111905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:34.111905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:34.111905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:34.111905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:34.111905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:34.112914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:41:34.112914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:41:34.112914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:41:34.112914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:41:34.112914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:41:34.112914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:41:34.112914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:34.112914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:34.112914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 525/1048] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:41:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:34.118717 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a536459-af59-44ec-876c-c0ecb71f2f2c None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:34.165176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0a40b-94cc-4e12-a7ac-8773cc755a41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:34.166749 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0a40b-94cc-4e12-a7ac-8773cc755a41 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:34.231123 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a536459-af59-44ec-876c-c0ecb71f2f2c None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:34.231324 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:34.256336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:34.268788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ddb1e-7c6a-4ca4-bc50-fac383fa58a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:34.269412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ddb1e-7c6a-4ca4-bc50-fac383fa58a0 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:34.269698 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ddb1e-7c6a-4ca4-bc50-fac383fa58a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:34.269975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ddb1e-7c6a-4ca4-bc50-fac383fa58a0 None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:34.270795 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ddb1e-7c6a-4ca4-bc50-fac383fa58a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:34.271103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ddb1e-7c6a-4ca4-bc50-fac383fa58a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:34.273103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ddb1e-7c6a-4ca4-bc50-fac383fa58a0 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:34.278842 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 524/1049] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:41:33 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 14:41:34.280059 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0a40b-94cc-4e12-a7ac-8773cc755a41 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:34.294163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 526/1050] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:41:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:34.295342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ddb1e-7c6a-4ca4-bc50-fac383fa58a0 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:34.390421 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0a40b-94cc-4e12-a7ac-8773cc755a41 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:34.402747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ddb1e-7c6a-4ca4-bc50-fac383fa58a0 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:34.428298 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3df719-d3a2-4a45-bddc-cbb5f65cb7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:34.429459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3df719-d3a2-4a45-bddc-cbb5f65cb7b7 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:34.429750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3df719-d3a2-4a45-bddc-cbb5f65cb7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:34.430036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3df719-d3a2-4a45-bddc-cbb5f65cb7b7 None admin] PATH_INFO: `/v3/projects/30d335fbc36747d7b53ea1e0d1612224` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:34.431241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3df719-d3a2-4a45-bddc-cbb5f65cb7b7 None admin] RBAC: Authorizing `identity:get_project(project_id=30d335fbc36747d7b53ea1e0d1612224)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:34.432672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3df719-d3a2-4a45-bddc-cbb5f65cb7b7 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:34.439314 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 525/1051] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:41:34 2022] GET /identity/v3/projects/30d335fbc36747d7b53ea1e0d1612224 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:34.439553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef31635-57ff-4e7b-b6ef-1f458e6975b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:34.440182 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3df719-d3a2-4a45-bddc-cbb5f65cb7b7 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:34.440718 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef31635-57ff-4e7b-b6ef-1f458e6975b8 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:34.441188 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef31635-57ff-4e7b-b6ef-1f458e6975b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:34.441468 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef31635-57ff-4e7b-b6ef-1f458e6975b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:34.442256 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef31635-57ff-4e7b-b6ef-1f458e6975b8 None admin] RBAC: Adding query filter params (role.id=392e2ed96a59406fb49190dce5ee2a85, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=d12fc26e640f4337b4a4da60cc4d9adc) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:34.442609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef31635-57ff-4e7b-b6ef-1f458e6975b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:34.444035 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef31635-57ff-4e7b-b6ef-1f458e6975b8 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:34.458419 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 527/1052] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:41:34 2022] GET /identity/v3/role_assignments?user.id=d12fc26e640f4337b4a4da60cc4d9adc&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=392e2ed96a59406fb49190dce5ee2a85 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:34.476516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:34.508501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3cd3b-741a-4e47-b5fa-85b2ac3743b5 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:34.508858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3cd3b-741a-4e47-b5fa-85b2ac3743b5 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:34.509542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3cd3b-741a-4e47-b5fa-85b2ac3743b5 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:34.511213 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 528/1053] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:34.517083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e69014-facc-4fb4-a61a-a897f1c5e49e None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:34.518039 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e69014-facc-4fb4-a61a-a897f1c5e49e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:34.518328 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e69014-facc-4fb4-a61a-a897f1c5e49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:34.537085 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-a5e69014-facc-4fb4-a61a-a897f1c5e49e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:34.538869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a5e69014-facc-4fb4-a61a-a897f1c5e49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:34.560345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3df719-d3a2-4a45-bddc-cbb5f65cb7b7 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:34.588538 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:34.597569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46ef1e-89a1-4acc-a2a5-c4a21d91b1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:34.598209 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46ef1e-89a1-4acc-a2a5-c4a21d91b1b0 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:34.598521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46ef1e-89a1-4acc-a2a5-c4a21d91b1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:34.598860 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46ef1e-89a1-4acc-a2a5-c4a21d91b1b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:34.599749 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46ef1e-89a1-4acc-a2a5-c4a21d91b1b0 None admin] RBAC: Adding query filter params (role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.project.id=30d335fbc36747d7b53ea1e0d1612224, user.id=68c24e9c4a0541f4ba5264f7a0995b94) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:34.600064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46ef1e-89a1-4acc-a2a5-c4a21d91b1b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:34.602050 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46ef1e-89a1-4acc-a2a5-c4a21d91b1b0 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:34.610425 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 526/1054] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:41:34 2022] GET /identity/v3/role_assignments?user.id=68c24e9c4a0541f4ba5264f7a0995b94&scope.project.id=30d335fbc36747d7b53ea1e0d1612224&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:34.620701 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 529/1055] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:41:34.643336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46ef1e-89a1-4acc-a2a5-c4a21d91b1b0 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:34.754542 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:34.760941 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46ef1e-89a1-4acc-a2a5-c4a21d91b1b0 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:34.797049 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3904a-fb4c-4b87-a026-071bfe0a4b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:34.797706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3904a-fb4c-4b87-a026-071bfe0a4b94 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:34.797992 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3904a-fb4c-4b87-a026-071bfe0a4b94 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:34.798269 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3904a-fb4c-4b87-a026-071bfe0a4b94 None admin] PATH_INFO: `/v3/services/image` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:34.798931 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3904a-fb4c-4b87-a026-071bfe0a4b94 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:34.800317 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3904a-fb4c-4b87-a026-071bfe0a4b94 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:34.810168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-c4c3904a-fb4c-4b87-a026-071bfe0a4b94 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:41:34.810168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:34.810168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:41:34.810168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:41:34.810168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:41:34.810168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:41:34.810168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:41:34.810168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:34.810168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:41:34.810168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:34.810168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:41:34.810168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:34.810168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:34.810168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:34.810168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:34.810168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:34.810168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:34.811385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:34.811385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:34.811385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:34.811385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:34.811385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:34.811385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:34.811385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:41:34.811385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:41:34.811385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:41:34.811385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:41:34.811385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:34.811385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:34.811385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:34.811385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:34.811385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:34.811385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:34.812222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:34.812222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:34.812222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:34.812222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:34.812222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:34.812222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:34.812222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:34.812222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:34.812222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:34.812222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:34.812222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:41:34.812222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:41:34.812222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:41:34.812222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:34.812222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 527/1056] 10.222.0.86 () {56 vars in 1105 bytes} [Tue Jul 26 14:41:34 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:34.819451 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e69014-facc-4fb4-a61a-a897f1c5e49e None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:34.924519 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e69014-facc-4fb4-a61a-a897f1c5e49e None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:34.958776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc2888-8722-4ea5-a7d0-68263c6e15f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:34.959410 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc2888-8722-4ea5-a7d0-68263c6e15f1 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:34.959693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc2888-8722-4ea5-a7d0-68263c6e15f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:34.960508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc2888-8722-4ea5-a7d0-68263c6e15f1 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:34.961189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc2888-8722-4ea5-a7d0-68263c6e15f1 None admin] RBAC: Adding query filter params (name=image) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:34.961500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc2888-8722-4ea5-a7d0-68263c6e15f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:34.962939 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc2888-8722-4ea5-a7d0-68263c6e15f1 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:34.968266 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 530/1057] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:34.973784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3904a-fb4c-4b87-a026-071bfe0a4b94 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:35.078550 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3904a-fb4c-4b87-a026-071bfe0a4b94 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:35.113888 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0ffc3-391e-4584-ba7b-8aecea6e248b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:35.114548 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0ffc3-391e-4584-ba7b-8aecea6e248b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:35.114834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0ffc3-391e-4584-ba7b-8aecea6e248b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:35.115111 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0ffc3-391e-4584-ba7b-8aecea6e248b None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:35.115786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0ffc3-391e-4584-ba7b-8aecea6e248b None admin] RBAC: Adding query filter params (type=image) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:35.116093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0ffc3-391e-4584-ba7b-8aecea6e248b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:35.117494 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0ffc3-391e-4584-ba7b-8aecea6e248b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:35.127631 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 528/1058] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:35.128415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc2888-8722-4ea5-a7d0-68263c6e15f1 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:35.171827 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:35.231864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc2888-8722-4ea5-a7d0-68263c6e15f1 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:35.269043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7c5c5-6742-49cc-bb6a-caaf2c8aa313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:35.269661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7c5c5-6742-49cc-bb6a-caaf2c8aa313 None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:35.269943 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7c5c5-6742-49cc-bb6a-caaf2c8aa313 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:35.270217 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7c5c5-6742-49cc-bb6a-caaf2c8aa313 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:35.270960 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7c5c5-6742-49cc-bb6a-caaf2c8aa313 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:35.272348 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7c5c5-6742-49cc-bb6a-caaf2c8aa313 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:35.358506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 531/1059] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:41:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:41:36.485406 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78552db-4372-4f97-b0a4-6c97e5dc06df None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:36.485936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78552db-4372-4f97-b0a4-6c97e5dc06df None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:36.485936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78552db-4372-4f97-b0a4-6c97e5dc06df None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:36.487472 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 529/1060] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:36.493177 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f26fa-bdc5-4f99-9614-1b6ee5d5de54 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:36.493567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f26fa-bdc5-4f99-9614-1b6ee5d5de54 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:36.493727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f26fa-bdc5-4f99-9614-1b6ee5d5de54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:36.512746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-205f26fa-bdc5-4f99-9614-1b6ee5d5de54 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:36.513932 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-205f26fa-bdc5-4f99-9614-1b6ee5d5de54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:36.589256 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 532/1061] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:36.603345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7240517-9e10-4574-8394-ded2cf84f755 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:36.603640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7240517-9e10-4574-8394-ded2cf84f755 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:36.603923 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7240517-9e10-4574-8394-ded2cf84f755 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:36.605414 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 530/1062] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:36.610398 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7240517-9e10-4574-8394-ded2cf84f755 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:36.610600 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d88e22-cf91-4005-a3dc-233d70eb15c2 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:36.610868 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d88e22-cf91-4005-a3dc-233d70eb15c2 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:36.611151 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d88e22-cf91-4005-a3dc-233d70eb15c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:36.629855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-36d88e22-cf91-4005-a3dc-233d70eb15c2 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:36.631071 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-36d88e22-cf91-4005-a3dc-233d70eb15c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:36.641331 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:36.649784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:36.718554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 533/1063] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:36.734917 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7240517-9e10-4574-8394-ded2cf84f755 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:36.739135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d88e22-cf91-4005-a3dc-233d70eb15c2 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:36.772376 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b25444-cea2-4e50-9b16-e7916fece9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:36.773020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b25444-cea2-4e50-9b16-e7916fece9c5 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:36.773296 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b25444-cea2-4e50-9b16-e7916fece9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:36.773570 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b25444-cea2-4e50-9b16-e7916fece9c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:36.783836 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b25444-cea2-4e50-9b16-e7916fece9c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:41:36.789282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-00b25444-cea2-4e50-9b16-e7916fece9c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:41:36.789282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:36.789282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:36.789282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:36.789282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:36.789282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:36.789282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:36.789282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:36.789282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:36.789282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:36.789282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:36.789282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:36.789282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:41:36.789282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:41:36.789282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:41:36.789282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:41:36.790216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:41:36.790216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:41:36.790216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:41:36.790216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:41:36.790216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:36.790216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:36.790216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:36.790216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:36.790216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:36.790216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:36.790216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:36.790216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:36.790216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:36.790216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:36.790216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:36.790216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:36.791276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:36.791276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:36.791276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:36.791276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:36.791276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:41:36.791276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:41:36.791276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:41:36.791276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:41:36.791276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:41:36.791276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:41:36.791276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:41:36.791276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:36.791276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 531/1064] 10.222.0.86 () {56 vars in 1120 bytes} [Tue Jul 26 14:41:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:36.796180 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b25444-cea2-4e50-9b16-e7916fece9c5 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:36.848833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d88e22-cf91-4005-a3dc-233d70eb15c2 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:36.887061 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca0382-b93d-493a-bdab-55800280f15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:36.887788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca0382-b93d-493a-bdab-55800280f15d None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:36.888101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca0382-b93d-493a-bdab-55800280f15d None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:36.888374 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca0382-b93d-493a-bdab-55800280f15d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:36.894081 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:36.900444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca0382-b93d-493a-bdab-55800280f15d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:41:36.905224 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b25444-cea2-4e50-9b16-e7916fece9c5 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:36.905463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-9bca0382-b93d-493a-bdab-55800280f15d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:41:36.905463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:36.905463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:36.905463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:36.905463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:36.905463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:36.905463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:36.905463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:36.905463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:36.905463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:36.905463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:36.905463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:36.905463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:41:36.905463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:41:36.905463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:41:36.905463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:41:36.906429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:41:36.906429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:41:36.906429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:41:36.906429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:41:36.906429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:36.906429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:36.906429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:36.906429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:36.906429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:36.906429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:36.906429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:36.906429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:36.906429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:36.906429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:36.906429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:36.906429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:36.907257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:36.907257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:36.907257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:36.907257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:36.907257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:41:36.907257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:41:36.907257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:41:36.907257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:41:36.907257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:41:36.907257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:41:36.907257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:41:36.907257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:36.907257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 534/1065] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:41:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:36.912866 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca0382-b93d-493a-bdab-55800280f15d None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:36.930722 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:36.949443 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6cf83-7238-4315-8834-bfa8712094b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:36.950247 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6cf83-7238-4315-8834-bfa8712094b3 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:36.950601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6cf83-7238-4315-8834-bfa8712094b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:36.950881 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6cf83-7238-4315-8834-bfa8712094b3 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:36.951748 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6cf83-7238-4315-8834-bfa8712094b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:36.952063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6cf83-7238-4315-8834-bfa8712094b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:36.954232 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6cf83-7238-4315-8834-bfa8712094b3 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:36.965628 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 532/1066] 10.222.0.86 () {56 vars in 1115 bytes} [Tue Jul 26 14:41:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:36.970321 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6cf83-7238-4315-8834-bfa8712094b3 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:37.028526 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca0382-b93d-493a-bdab-55800280f15d None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:37.066178 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a60457-32ed-4c49-b0db-15205f1822db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:37.066841 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a60457-32ed-4c49-b0db-15205f1822db None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:37.067126 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a60457-32ed-4c49-b0db-15205f1822db None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:37.067400 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a60457-32ed-4c49-b0db-15205f1822db None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:37.068229 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a60457-32ed-4c49-b0db-15205f1822db None admin] RBAC: Adding query filter params (name=admin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:37.068537 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a60457-32ed-4c49-b0db-15205f1822db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:37.069955 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a60457-32ed-4c49-b0db-15205f1822db None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:37.083950 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 535/1067] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:41:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:37.084155 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6cf83-7238-4315-8834-bfa8712094b3 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:37.085502 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a60457-32ed-4c49-b0db-15205f1822db None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:37.119833 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6ce8c-d947-4c0e-918e-3040b5402078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:37.120729 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6ce8c-d947-4c0e-918e-3040b5402078 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:37.121873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6ce8c-d947-4c0e-918e-3040b5402078 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:37.122159 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6ce8c-d947-4c0e-918e-3040b5402078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:37.135957 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6ce8c-d947-4c0e-918e-3040b5402078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:37.137406 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6ce8c-d947-4c0e-918e-3040b5402078 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:37.144577 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:37.153783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-1ac6ce8c-d947-4c0e-918e-3040b5402078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:37.153783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:37.153783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:37.153783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:37.153783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:37.153783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:37.153783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:37.153783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:37.153783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:37.153783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:37.153783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:37.153783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:37.153783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:37.153783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:37.153783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:37.163934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:37.163934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:37.163934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:37.163934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:37.163934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:37.163934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:37.163934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:37.163934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:37.163934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:37.163934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:37.163934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:37.163934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:37.163934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:37.163934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:37.163934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:37.163934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:37.163934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:37.164971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:37.164971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:37.164971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:37.164971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:37.164971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 533/1068] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:37.164971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6ce8c-d947-4c0e-918e-3040b5402078 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:37.171976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:37.199997 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a60457-32ed-4c49-b0db-15205f1822db None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:37.237933 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b7882-7635-4cfa-b6d2-b0cd0909d146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:37.238621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b7882-7635-4cfa-b6d2-b0cd0909d146 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:37.238910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b7882-7635-4cfa-b6d2-b0cd0909d146 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:37.239189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b7882-7635-4cfa-b6d2-b0cd0909d146 None admin] PATH_INFO: `/v3/users/68c24e9c4a0541f4ba5264f7a0995b94` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:37.240399 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b7882-7635-4cfa-b6d2-b0cd0909d146 None admin] RBAC: Authorizing `identity:get_user(user_id=68c24e9c4a0541f4ba5264f7a0995b94)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:37.241858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b7882-7635-4cfa-b6d2-b0cd0909d146 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:37.243519 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 536/1069] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:41:37 2022] GET /identity/v3/users/68c24e9c4a0541f4ba5264f7a0995b94 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:37.249070 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b7882-7635-4cfa-b6d2-b0cd0909d146 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:37.268216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6ce8c-d947-4c0e-918e-3040b5402078 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:37.302751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c45a1-83b1-437e-b7b7-c0643ecea7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:37.303302 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c45a1-83b1-437e-b7b7-c0643ecea7ef None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:37.303613 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c45a1-83b1-437e-b7b7-c0643ecea7ef None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:37.303897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c45a1-83b1-437e-b7b7-c0643ecea7ef None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:37.304595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c45a1-83b1-437e-b7b7-c0643ecea7ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:37.304907 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c45a1-83b1-437e-b7b7-c0643ecea7ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:37.306270 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c45a1-83b1-437e-b7b7-c0643ecea7ef None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:37.318198 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 534/1070] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:37.324275 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c45a1-83b1-437e-b7b7-c0643ecea7ef None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:37.367031 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b7882-7635-4cfa-b6d2-b0cd0909d146 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:37.384766 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:37.402283 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbb85b-7bae-4f39-929b-84f9b1b8d9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:37.402956 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbb85b-7bae-4f39-929b-84f9b1b8d9e2 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:37.403240 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbb85b-7bae-4f39-929b-84f9b1b8d9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:37.403517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbb85b-7bae-4f39-929b-84f9b1b8d9e2 None admin] PATH_INFO: `/v3/projects/30d335fbc36747d7b53ea1e0d1612224` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:37.404667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbb85b-7bae-4f39-929b-84f9b1b8d9e2 None admin] RBAC: Authorizing `identity:get_project(project_id=30d335fbc36747d7b53ea1e0d1612224)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:37.406099 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbb85b-7bae-4f39-929b-84f9b1b8d9e2 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:37.407801 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 537/1071] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:41:37 2022] GET /identity/v3/projects/30d335fbc36747d7b53ea1e0d1612224 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:37.408918 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34517ccd-ebcd-4fa7-9059-287071691883 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:37.409210 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34517ccd-ebcd-4fa7-9059-287071691883 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:37.409487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34517ccd-ebcd-4fa7-9059-287071691883 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:37.410935 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 538/1072] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:37.415931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34517ccd-ebcd-4fa7-9059-287071691883 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:37.427865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c45a1-83b1-437e-b7b7-c0643ecea7ef None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:37.428213 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:37.462220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac195ce-446d-49fa-9c9e-9d3a96a85458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:37.462900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac195ce-446d-49fa-9c9e-9d3a96a85458 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:37.463181 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac195ce-446d-49fa-9c9e-9d3a96a85458 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:37.463463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac195ce-446d-49fa-9c9e-9d3a96a85458 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:37.470665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac195ce-446d-49fa-9c9e-9d3a96a85458 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:37.472103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac195ce-446d-49fa-9c9e-9d3a96a85458 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:37.483997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-7ac195ce-446d-49fa-9c9e-9d3a96a85458 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:41:37.483997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:37.483997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:37.483997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:37.483997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:37.483997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:37.483997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:37.483997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:37.483997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:37.483997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:37.483997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:37.483997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:37.483997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:41:37.483997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:41:37.483997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:41:37.483997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:41:37.485083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:37.485083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:37.485083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:41:37.485083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:37.485083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:41:37.485083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:37.485083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:37.485083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:37.485083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:37.485083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:37.485083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:37.485083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:37.485083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:37.485083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:37.485083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:37.485083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:37.485083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:37.485083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:37.487012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:37.487012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:37.487012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:41:37.487012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:41:37.487012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:41:37.487012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:41:37.487012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:41:37.487012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:41:37.487012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:41:37.487012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:37.487012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 535/1073] 10.222.0.86 () {56 vars in 1093 bytes} [Tue Jul 26 14:41:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:37.487012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37d64f-e87d-4c66-b754-a17917ccc539 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:37.487012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37d64f-e87d-4c66-b754-a17917ccc539 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:37.487828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37d64f-e87d-4c66-b754-a17917ccc539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:37.505206 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-9a37d64f-e87d-4c66-b754-a17917ccc539 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:37.506412 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-9a37d64f-e87d-4c66-b754-a17917ccc539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:37.522848 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34517ccd-ebcd-4fa7-9059-287071691883 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:37.556949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53c0c6-255c-4d55-b7d2-c3155a780d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:37.557547 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53c0c6-255c-4d55-b7d2-c3155a780d82 None admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:37.557833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53c0c6-255c-4d55-b7d2-c3155a780d82 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:37.558113 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53c0c6-255c-4d55-b7d2-c3155a780d82 None admin] PATH_INFO: `/v3/projects/30d335fbc36747d7b53ea1e0d1612224/users/68c24e9c4a0541f4ba5264f7a0995b94/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:37.560115 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53c0c6-255c-4d55-b7d2-c3155a780d82 None admin] RBAC: Authorizing `identity:create_grant(project_id=30d335fbc36747d7b53ea1e0d1612224, user_id=68c24e9c4a0541f4ba5264f7a0995b94, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:37.561559 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53c0c6-255c-4d55-b7d2-c3155a780d82 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:37.572292 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 536/1074] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:37.573128 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37d64f-e87d-4c66-b754-a17917ccc539 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:37.623171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:37.662401 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 539/1075] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:41:37 2022] PUT /identity/v3/projects/30d335fbc36747d7b53ea1e0d1612224/users/68c24e9c4a0541f4ba5264f7a0995b94/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:41:37.663815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53c0c6-255c-4d55-b7d2-c3155a780d82 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:37.685558 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37d64f-e87d-4c66-b754-a17917ccc539 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:37.727087 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3646bf-5f7d-4bd7-b0df-1d9d17c361fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:37.727737 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3646bf-5f7d-4bd7-b0df-1d9d17c361fd None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:37.728025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3646bf-5f7d-4bd7-b0df-1d9d17c361fd None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:37.728307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3646bf-5f7d-4bd7-b0df-1d9d17c361fd None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:37.729192 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3646bf-5f7d-4bd7-b0df-1d9d17c361fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:37.729513 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3646bf-5f7d-4bd7-b0df-1d9d17c361fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:37.731023 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3646bf-5f7d-4bd7-b0df-1d9d17c361fd None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:37.751088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 537/1076] 10.222.0.86 () {56 vars in 1133 bytes} [Tue Jul 26 14:41:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:37.757183 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3646bf-5f7d-4bd7-b0df-1d9d17c361fd None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:37.762630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:37.801319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53c0c6-255c-4d55-b7d2-c3155a780d82 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:37.844357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907619d2-90f3-4bc4-8606-8ee9ae2b21a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:37.845049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907619d2-90f3-4bc4-8606-8ee9ae2b21a1 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:37.845332 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907619d2-90f3-4bc4-8606-8ee9ae2b21a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:37.845607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907619d2-90f3-4bc4-8606-8ee9ae2b21a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:37.872964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3646bf-5f7d-4bd7-b0df-1d9d17c361fd None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:37.880732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:37.908401 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572efa5c-95c5-46d3-a6cd-8818c8d55bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:37.909053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572efa5c-95c5-46d3-a6cd-8818c8d55bc6 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:37.909377 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572efa5c-95c5-46d3-a6cd-8818c8d55bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:37.909656 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572efa5c-95c5-46d3-a6cd-8818c8d55bc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:37.917710 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907619d2-90f3-4bc4-8606-8ee9ae2b21a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:37.919206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907619d2-90f3-4bc4-8606-8ee9ae2b21a1 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:37.920383 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572efa5c-95c5-46d3-a6cd-8818c8d55bc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:37.921837 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572efa5c-95c5-46d3-a6cd-8818c8d55bc6 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:37.938717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-572efa5c-95c5-46d3-a6cd-8818c8d55bc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:37.938717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:37.938717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:37.938717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:37.938717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:37.938717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:37.938717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:37.938717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:37.938717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:37.938717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:37.938717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:37.938717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:37.938717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:37.938717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:37.938717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:37.939641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:37.939641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:37.939641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:37.939641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:37.939641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:37.939641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:37.939641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:37.939641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:37.939641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:37.939641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:37.939641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:37.939641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:37.939641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:37.939641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:37.939641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:37.939641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:37.939641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:37.940527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:37.940527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:37.940527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:37.940527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:37.940527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 538/1077] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:37.945879 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572efa5c-95c5-46d3-a6cd-8818c8d55bc6 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:38.011507 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:38.050473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 540/1078] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:41:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:41:38.052987 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907619d2-90f3-4bc4-8606-8ee9ae2b21a1 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:38.064597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572efa5c-95c5-46d3-a6cd-8818c8d55bc6 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:38.099552 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238179d-b304-4f8a-9e11-b3fdef9688b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:38.100092 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238179d-b304-4f8a-9e11-b3fdef9688b6 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:38.100864 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238179d-b304-4f8a-9e11-b3fdef9688b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:38.101144 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238179d-b304-4f8a-9e11-b3fdef9688b6 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:38.101819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238179d-b304-4f8a-9e11-b3fdef9688b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:38.102349 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238179d-b304-4f8a-9e11-b3fdef9688b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:38.103521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238179d-b304-4f8a-9e11-b3fdef9688b6 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:38.116960 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 539/1079] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:38.122289 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238179d-b304-4f8a-9e11-b3fdef9688b6 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:38.143601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:38.168476 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907619d2-90f3-4bc4-8606-8ee9ae2b21a1 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:38.205270 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0a87d-214b-452e-a7c1-502e40d1177a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:38.206108 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0a87d-214b-452e-a7c1-502e40d1177a None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:38.206464 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0a87d-214b-452e-a7c1-502e40d1177a None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:38.206742 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0a87d-214b-452e-a7c1-502e40d1177a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:38.217533 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0a87d-214b-452e-a7c1-502e40d1177a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:38.219014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0a87d-214b-452e-a7c1-502e40d1177a None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:38.230510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238179d-b304-4f8a-9e11-b3fdef9688b6 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:38.234826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-6fd0a87d-214b-452e-a7c1-502e40d1177a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:38.234826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:38.234826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:38.234826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:38.234826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:38.234826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:38.234826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:38.234826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:38.234826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:38.234826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:38.234826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:38.234826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:38.234826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:38.234826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:38.234826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:38.235704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:38.235704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:38.235704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:38.235704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:38.235704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:38.235704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:38.235704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:38.235704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:38.235704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:38.235704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:38.235704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:38.235704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:38.235704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:38.235704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:38.235704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:38.235704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:38.235704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:38.236578 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:38.236578 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:38.236578 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:38.236578 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:38.241734 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 541/1080] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:38.242434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0a87d-214b-452e-a7c1-502e40d1177a None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:38.267263 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ef3f1-9ed3-4d49-aca4-f539dd7008a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:38.267955 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ef3f1-9ed3-4d49-aca4-f539dd7008a4 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:38.268241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ef3f1-9ed3-4d49-aca4-f539dd7008a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:38.268587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ef3f1-9ed3-4d49-aca4-f539dd7008a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:38.270729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:38.279246 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ef3f1-9ed3-4d49-aca4-f539dd7008a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:38.280760 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ef3f1-9ed3-4d49-aca4-f539dd7008a4 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:38.297622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-7e2ef3f1-9ed3-4d49-aca4-f539dd7008a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:38.297622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:38.297622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:38.297622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:38.297622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:38.297622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:38.297622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:38.297622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:38.297622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:38.297622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:38.297622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:38.297622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:38.297622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:41:38.297622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:41:38.297622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:41:38.298622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:41:38.298622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:38.298622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:38.298622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:38.298622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:38.298622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:38.298622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:38.298622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:38.298622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:38.298622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:38.298622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:38.298622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:38.298622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:38.298622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:38.298622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:38.298622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:38.298622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:38.299500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:41:38.299500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:41:38.299500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:41:38.299500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:41:38.299500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:41:38.299500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:41:38.299500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:38.299500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:38.299500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 540/1081] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:41:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:38.304508 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ef3f1-9ed3-4d49-aca4-f539dd7008a4 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:38.356152 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0a87d-214b-452e-a7c1-502e40d1177a None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:38.390668 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694a7ac-9d7f-4ed2-9167-46df8a6ec8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:38.391294 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694a7ac-9d7f-4ed2-9167-46df8a6ec8c4 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:38.391574 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694a7ac-9d7f-4ed2-9167-46df8a6ec8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:38.391848 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694a7ac-9d7f-4ed2-9167-46df8a6ec8c4 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:38.392543 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694a7ac-9d7f-4ed2-9167-46df8a6ec8c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:38.392848 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694a7ac-9d7f-4ed2-9167-46df8a6ec8c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:38.394449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694a7ac-9d7f-4ed2-9167-46df8a6ec8c4 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:38.397750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:38.408049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 542/1082] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:38.420859 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ef3f1-9ed3-4d49-aca4-f539dd7008a4 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:38.459182 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d9df8-7623-45d7-9a17-cc0bf7eb9d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:38.460374 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d9df8-7623-45d7-9a17-cc0bf7eb9d7d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:38.460724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d9df8-7623-45d7-9a17-cc0bf7eb9d7d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:38.461003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d9df8-7623-45d7-9a17-cc0bf7eb9d7d None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:38.461812 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d9df8-7623-45d7-9a17-cc0bf7eb9d7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:38.462125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d9df8-7623-45d7-9a17-cc0bf7eb9d7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:38.463659 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d9df8-7623-45d7-9a17-cc0bf7eb9d7d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:38.482448 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 541/1083] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:41:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:38.484976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694a7ac-9d7f-4ed2-9167-46df8a6ec8c4 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:38.576169 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:38.595540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694a7ac-9d7f-4ed2-9167-46df8a6ec8c4 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:38.632983 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980fc7f-cae3-4dc4-b561-eef890d1ff54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:38.633597 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980fc7f-cae3-4dc4-b561-eef890d1ff54 None admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:38.633883 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980fc7f-cae3-4dc4-b561-eef890d1ff54 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:38.634165 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980fc7f-cae3-4dc4-b561-eef890d1ff54 None admin] PATH_INFO: `/v3/projects/12937bc17f02483285f18c492fe237e3/users/d12fc26e640f4337b4a4da60cc4d9adc/roles/392e2ed96a59406fb49190dce5ee2a85` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:38.636862 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980fc7f-cae3-4dc4-b561-eef890d1ff54 None admin] RBAC: Authorizing `identity:create_grant(project_id=12937bc17f02483285f18c492fe237e3, user_id=d12fc26e640f4337b4a4da60cc4d9adc, role_id=392e2ed96a59406fb49190dce5ee2a85)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:38.638316 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980fc7f-cae3-4dc4-b561-eef890d1ff54 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:38.752929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 543/1084] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:41:38 2022] PUT /identity/v3/projects/12937bc17f02483285f18c492fe237e3/users/d12fc26e640f4337b4a4da60cc4d9adc/roles/392e2ed96a59406fb49190dce5ee2a85 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:41:39.723245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7828524-3dc9-454e-adf9-90903d7c2c23 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:39.723765 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7828524-3dc9-454e-adf9-90903d7c2c23 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:39.723985 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7828524-3dc9-454e-adf9-90903d7c2c23 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:39.725461 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 542/1085] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:39.730883 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f69b28-40cc-4207-a0b9-84d7a062bd11 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:39.731307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f69b28-40cc-4207-a0b9-84d7a062bd11 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:39.731422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f69b28-40cc-4207-a0b9-84d7a062bd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:39.749710 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-56f69b28-40cc-4207-a0b9-84d7a062bd11 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:39.750932 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-56f69b28-40cc-4207-a0b9-84d7a062bd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:39.816239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 544/1086] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:39.840028 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7828524-3dc9-454e-adf9-90903d7c2c23 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:39.940219 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7828524-3dc9-454e-adf9-90903d7c2c23 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:39.972941 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5166bf-1691-412d-b1d9-f89b3eef8f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:39.973574 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5166bf-1691-412d-b1d9-f89b3eef8f9d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:39.973853 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5166bf-1691-412d-b1d9-f89b3eef8f9d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:39.974124 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5166bf-1691-412d-b1d9-f89b3eef8f9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:39.980761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:39.990098 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5166bf-1691-412d-b1d9-f89b3eef8f9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:41:39.997024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-ce5166bf-1691-412d-b1d9-f89b3eef8f9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:41:39.997024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:39.997024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:39.997024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:39.997024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:39.997024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:39.997024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:39.997024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:39.997024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:39.997024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:39.997024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:39.997024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:39.997024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:41:39.997024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:41:39.997024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:41:39.997024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:41:39.998007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:41:39.998007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:41:39.998007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:41:39.998007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:41:39.998007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:39.998007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:39.998007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:39.998007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:39.998007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:39.998007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:39.998007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:39.998007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:39.998007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:39.998007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:39.998007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:39.998007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:39.999616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:39.999616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:39.999616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:39.999616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:39.999616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:41:39.999616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:41:39.999616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:41:39.999616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:41:39.999616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:41:39.999616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:41:39.999616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:41:39.999616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:39.999616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 543/1087] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:41:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:40.004488 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f69b28-40cc-4207-a0b9-84d7a062bd11 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:40.073345 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:40.101224 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f69b28-40cc-4207-a0b9-84d7a062bd11 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:40.136089 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b982db5-b488-4c18-8232-26c1183ea23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:40.136726 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b982db5-b488-4c18-8232-26c1183ea23a None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:40.137013 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b982db5-b488-4c18-8232-26c1183ea23a None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:40.137288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b982db5-b488-4c18-8232-26c1183ea23a None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:40.138001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b982db5-b488-4c18-8232-26c1183ea23a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:40.138307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b982db5-b488-4c18-8232-26c1183ea23a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:40.139705 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b982db5-b488-4c18-8232-26c1183ea23a None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:40.147946 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 545/1088] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:41:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:40.153715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5166bf-1691-412d-b1d9-f89b3eef8f9d None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:40.250981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5166bf-1691-412d-b1d9-f89b3eef8f9d None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:40.283343 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af56807-caf8-4e24-85b7-a811cc38c14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:40.284107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af56807-caf8-4e24-85b7-a811cc38c14a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:40.284383 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af56807-caf8-4e24-85b7-a811cc38c14a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:40.284656 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af56807-caf8-4e24-85b7-a811cc38c14a None admin] PATH_INFO: `/v3/users/68c24e9c4a0541f4ba5264f7a0995b94` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:40.285800 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af56807-caf8-4e24-85b7-a811cc38c14a None admin] RBAC: Authorizing `identity:get_user(user_id=68c24e9c4a0541f4ba5264f7a0995b94)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:40.287262 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af56807-caf8-4e24-85b7-a811cc38c14a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:40.289405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 544/1089] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:41:40 2022] GET /identity/v3/users/68c24e9c4a0541f4ba5264f7a0995b94 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:40.295086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b982db5-b488-4c18-8232-26c1183ea23a None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:40.394292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b982db5-b488-4c18-8232-26c1183ea23a None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:40.428045 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dcb30-9dfd-4b12-9f22-6c86071b949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:40.429296 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dcb30-9dfd-4b12-9f22-6c86071b949e None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:40.429584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dcb30-9dfd-4b12-9f22-6c86071b949e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:40.429864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dcb30-9dfd-4b12-9f22-6c86071b949e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:40.432519 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:40.497768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dcb30-9dfd-4b12-9f22-6c86071b949e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:40.499237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dcb30-9dfd-4b12-9f22-6c86071b949e None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:40.596339 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 546/1090] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:41:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:41:40.602770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af56807-caf8-4e24-85b7-a811cc38c14a None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:40.667404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:40.704184 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af56807-caf8-4e24-85b7-a811cc38c14a None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:40.738403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8625b7d-8ba2-43c5-a044-65922175a7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:40.739769 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8625b7d-8ba2-43c5-a044-65922175a7bc None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:40.740081 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8625b7d-8ba2-43c5-a044-65922175a7bc None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:40.740325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8625b7d-8ba2-43c5-a044-65922175a7bc None admin] PATH_INFO: `/v3/projects/30d335fbc36747d7b53ea1e0d1612224` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:40.741514 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8625b7d-8ba2-43c5-a044-65922175a7bc None admin] RBAC: Authorizing `identity:get_project(project_id=30d335fbc36747d7b53ea1e0d1612224)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:40.742991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8625b7d-8ba2-43c5-a044-65922175a7bc None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:40.744662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 545/1091] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:41:40 2022] GET /identity/v3/projects/30d335fbc36747d7b53ea1e0d1612224 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:40.750959 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dcb30-9dfd-4b12-9f22-6c86071b949e None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:40.754104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59869393-ca71-47dd-a656-95e169dd5fa9 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:40.754412 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59869393-ca71-47dd-a656-95e169dd5fa9 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:40.754707 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59869393-ca71-47dd-a656-95e169dd5fa9 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:40.756029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 546/1092] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:41:40.760858 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739b933-b138-4869-9597-16a8b51bd49e None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:40.761148 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739b933-b138-4869-9597-16a8b51bd49e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:40.761432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739b933-b138-4869-9597-16a8b51bd49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:40.779184 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-8739b933-b138-4869-9597-16a8b51bd49e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:40.780389 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8739b933-b138-4869-9597-16a8b51bd49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:40.784798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:40.847210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 547/1093] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:41:40.850059 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dcb30-9dfd-4b12-9f22-6c86071b949e None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:40.871023 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739b933-b138-4869-9597-16a8b51bd49e None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:40.885632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b84c1-f73c-4886-9c99-44a021ffc388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:40.886254 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b84c1-f73c-4886-9c99-44a021ffc388 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:40.886571 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b84c1-f73c-4886-9c99-44a021ffc388 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:40.886858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b84c1-f73c-4886-9c99-44a021ffc388 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:40.887776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b84c1-f73c-4886-9c99-44a021ffc388 None admin] RBAC: Adding query filter params (role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.project.id=30d335fbc36747d7b53ea1e0d1612224, user.id=68c24e9c4a0541f4ba5264f7a0995b94) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:40.888088 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b84c1-f73c-4886-9c99-44a021ffc388 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:40.889522 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b84c1-f73c-4886-9c99-44a021ffc388 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:40.895354 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 547/1094] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:41:40 2022] GET /identity/v3/role_assignments?user.id=68c24e9c4a0541f4ba5264f7a0995b94&scope.project.id=30d335fbc36747d7b53ea1e0d1612224&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:40.937423 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:40.987930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739b933-b138-4869-9597-16a8b51bd49e None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:41.024534 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6183c85-08c2-42c9-bfa1-ab7445908f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:41.025195 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6183c85-08c2-42c9-bfa1-ab7445908f13 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:41.025480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6183c85-08c2-42c9-bfa1-ab7445908f13 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:41.025756 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6183c85-08c2-42c9-bfa1-ab7445908f13 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:41.036655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6183c85-08c2-42c9-bfa1-ab7445908f13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:41:41.041585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-a6183c85-08c2-42c9-bfa1-ab7445908f13 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:41:41.041585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:41.041585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:41.041585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:41.041585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:41.041585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:41.041585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:41.041585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:41.041585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:41.041585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:41.041585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:41.041585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:41.041585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:41:41.041585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:41:41.041585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:41:41.041585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:41:41.042561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:41:41.042561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:41:41.042561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:41:41.042561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:41:41.042561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:41.042561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:41.042561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:41.042561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:41.042561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:41.042561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:41.042561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:41.042561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:41.042561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:41.042561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:41.042561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:41.042561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:41.043387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:41.043387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:41.043387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:41.043387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:41.043387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:41:41.043387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:41:41.043387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:41:41.043387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:41:41.043387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:41:41.043387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:41:41.043387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:41:41.043387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:41.043387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 548/1095] 10.222.0.86 () {56 vars in 1120 bytes} [Tue Jul 26 14:41:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:41.049112 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b84c1-f73c-4886-9c99-44a021ffc388 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:41.145982 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:41.149947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b84c1-f73c-4886-9c99-44a021ffc388 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:41.184343 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dd5c4-f3d3-4ba9-af86-761960b1d7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:41.184962 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dd5c4-f3d3-4ba9-af86-761960b1d7ae None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:41.185244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dd5c4-f3d3-4ba9-af86-761960b1d7ae None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:41.185520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dd5c4-f3d3-4ba9-af86-761960b1d7ae None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:41.186231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208dd5c4-f3d3-4ba9-af86-761960b1d7ae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:41.186583 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208dd5c4-f3d3-4ba9-af86-761960b1d7ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:41.187954 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208dd5c4-f3d3-4ba9-af86-761960b1d7ae None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:41.196494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 548/1096] 10.222.0.86 () {56 vars in 1115 bytes} [Tue Jul 26 14:41:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:41.202203 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6183c85-08c2-42c9-bfa1-ab7445908f13 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:41.300462 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6183c85-08c2-42c9-bfa1-ab7445908f13 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:41.323963 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:41.334299 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ad8b5-e39c-46b6-8e42-7343b1ef9fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:41.336743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ad8b5-e39c-46b6-8e42-7343b1ef9fa8 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:41.336743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ad8b5-e39c-46b6-8e42-7343b1ef9fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:41.336743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ad8b5-e39c-46b6-8e42-7343b1ef9fa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:41.345995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ad8b5-e39c-46b6-8e42-7343b1ef9fa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:41.347465 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ad8b5-e39c-46b6-8e42-7343b1ef9fa8 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:41.363153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-e60ad8b5-e39c-46b6-8e42-7343b1ef9fa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:41.363153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:41.363153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:41.363153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:41.363153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:41.363153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:41.363153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:41.363153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:41.363153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:41.363153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:41.363153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:41.363153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:41.363153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:41.363153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:41.363153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:41.364210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:41.364210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:41.364210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:41.364210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:41.364210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:41.364210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:41.364210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:41.364210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:41.364210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:41.364210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:41.364210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:41.364210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:41.364210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:41.364210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:41.364210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:41.364210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:41.364210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:41.365534 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:41.365534 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:41.365534 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:41.365534 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:41.365534 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 549/1097] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:41.370579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dd5c4-f3d3-4ba9-af86-761960b1d7ae None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:41.470162 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dd5c4-f3d3-4ba9-af86-761960b1d7ae None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:41.503904 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719d80c-1203-4253-b2dd-aa5cd6e72f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:41.504520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719d80c-1203-4253-b2dd-aa5cd6e72f9e None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:41.504808 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719d80c-1203-4253-b2dd-aa5cd6e72f9e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:41.505093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719d80c-1203-4253-b2dd-aa5cd6e72f9e None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:41.505779 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719d80c-1203-4253-b2dd-aa5cd6e72f9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:41.506089 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719d80c-1203-4253-b2dd-aa5cd6e72f9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:41.508041 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719d80c-1203-4253-b2dd-aa5cd6e72f9e None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:41.519484 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 549/1098] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:41.525122 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ad8b5-e39c-46b6-8e42-7343b1ef9fa8 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:41.624144 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ad8b5-e39c-46b6-8e42-7343b1ef9fa8 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:41.657582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700421da-e9d8-416f-8020-f9742c1aa1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:41.658224 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700421da-e9d8-416f-8020-f9742c1aa1a6 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:41.658543 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700421da-e9d8-416f-8020-f9742c1aa1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:41.658888 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700421da-e9d8-416f-8020-f9742c1aa1a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:41.666786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700421da-e9d8-416f-8020-f9742c1aa1a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:41.668246 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700421da-e9d8-416f-8020-f9742c1aa1a6 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:41.679757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-700421da-e9d8-416f-8020-f9742c1aa1a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:41:41.679757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:41.679757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:41.679757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:41.679757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:41.679757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:41.679757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:41.679757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:41.679757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:41.679757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:41.679757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:41.679757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:41.679757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:41:41.679757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:41:41.679757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:41:41.679757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:41:41.680718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:41.680718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:41.680718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:41:41.680718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:41.680718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:41:41.680718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:41:41.680718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:41.680718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:41.680718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:41.680718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:41.680718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:41.680718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:41.680718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:41.680718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:41.680718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:41.680718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:41.680718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:41.680718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:41.686964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:41.686964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:41.686964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:41:41.686964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:41:41.686964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:41:41.686964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:41:41.686964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:41:41.686964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:41:41.686964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:41:41.686964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:41.686964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 550/1099] 10.222.0.86 () {56 vars in 1093 bytes} [Tue Jul 26 14:41:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:41:41.687562 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719d80c-1203-4253-b2dd-aa5cd6e72f9e None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:41.709008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:41.792156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719d80c-1203-4253-b2dd-aa5cd6e72f9e None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:41.824797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7c38d-fdb0-4135-abca-6b957d021b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:41.825406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7c38d-fdb0-4135-abca-6b957d021b11 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:41.825685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7c38d-fdb0-4135-abca-6b957d021b11 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:41.825960 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7c38d-fdb0-4135-abca-6b957d021b11 None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:41.826778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7c38d-fdb0-4135-abca-6b957d021b11 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:41.827087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7c38d-fdb0-4135-abca-6b957d021b11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:41.828516 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7c38d-fdb0-4135-abca-6b957d021b11 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:41.845010 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 550/1100] 10.222.0.86 () {56 vars in 1133 bytes} [Tue Jul 26 14:41:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:41.852412 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700421da-e9d8-416f-8020-f9742c1aa1a6 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:41.887529 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:41.950805 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700421da-e9d8-416f-8020-f9742c1aa1a6 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:41.984098 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9908a-972a-4886-83ba-2db8c4d7a513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:41.984721 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9908a-972a-4886-83ba-2db8c4d7a513 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:41.985006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9908a-972a-4886-83ba-2db8c4d7a513 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:41.985284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9908a-972a-4886-83ba-2db8c4d7a513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:42.066571 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9908a-972a-4886-83ba-2db8c4d7a513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:42.067936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9908a-972a-4886-83ba-2db8c4d7a513 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:42.101741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:42.166004 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 551/1101] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:41:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 14:41:42.171732 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7c38d-fdb0-4135-abca-6b957d021b11 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:42.250582 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:42.271400 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7c38d-fdb0-4135-abca-6b957d021b11 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:42.306060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c52ba3-d841-4a2d-b7f0-6521999657fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:42.306733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c52ba3-d841-4a2d-b7f0-6521999657fd None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:42.307021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c52ba3-d841-4a2d-b7f0-6521999657fd None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:42.307298 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c52ba3-d841-4a2d-b7f0-6521999657fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:42.317319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c52ba3-d841-4a2d-b7f0-6521999657fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:42.318765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c52ba3-d841-4a2d-b7f0-6521999657fd None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:42.333164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-f0c52ba3-d841-4a2d-b7f0-6521999657fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:42.333164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:42.333164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:42.333164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:42.333164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:42.333164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:42.333164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:42.333164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:42.333164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:42.333164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:42.333164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:42.333164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:42.333164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:41:42.333164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:41:42.333164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:41:42.334173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:41:42.334173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:42.334173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:42.334173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:42.334173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:42.334173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:42.334173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:42.334173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:42.334173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:42.334173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:42.334173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:42.334173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:42.334173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:42.334173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:42.334173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:42.334173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:42.334173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:42.336053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:41:42.336053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:41:42.336053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:41:42.336053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:42.336053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 551/1102] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:42.340538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9908a-972a-4886-83ba-2db8c4d7a513 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:42.448735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9908a-972a-4886-83ba-2db8c4d7a513 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:42.482769 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55b187-7ab6-40dd-b541-eb2e0703cc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:42.483391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55b187-7ab6-40dd-b541-eb2e0703cc10 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:42.483677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55b187-7ab6-40dd-b541-eb2e0703cc10 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:42.483955 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55b187-7ab6-40dd-b541-eb2e0703cc10 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:42.484645 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55b187-7ab6-40dd-b541-eb2e0703cc10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:42.484951 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55b187-7ab6-40dd-b541-eb2e0703cc10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:42.486323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55b187-7ab6-40dd-b541-eb2e0703cc10 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:42.488686 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:42.500627 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 552/1103] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:42.506439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c52ba3-d841-4a2d-b7f0-6521999657fd None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:42.606458 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c52ba3-d841-4a2d-b7f0-6521999657fd None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:42.634828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:42.640744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e162df4-fea3-48d2-89e0-801b40ac2ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:42.641397 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e162df4-fea3-48d2-89e0-801b40ac2ff7 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:42.647502 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e162df4-fea3-48d2-89e0-801b40ac2ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:42.647502 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e162df4-fea3-48d2-89e0-801b40ac2ff7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:42.648883 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e162df4-fea3-48d2-89e0-801b40ac2ff7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:42.650324 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e162df4-fea3-48d2-89e0-801b40ac2ff7 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:42.661667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-3e162df4-fea3-48d2-89e0-801b40ac2ff7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:42.661667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:42.661667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:42.661667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:42.661667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:42.661667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:42.661667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:42.661667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:42.661667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:42.661667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:42.661667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:42.661667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:42.661667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:41:42.661667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:41:42.661667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:41:42.662630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:41:42.662630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:42.662630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:42.662630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:42.662630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:42.662630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:42.662630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:42.662630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:42.662630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:42.662630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:42.662630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:42.662630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:42.662630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:42.662630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:42.662630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:42.662630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:42.662630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:42.664000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:41:42.664000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:41:42.664000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:41:42.664000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:41:42.664000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:41:42.664000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:41:42.664000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:41:42.664000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:41:42.664000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 552/1104] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:41:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:42.669197 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55b187-7ab6-40dd-b541-eb2e0703cc10 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:42.771098 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55b187-7ab6-40dd-b541-eb2e0703cc10 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:42.806126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157de2d-add1-4cc6-84b3-7ce6b9b01b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:42.806805 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157de2d-add1-4cc6-84b3-7ce6b9b01b8a None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:42.807091 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157de2d-add1-4cc6-84b3-7ce6b9b01b8a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:42.807369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157de2d-add1-4cc6-84b3-7ce6b9b01b8a None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:42.808142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157de2d-add1-4cc6-84b3-7ce6b9b01b8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:42.808454 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157de2d-add1-4cc6-84b3-7ce6b9b01b8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:42.809916 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157de2d-add1-4cc6-84b3-7ce6b9b01b8a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:42.823551 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 553/1105] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:41:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:41:42.829762 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e162df4-fea3-48d2-89e0-801b40ac2ff7 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:42.936937 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e162df4-fea3-48d2-89e0-801b40ac2ff7 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:42.970598 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854a491-8df2-41b5-b073-812d8dbb0a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:42.971223 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854a491-8df2-41b5-b073-812d8dbb0a20 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:42.971517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854a491-8df2-41b5-b073-812d8dbb0a20 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:42.971795 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854a491-8df2-41b5-b073-812d8dbb0a20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:42.972574 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854a491-8df2-41b5-b073-812d8dbb0a20 None admin] RBAC: Adding query filter params (role.id=392e2ed96a59406fb49190dce5ee2a85, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=d12fc26e640f4337b4a4da60cc4d9adc) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:42.972886 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854a491-8df2-41b5-b073-812d8dbb0a20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:42.974318 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854a491-8df2-41b5-b073-812d8dbb0a20 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:42.980330 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 553/1106] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:41:42 2022] GET /identity/v3/role_assignments?user.id=d12fc26e640f4337b4a4da60cc4d9adc&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=392e2ed96a59406fb49190dce5ee2a85 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:42.988254 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53264dc5-9954-4e4b-b25e-7f9b8ed669ef None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:42.988798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53264dc5-9954-4e4b-b25e-7f9b8ed669ef None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:42.988798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53264dc5-9954-4e4b-b25e-7f9b8ed669ef None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:42.990200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 554/1107] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:42.996431 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d984c8-bb00-4e12-9d92-0242d9728d2a None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:42.996717 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d984c8-bb00-4e12-9d92-0242d9728d2a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:42.996997 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d984c8-bb00-4e12-9d92-0242d9728d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:43.028083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-74d984c8-bb00-4e12-9d92-0242d9728d2a None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:43.029298 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-74d984c8-bb00-4e12-9d92-0242d9728d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:43.082831 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:43.101767 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 554/1108] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:43.126484 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53264dc5-9954-4e4b-b25e-7f9b8ed669ef None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:43.185615 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:43.234842 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53264dc5-9954-4e4b-b25e-7f9b8ed669ef None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:43.270481 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592db4c-ab49-4c75-9819-1b1b2e9b8606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:43.271210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592db4c-ab49-4c75-9819-1b1b2e9b8606 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:43.271491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592db4c-ab49-4c75-9819-1b1b2e9b8606 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:43.271768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592db4c-ab49-4c75-9819-1b1b2e9b8606 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:43.273508 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592db4c-ab49-4c75-9819-1b1b2e9b8606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:43.274966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592db4c-ab49-4c75-9819-1b1b2e9b8606 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:43.276583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 555/1109] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:43.282544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d984c8-bb00-4e12-9d92-0242d9728d2a None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:43.386459 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d984c8-bb00-4e12-9d92-0242d9728d2a None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:43.422536 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e8fef-8ed6-4eca-8ba9-62533ad69ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:43.423171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e8fef-8ed6-4eca-8ba9-62533ad69ffa None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:43.423459 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e8fef-8ed6-4eca-8ba9-62533ad69ffa None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:43.423740 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e8fef-8ed6-4eca-8ba9-62533ad69ffa None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:43.424449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e8fef-8ed6-4eca-8ba9-62533ad69ffa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:43.425899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e8fef-8ed6-4eca-8ba9-62533ad69ffa None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:43.518285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 555/1110] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jul 26 14:41:43 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:41:45.548798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba9d6-6030-4881-bc89-26c98c0b9b42 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:45.549350 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba9d6-6030-4881-bc89-26c98c0b9b42 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:45.549350 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba9d6-6030-4881-bc89-26c98c0b9b42 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:45.550735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 556/1111] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:45.555738 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963d8e7-36d0-40d8-8d9c-3bd11469c0bb None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:45.556158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963d8e7-36d0-40d8-8d9c-3bd11469c0bb None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:45.556318 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963d8e7-36d0-40d8-8d9c-3bd11469c0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:45.575337 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-b963d8e7-36d0-40d8-8d9c-3bd11469c0bb None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:45.576523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-b963d8e7-36d0-40d8-8d9c-3bd11469c0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:45.610203 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:45.641972 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 556/1112] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:45.665128 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fba9d6-6030-4881-bc89-26c98c0b9b42 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:45.768974 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fba9d6-6030-4881-bc89-26c98c0b9b42 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:45.791211 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:45.801635 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251730f-b617-4941-89a2-a94765f8ecfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:45.802212 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251730f-b617-4941-89a2-a94765f8ecfc None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:45.802530 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251730f-b617-4941-89a2-a94765f8ecfc None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:45.802812 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251730f-b617-4941-89a2-a94765f8ecfc None admin] PATH_INFO: `/v3/roles/9cc7bf3bc6aa4b33ab6dee0dd67e1846` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:45.804753 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251730f-b617-4941-89a2-a94765f8ecfc None admin] RBAC: Authorizing `identity:get_role(role_id=9cc7bf3bc6aa4b33ab6dee0dd67e1846)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:45.806119 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251730f-b617-4941-89a2-a94765f8ecfc None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:45.807502 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 557/1113] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:41:45 2022] GET /identity/v3/roles/9cc7bf3bc6aa4b33ab6dee0dd67e1846 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:45.813359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963d8e7-36d0-40d8-8d9c-3bd11469c0bb None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:45.911473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963d8e7-36d0-40d8-8d9c-3bd11469c0bb None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:45.945480 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf20b5-9c19-4dcc-a8ce-643ff1875488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:45.946138 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf20b5-9c19-4dcc-a8ce-643ff1875488 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:45.946474 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf20b5-9c19-4dcc-a8ce-643ff1875488 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:45.946772 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf20b5-9c19-4dcc-a8ce-643ff1875488 None admin] PATH_INFO: `/v3/users/e85dfe0abf884bfabfe7e5682b201a7f` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:45.960937 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf20b5-9c19-4dcc-a8ce-643ff1875488 None admin] RBAC: Authorizing `identity:get_user(user_id=e85dfe0abf884bfabfe7e5682b201a7f)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:45.967133 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf20b5-9c19-4dcc-a8ce-643ff1875488 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:45.967133 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 557/1114] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:41:45 2022] GET /identity/v3/users/e85dfe0abf884bfabfe7e5682b201a7f => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:45.970045 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251730f-b617-4941-89a2-a94765f8ecfc None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:46.141086 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251730f-b617-4941-89a2-a94765f8ecfc None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:46.256228 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557031b-ebd6-4111-aa76-9fb1cb8e53ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:46.257329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557031b-ebd6-4111-aa76-9fb1cb8e53ad None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:46.257614 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557031b-ebd6-4111-aa76-9fb1cb8e53ad None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:46.257888 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557031b-ebd6-4111-aa76-9fb1cb8e53ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:46.324301 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:46.333436 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557031b-ebd6-4111-aa76-9fb1cb8e53ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:46.335586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557031b-ebd6-4111-aa76-9fb1cb8e53ad None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:46.434371 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 558/1115] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:41:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:41:46.440246 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf20b5-9c19-4dcc-a8ce-643ff1875488 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:46.468404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:46.539467 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf20b5-9c19-4dcc-a8ce-643ff1875488 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:46.572750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7d9c1-a2a9-4de5-b5c4-a054f1567837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:46.573392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7d9c1-a2a9-4de5-b5c4-a054f1567837 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:46.573676 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7d9c1-a2a9-4de5-b5c4-a054f1567837 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:46.573954 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7d9c1-a2a9-4de5-b5c4-a054f1567837 None admin] PATH_INFO: `/v3/projects/30d335fbc36747d7b53ea1e0d1612224` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:46.575134 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7d9c1-a2a9-4de5-b5c4-a054f1567837 None admin] RBAC: Authorizing `identity:get_project(project_id=30d335fbc36747d7b53ea1e0d1612224)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:46.576574 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7d9c1-a2a9-4de5-b5c4-a054f1567837 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:46.578239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 558/1116] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:41:46 2022] GET /identity/v3/projects/30d335fbc36747d7b53ea1e0d1612224 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:46.584400 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557031b-ebd6-4111-aa76-9fb1cb8e53ad None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:46.687083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:46.696812 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557031b-ebd6-4111-aa76-9fb1cb8e53ad None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:46.731452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b2228-f63b-45a0-9dfe-3cef3c098770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:46.732063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b2228-f63b-45a0-9dfe-3cef3c098770 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:46.732345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b2228-f63b-45a0-9dfe-3cef3c098770 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:46.732622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b2228-f63b-45a0-9dfe-3cef3c098770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:46.733404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b2228-f63b-45a0-9dfe-3cef3c098770 None admin] RBAC: Adding query filter params (role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846, scope.project.id=30d335fbc36747d7b53ea1e0d1612224, user.id=e85dfe0abf884bfabfe7e5682b201a7f) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:46.733720 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b2228-f63b-45a0-9dfe-3cef3c098770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:46.735216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b2228-f63b-45a0-9dfe-3cef3c098770 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:46.740545 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 559/1117] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:41:46 2022] GET /identity/v3/role_assignments?user.id=e85dfe0abf884bfabfe7e5682b201a7f&scope.project.id=30d335fbc36747d7b53ea1e0d1612224&role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:48.706895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382dbbd-51a7-48d0-bb3d-40fcda1817e2 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:48.707385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382dbbd-51a7-48d0-bb3d-40fcda1817e2 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:48.707497 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382dbbd-51a7-48d0-bb3d-40fcda1817e2 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:48.708823 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 559/1118] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:48.713924 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdbcec-b6fc-43ac-b9fb-b7c9b19f47e6 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:48.714305 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdbcec-b6fc-43ac-b9fb-b7c9b19f47e6 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:48.714524 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdbcec-b6fc-43ac-b9fb-b7c9b19f47e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:48.732794 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-fbbdbcec-b6fc-43ac-b9fb-b7c9b19f47e6 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:48.733972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-fbbdbcec-b6fc-43ac-b9fb-b7c9b19f47e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:48.800087 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 560/1119] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:48.822127 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382dbbd-51a7-48d0-bb3d-40fcda1817e2 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:48.915987 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:48.926489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382dbbd-51a7-48d0-bb3d-40fcda1817e2 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:48.963481 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a69c4-81ad-40e9-9e8f-ae9a6d0b06f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:48.964124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a69c4-81ad-40e9-9e8f-ae9a6d0b06f4 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:48.964413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a69c4-81ad-40e9-9e8f-ae9a6d0b06f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:48.964694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a69c4-81ad-40e9-9e8f-ae9a6d0b06f4 None admin] PATH_INFO: `/v3/roles/9cc7bf3bc6aa4b33ab6dee0dd67e1846` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:48.966135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a69c4-81ad-40e9-9e8f-ae9a6d0b06f4 None admin] RBAC: Authorizing `identity:get_role(role_id=9cc7bf3bc6aa4b33ab6dee0dd67e1846)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:48.967554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a69c4-81ad-40e9-9e8f-ae9a6d0b06f4 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:48.968906 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 560/1120] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:41:48 2022] GET /identity/v3/roles/9cc7bf3bc6aa4b33ab6dee0dd67e1846 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:48.974881 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdbcec-b6fc-43ac-b9fb-b7c9b19f47e6 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:49.056016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:49.070191 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdbcec-b6fc-43ac-b9fb-b7c9b19f47e6 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:49.104225 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e504fd-3131-4a72-bc1e-3e64632b9161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:49.104865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e504fd-3131-4a72-bc1e-3e64632b9161 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:49.105148 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e504fd-3131-4a72-bc1e-3e64632b9161 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:49.105424 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e504fd-3131-4a72-bc1e-3e64632b9161 None admin] PATH_INFO: `/v3/users/e85dfe0abf884bfabfe7e5682b201a7f` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:49.106610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e504fd-3131-4a72-bc1e-3e64632b9161 None admin] RBAC: Authorizing `identity:get_user(user_id=e85dfe0abf884bfabfe7e5682b201a7f)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:49.108040 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e504fd-3131-4a72-bc1e-3e64632b9161 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:49.109652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 561/1121] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:41:48 2022] GET /identity/v3/users/e85dfe0abf884bfabfe7e5682b201a7f => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:49.115393 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a69c4-81ad-40e9-9e8f-ae9a6d0b06f4 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:49.213086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a69c4-81ad-40e9-9e8f-ae9a6d0b06f4 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:49.245871 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a67d4d-855b-4521-9dc1-b8633104a5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:49.246529 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a67d4d-855b-4521-9dc1-b8633104a5df None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:49.246815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a67d4d-855b-4521-9dc1-b8633104a5df None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:49.247092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a67d4d-855b-4521-9dc1-b8633104a5df None admin] PATH_INFO: `/v3/projects/30d335fbc36747d7b53ea1e0d1612224` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:49.248231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a67d4d-855b-4521-9dc1-b8633104a5df None admin] RBAC: Authorizing `identity:get_project(project_id=30d335fbc36747d7b53ea1e0d1612224)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:49.249917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a67d4d-855b-4521-9dc1-b8633104a5df None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:49.251583 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 561/1122] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:41:49 2022] GET /identity/v3/projects/30d335fbc36747d7b53ea1e0d1612224 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:49.257909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e504fd-3131-4a72-bc1e-3e64632b9161 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:49.357259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e504fd-3131-4a72-bc1e-3e64632b9161 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:49.390472 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b9a5d-6b5b-4143-beef-f2753a57cd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:49.391139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b9a5d-6b5b-4143-beef-f2753a57cd0a None admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:49.391426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b9a5d-6b5b-4143-beef-f2753a57cd0a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:49.391703 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b9a5d-6b5b-4143-beef-f2753a57cd0a None admin] PATH_INFO: `/v3/projects/30d335fbc36747d7b53ea1e0d1612224/users/e85dfe0abf884bfabfe7e5682b201a7f/roles/9cc7bf3bc6aa4b33ab6dee0dd67e1846` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:49.393853 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b9a5d-6b5b-4143-beef-f2753a57cd0a None admin] RBAC: Authorizing `identity:create_grant(project_id=30d335fbc36747d7b53ea1e0d1612224, user_id=e85dfe0abf884bfabfe7e5682b201a7f, role_id=9cc7bf3bc6aa4b33ab6dee0dd67e1846)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:49.395300 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b9a5d-6b5b-4143-beef-f2753a57cd0a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:49.466805 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 562/1123] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:41:49 2022] PUT /identity/v3/projects/30d335fbc36747d7b53ea1e0d1612224/users/e85dfe0abf884bfabfe7e5682b201a7f/roles/9cc7bf3bc6aa4b33ab6dee0dd67e1846 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:41:51.440969 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd70a72-c011-4292-a4a9-03eb67cfbc5e None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:51.441524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd70a72-c011-4292-a4a9-03eb67cfbc5e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:51.441524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd70a72-c011-4292-a4a9-03eb67cfbc5e None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:51.442908 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 562/1124] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:51.448022 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a305d9-8069-4de0-9af9-f83b8dfb220b None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:51.456182 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a305d9-8069-4de0-9af9-f83b8dfb220b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:51.456182 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a305d9-8069-4de0-9af9-f83b8dfb220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:51.466203 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-e8a305d9-8069-4de0-9af9-f83b8dfb220b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:51.467409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e8a305d9-8069-4de0-9af9-f83b8dfb220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:51.476946 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:51.533261 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 563/1125] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:51.556662 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd70a72-c011-4292-a4a9-03eb67cfbc5e None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:51.588199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:51.658933 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd70a72-c011-4292-a4a9-03eb67cfbc5e None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:51.694529 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c58d9-1c2f-42bf-9b23-cab0109669f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:51.695109 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c58d9-1c2f-42bf-9b23-cab0109669f5 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:51.695395 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c58d9-1c2f-42bf-9b23-cab0109669f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:51.695678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c58d9-1c2f-42bf-9b23-cab0109669f5 None admin] PATH_INFO: `/v3/roles/9cc7bf3bc6aa4b33ab6dee0dd67e1846` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:51.697112 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c58d9-1c2f-42bf-9b23-cab0109669f5 None admin] RBAC: Authorizing `identity:get_role(role_id=9cc7bf3bc6aa4b33ab6dee0dd67e1846)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:51.698523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c58d9-1c2f-42bf-9b23-cab0109669f5 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:51.699877 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 563/1126] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:41:51 2022] GET /identity/v3/roles/9cc7bf3bc6aa4b33ab6dee0dd67e1846 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:51.705740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a305d9-8069-4de0-9af9-f83b8dfb220b None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:51.801467 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a305d9-8069-4de0-9af9-f83b8dfb220b None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:51.835284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78841120-1789-49ea-8e80-385ababf9690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:51.835925 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78841120-1789-49ea-8e80-385ababf9690 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:51.836210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78841120-1789-49ea-8e80-385ababf9690 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:51.836486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78841120-1789-49ea-8e80-385ababf9690 None admin] PATH_INFO: `/v3/users/e85dfe0abf884bfabfe7e5682b201a7f` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:51.837634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78841120-1789-49ea-8e80-385ababf9690 None admin] RBAC: Authorizing `identity:get_user(user_id=e85dfe0abf884bfabfe7e5682b201a7f)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:51.839113 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78841120-1789-49ea-8e80-385ababf9690 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:51.840696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 564/1127] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:41:51 2022] GET /identity/v3/users/e85dfe0abf884bfabfe7e5682b201a7f => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:51.846656 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c58d9-1c2f-42bf-9b23-cab0109669f5 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:51.948153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:51.950978 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c58d9-1c2f-42bf-9b23-cab0109669f5 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:51.985846 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17928c4-9b76-46bd-980e-5832bf96d7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:51.986501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17928c4-9b76-46bd-980e-5832bf96d7a1 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:51.987014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17928c4-9b76-46bd-980e-5832bf96d7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:51.987348 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17928c4-9b76-46bd-980e-5832bf96d7a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:52.054038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17928c4-9b76-46bd-980e-5832bf96d7a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:52.055510 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17928c4-9b76-46bd-980e-5832bf96d7a1 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:52.172540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:52.176210 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 564/1128] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:41:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:41:52.182741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78841120-1789-49ea-8e80-385ababf9690 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:52.197535 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:52.286616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78841120-1789-49ea-8e80-385ababf9690 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:52.322807 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ed402-3c8f-4653-9a0b-cb3bba1de51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:52.323559 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ed402-3c8f-4653-9a0b-cb3bba1de51d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:52.323839 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ed402-3c8f-4653-9a0b-cb3bba1de51d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:52.324111 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ed402-3c8f-4653-9a0b-cb3bba1de51d None admin] PATH_INFO: `/v3/projects/30d335fbc36747d7b53ea1e0d1612224` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:52.325328 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ed402-3c8f-4653-9a0b-cb3bba1de51d None admin] RBAC: Authorizing `identity:get_project(project_id=30d335fbc36747d7b53ea1e0d1612224)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:52.326772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ed402-3c8f-4653-9a0b-cb3bba1de51d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:52.328443 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 565/1129] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:41:52 2022] GET /identity/v3/projects/30d335fbc36747d7b53ea1e0d1612224 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:52.335526 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17928c4-9b76-46bd-980e-5832bf96d7a1 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:52.444163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17928c4-9b76-46bd-980e-5832bf96d7a1 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:52.481563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cffa5c-4048-41c1-bd0a-5d2bd024ce86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:52.482180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cffa5c-4048-41c1-bd0a-5d2bd024ce86 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:52.482492 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cffa5c-4048-41c1-bd0a-5d2bd024ce86 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:52.482776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cffa5c-4048-41c1-bd0a-5d2bd024ce86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:52.483564 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cffa5c-4048-41c1-bd0a-5d2bd024ce86 None admin] RBAC: Adding query filter params (role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846, scope.project.id=30d335fbc36747d7b53ea1e0d1612224, user.id=e85dfe0abf884bfabfe7e5682b201a7f) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:52.483879 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cffa5c-4048-41c1-bd0a-5d2bd024ce86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:52.485328 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cffa5c-4048-41c1-bd0a-5d2bd024ce86 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:52.491836 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 565/1130] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:41:52 2022] GET /identity/v3/role_assignments?user.id=e85dfe0abf884bfabfe7e5682b201a7f&scope.project.id=30d335fbc36747d7b53ea1e0d1612224&role.id=9cc7bf3bc6aa4b33ab6dee0dd67e1846 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:54.541463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa71a2-df2c-47d8-bbae-f78de7e6d6e9 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:54.542028 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa71a2-df2c-47d8-bbae-f78de7e6d6e9 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:54.542028 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa71a2-df2c-47d8-bbae-f78de7e6d6e9 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:54.543416 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 566/1131] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:54.548520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f19609-9875-4c0e-b074-3177a7084cf9 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:54.548890 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f19609-9875-4c0e-b074-3177a7084cf9 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:54.549075 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f19609-9875-4c0e-b074-3177a7084cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:54.567370 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-01f19609-9875-4c0e-b074-3177a7084cf9 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:54.568551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-01f19609-9875-4c0e-b074-3177a7084cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:54.625815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:54.633924 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 566/1132] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:54.656287 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa71a2-df2c-47d8-bbae-f78de7e6d6e9 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:54.736915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:54.756903 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa71a2-df2c-47d8-bbae-f78de7e6d6e9 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:54.790600 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44f957-be56-4f4d-b55f-f408521b0628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:54.791233 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44f957-be56-4f4d-b55f-f408521b0628 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:54.791562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44f957-be56-4f4d-b55f-f408521b0628 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:54.791788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44f957-be56-4f4d-b55f-f408521b0628 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:54.792929 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44f957-be56-4f4d-b55f-f408521b0628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:54.794358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44f957-be56-4f4d-b55f-f408521b0628 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:54.795970 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 567/1133] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:54.801835 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f19609-9875-4c0e-b074-3177a7084cf9 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:54.898177 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f19609-9875-4c0e-b074-3177a7084cf9 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:54.932092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9eca8-450f-4f58-9fc3-490b6292d3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:54.932710 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9eca8-450f-4f58-9fc3-490b6292d3e5 None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:54.932993 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9eca8-450f-4f58-9fc3-490b6292d3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:54.933269 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9eca8-450f-4f58-9fc3-490b6292d3e5 None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:54.933952 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9eca8-450f-4f58-9fc3-490b6292d3e5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:54.935414 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9eca8-450f-4f58-9fc3-490b6292d3e5 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:55.004258 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 567/1134] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jul 26 14:41:54 2022] POST /identity/v3/projects => generated 311 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:41:57.043781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84319e4-69d1-4fe6-8b01-f990e09da82e None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:57.044305 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84319e4-69d1-4fe6-8b01-f990e09da82e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:57.044305 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84319e4-69d1-4fe6-8b01-f990e09da82e None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:57.045683 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 568/1135] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:57.051279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6f484-12a3-4bcd-bf4e-c9dfeb8af807 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:57.051725 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6f484-12a3-4bcd-bf4e-c9dfeb8af807 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:57.051906 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6f484-12a3-4bcd-bf4e-c9dfeb8af807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:57.071967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-a2d6f484-12a3-4bcd-bf4e-c9dfeb8af807 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:57.073392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a2d6f484-12a3-4bcd-bf4e-c9dfeb8af807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:57.114024 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:57.138342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 568/1136] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:57.162861 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84319e4-69d1-4fe6-8b01-f990e09da82e None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:57.262561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84319e4-69d1-4fe6-8b01-f990e09da82e None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:57.294690 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80084bdd-1416-409d-8928-9867fd2ccbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:57.295263 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80084bdd-1416-409d-8928-9867fd2ccbc5 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:57.295549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80084bdd-1416-409d-8928-9867fd2ccbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:57.295828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80084bdd-1416-409d-8928-9867fd2ccbc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:57.296974 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80084bdd-1416-409d-8928-9867fd2ccbc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:57.298429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80084bdd-1416-409d-8928-9867fd2ccbc5 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:57.300016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 569/1137] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:41:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:57.307740 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6f484-12a3-4bcd-bf4e-c9dfeb8af807 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:57.403540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6f484-12a3-4bcd-bf4e-c9dfeb8af807 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:57.436699 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80071ae-7a49-4bee-8249-b76e39c23ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:57.437308 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80071ae-7a49-4bee-8249-b76e39c23ab2 None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:57.437587 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80071ae-7a49-4bee-8249-b76e39c23ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:57.437860 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80071ae-7a49-4bee-8249-b76e39c23ab2 None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:57.438573 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80071ae-7a49-4bee-8249-b76e39c23ab2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:57.440047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80071ae-7a49-4bee-8249-b76e39c23ab2 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:41:57.516899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 569/1138] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jul 26 14:41:57 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:41:59.586628 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ff0d8-158d-4d41-bd2f-d92c910a225d None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:59.587157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ff0d8-158d-4d41-bd2f-d92c910a225d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:59.587157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ff0d8-158d-4d41-bd2f-d92c910a225d None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:59.588528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 570/1139] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:41:59.593646 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556aef73-534b-48ea-ba37-c7390a9d5810 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:59.594077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556aef73-534b-48ea-ba37-c7390a9d5810 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:59.594194 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556aef73-534b-48ea-ba37-c7390a9d5810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:59.612559 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-556aef73-534b-48ea-ba37-c7390a9d5810 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:41:59.613734 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-556aef73-534b-48ea-ba37-c7390a9d5810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:41:59.641131 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:59.681264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 570/1140] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:41:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:41:59.703867 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ff0d8-158d-4d41-bd2f-d92c910a225d None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:59.722315 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:59.804069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ff0d8-158d-4d41-bd2f-d92c910a225d None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:59.836801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408f37c-8095-4113-a7f4-1a2bef0148c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:59.837375 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408f37c-8095-4113-a7f4-1a2bef0148c2 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:59.837660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408f37c-8095-4113-a7f4-1a2bef0148c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:59.837939 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408f37c-8095-4113-a7f4-1a2bef0148c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:59.847746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408f37c-8095-4113-a7f4-1a2bef0148c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:41:59.853176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-1408f37c-8095-4113-a7f4-1a2bef0148c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:41:59.853176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:41:59.853176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:41:59.853176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:41:59.853176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:41:59.853176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:41:59.853176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:41:59.853176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:41:59.853176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:41:59.853176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:41:59.853176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:41:59.853176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:41:59.853176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:41:59.853176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:41:59.853176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:41:59.853176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:41:59.854325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:41:59.854325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:41:59.854325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:41:59.854325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:41:59.854325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:41:59.854325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:41:59.854325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:41:59.854325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:41:59.854325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:41:59.854325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:41:59.854325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:41:59.854325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:41:59.854325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:41:59.854325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:41:59.854325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:41:59.854325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:41:59.855563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:41:59.855563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:41:59.855563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:41:59.855563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:41:59.855563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:41:59.855563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:41:59.855563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:41:59.855563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:41:59.855563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:41:59.855563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:41:59.855563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:41:59.855563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:41:59.855563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 571/1141] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:41:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:41:59.860329 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556aef73-534b-48ea-ba37-c7390a9d5810 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:41:59.956938 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556aef73-534b-48ea-ba37-c7390a9d5810 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:41:59.989490 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc07c5d-e972-43b7-8a2a-3e62266d5068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:41:59.990099 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc07c5d-e972-43b7-8a2a-3e62266d5068 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:41:59.990407 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc07c5d-e972-43b7-8a2a-3e62266d5068 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:41:59.991203 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc07c5d-e972-43b7-8a2a-3e62266d5068 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:41:59.991914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc07c5d-e972-43b7-8a2a-3e62266d5068 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:41:59.992225 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc07c5d-e972-43b7-8a2a-3e62266d5068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:41:59.993603 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc07c5d-e972-43b7-8a2a-3e62266d5068 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:00.001739 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 571/1142] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:41:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:00.008132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408f37c-8095-4113-a7f4-1a2bef0148c2 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:00.087374 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:00.110351 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408f37c-8095-4113-a7f4-1a2bef0148c2 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:00.145220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a54d3-eaad-4107-8659-4ff5bb13a30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:00.145847 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a54d3-eaad-4107-8659-4ff5bb13a30f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:00.146125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a54d3-eaad-4107-8659-4ff5bb13a30f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:00.146480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a54d3-eaad-4107-8659-4ff5bb13a30f None admin] PATH_INFO: `/v3/users/a4dbc1fceb6e49788914e2094c4d381b` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:00.160202 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a54d3-eaad-4107-8659-4ff5bb13a30f None admin] RBAC: Authorizing `identity:get_user(user_id=a4dbc1fceb6e49788914e2094c4d381b)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:00.161632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a54d3-eaad-4107-8659-4ff5bb13a30f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:00.163824 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 572/1143] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:42:00 2022] GET /identity/v3/users/a4dbc1fceb6e49788914e2094c4d381b => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:00.169709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc07c5d-e972-43b7-8a2a-3e62266d5068 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:00.195413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:00.269744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc07c5d-e972-43b7-8a2a-3e62266d5068 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:00.302731 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f0362-d9c9-4daf-bc31-a628b51a9f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:00.303349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f0362-d9c9-4daf-bc31-a628b51a9f90 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:00.303628 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f0362-d9c9-4daf-bc31-a628b51a9f90 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:00.303898 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f0362-d9c9-4daf-bc31-a628b51a9f90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:00.369850 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f0362-d9c9-4daf-bc31-a628b51a9f90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:00.371258 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f0362-d9c9-4daf-bc31-a628b51a9f90 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:00.394840 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:00.469019 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 572/1144] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:42:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:42:00.474946 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a54d3-eaad-4107-8659-4ff5bb13a30f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:00.571098 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a54d3-eaad-4107-8659-4ff5bb13a30f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:00.605638 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8f255-4796-4280-84d7-fb9a2d322e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:00.606289 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8f255-4796-4280-84d7-fb9a2d322e6b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:00.606591 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8f255-4796-4280-84d7-fb9a2d322e6b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:00.606868 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8f255-4796-4280-84d7-fb9a2d322e6b None admin] PATH_INFO: `/v3/projects/7c7a36df78784a6d88dbf54d0ee01661` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:00.608044 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8f255-4796-4280-84d7-fb9a2d322e6b None admin] RBAC: Authorizing `identity:get_project(project_id=7c7a36df78784a6d88dbf54d0ee01661)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:00.609471 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8f255-4796-4280-84d7-fb9a2d322e6b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:00.611192 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 573/1145] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:42:00 2022] GET /identity/v3/projects/7c7a36df78784a6d88dbf54d0ee01661 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:00.617256 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f0362-d9c9-4daf-bc31-a628b51a9f90 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:00.717462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f0362-d9c9-4daf-bc31-a628b51a9f90 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:00.739953 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:00.751039 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05206409-df8b-4de9-8b33-b5c2230ad221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:00.754043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05206409-df8b-4de9-8b33-b5c2230ad221 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:00.754043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05206409-df8b-4de9-8b33-b5c2230ad221 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:00.754043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05206409-df8b-4de9-8b33-b5c2230ad221 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:00.754043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05206409-df8b-4de9-8b33-b5c2230ad221 None admin] RBAC: Adding query filter params (role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.project.id=7c7a36df78784a6d88dbf54d0ee01661, user.id=a4dbc1fceb6e49788914e2094c4d381b) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:00.754043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05206409-df8b-4de9-8b33-b5c2230ad221 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:00.754888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05206409-df8b-4de9-8b33-b5c2230ad221 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:00.760889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 573/1146] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:42:00 2022] GET /identity/v3/role_assignments?user.id=a4dbc1fceb6e49788914e2094c4d381b&scope.project.id=7c7a36df78784a6d88dbf54d0ee01661&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:02.725419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c10079-d0fa-48c5-bde3-282615157447 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:02.725957 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c10079-d0fa-48c5-bde3-282615157447 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:02.725957 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c10079-d0fa-48c5-bde3-282615157447 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:02.727361 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 574/1147] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:42:02.732403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a1d91-7944-4674-b162-e9c25775e27b None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:02.732808 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a1d91-7944-4674-b162-e9c25775e27b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:02.732967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a1d91-7944-4674-b162-e9c25775e27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:02.751651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-e31a1d91-7944-4674-b162-e9c25775e27b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:42:02.752843 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e31a1d91-7944-4674-b162-e9c25775e27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:42:02.817894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 574/1148] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:42:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:42:02.840230 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c10079-d0fa-48c5-bde3-282615157447 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:02.843092 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:02.939295 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c10079-d0fa-48c5-bde3-282615157447 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:02.971418 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac1854-358a-45c0-943d-fbf644e4725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:02.972037 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac1854-358a-45c0-943d-fbf644e4725b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:02.972317 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac1854-358a-45c0-943d-fbf644e4725b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:02.972589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac1854-358a-45c0-943d-fbf644e4725b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:02.982224 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac1854-358a-45c0-943d-fbf644e4725b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:42:02.986991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-caac1854-358a-45c0-943d-fbf644e4725b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:42:02.986991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:02.986991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:02.986991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:02.986991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:02.986991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:02.986991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:02.986991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:02.986991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:02.986991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:02.986991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:02.986991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:02.986991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:42:02.986991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:42:02.986991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:42:02.986991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:42:02.988094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:42:02.988094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:42:02.988094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:42:02.988094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:42:02.988094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:02.988094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:02.988094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:02.988094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:02.988094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:02.988094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:02.988094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:02.988094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:02.988094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:02.988094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:02.988094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:02.988094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:02.989118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:02.989118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:02.989118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:02.989118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:02.989118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:42:02.989118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:42:02.989118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:42:02.989118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:42:02.989118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:42:02.989118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:42:02.989118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:42:02.989118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:42:02.989118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 575/1149] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:42:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:02.994769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a1d91-7944-4674-b162-e9c25775e27b None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:03.093897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a1d91-7944-4674-b162-e9c25775e27b None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:03.110649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:03.127260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deff29-d737-488e-b778-e9d03a805e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:03.127882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deff29-d737-488e-b778-e9d03a805e1d None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:03.128165 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deff29-d737-488e-b778-e9d03a805e1d None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:03.128447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deff29-d737-488e-b778-e9d03a805e1d None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:03.129164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88deff29-d737-488e-b778-e9d03a805e1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:03.129478 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88deff29-d737-488e-b778-e9d03a805e1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:03.130889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88deff29-d737-488e-b778-e9d03a805e1d None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:03.140131 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 575/1150] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:42:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:03.145096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac1854-358a-45c0-943d-fbf644e4725b None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:03.204492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:03.242737 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac1854-358a-45c0-943d-fbf644e4725b None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:03.279924 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37eb30-2257-4d03-b0a8-8acbb7226e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:03.280561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37eb30-2257-4d03-b0a8-8acbb7226e4b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:03.280841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37eb30-2257-4d03-b0a8-8acbb7226e4b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:03.281115 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37eb30-2257-4d03-b0a8-8acbb7226e4b None admin] PATH_INFO: `/v3/users/a4dbc1fceb6e49788914e2094c4d381b` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:03.282258 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37eb30-2257-4d03-b0a8-8acbb7226e4b None admin] RBAC: Authorizing `identity:get_user(user_id=a4dbc1fceb6e49788914e2094c4d381b)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:03.283715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37eb30-2257-4d03-b0a8-8acbb7226e4b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:03.285318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 576/1151] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:42:03 2022] GET /identity/v3/users/a4dbc1fceb6e49788914e2094c4d381b => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:03.291288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deff29-d737-488e-b778-e9d03a805e1d None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:03.389989 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deff29-d737-488e-b778-e9d03a805e1d None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:03.423353 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8af3c1-6da0-41c1-90b1-72b2260c8ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:03.423977 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8af3c1-6da0-41c1-90b1-72b2260c8ccb None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:03.424265 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8af3c1-6da0-41c1-90b1-72b2260c8ccb None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:03.424543 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8af3c1-6da0-41c1-90b1-72b2260c8ccb None admin] PATH_INFO: `/v3/projects/7c7a36df78784a6d88dbf54d0ee01661` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:03.425834 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8af3c1-6da0-41c1-90b1-72b2260c8ccb None admin] RBAC: Authorizing `identity:get_project(project_id=7c7a36df78784a6d88dbf54d0ee01661)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:03.427305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8af3c1-6da0-41c1-90b1-72b2260c8ccb None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:03.428972 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 576/1152] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:42:03 2022] GET /identity/v3/projects/7c7a36df78784a6d88dbf54d0ee01661 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:03.434964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37eb30-2257-4d03-b0a8-8acbb7226e4b None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:03.529850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37eb30-2257-4d03-b0a8-8acbb7226e4b None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:03.560113 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:03.566215 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a79f94-493f-47f4-9cce-e343b386707b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:03.573644 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a79f94-493f-47f4-9cce-e343b386707b None admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:03.573644 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a79f94-493f-47f4-9cce-e343b386707b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:03.573644 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a79f94-493f-47f4-9cce-e343b386707b None admin] PATH_INFO: `/v3/projects/7c7a36df78784a6d88dbf54d0ee01661/users/a4dbc1fceb6e49788914e2094c4d381b/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:03.573644 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a79f94-493f-47f4-9cce-e343b386707b None admin] RBAC: Authorizing `identity:create_grant(project_id=7c7a36df78784a6d88dbf54d0ee01661, user_id=a4dbc1fceb6e49788914e2094c4d381b, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:03.573644 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a79f94-493f-47f4-9cce-e343b386707b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:03.642276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 577/1153] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:42:03 2022] PUT /identity/v3/projects/7c7a36df78784a6d88dbf54d0ee01661/users/a4dbc1fceb6e49788914e2094c4d381b/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:42:05.618787 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1818997-aef1-4f1e-8c2c-24ec7f91fe20 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:05.619320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1818997-aef1-4f1e-8c2c-24ec7f91fe20 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:05.619320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1818997-aef1-4f1e-8c2c-24ec7f91fe20 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:05.620685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 577/1154] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:42:05.626246 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f949b-a167-48e2-ae7c-da688705d333 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:05.626691 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f949b-a167-48e2-ae7c-da688705d333 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:05.626853 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f949b-a167-48e2-ae7c-da688705d333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:05.644699 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-c84f949b-a167-48e2-ae7c-da688705d333 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:42:05.645873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-c84f949b-a167-48e2-ae7c-da688705d333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:42:05.712429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 578/1155] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:42:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:42:05.735268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1818997-aef1-4f1e-8c2c-24ec7f91fe20 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:05.785323 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:05.836924 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1818997-aef1-4f1e-8c2c-24ec7f91fe20 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:05.869581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3c08b-771f-4b79-bf1f-f7753cbff07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:05.870154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3c08b-771f-4b79-bf1f-f7753cbff07d None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:05.870467 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3c08b-771f-4b79-bf1f-f7753cbff07d None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:05.870753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3c08b-771f-4b79-bf1f-f7753cbff07d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:05.881381 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3c08b-771f-4b79-bf1f-f7753cbff07d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:42:05.886236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-6be3c08b-771f-4b79-bf1f-f7753cbff07d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:42:05.886236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:05.886236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:05.886236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:05.886236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:05.886236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:05.886236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:05.886236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:05.886236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:05.886236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:05.886236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:05.886236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:05.886236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:42:05.886236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:42:05.886236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:42:05.886236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:42:05.887346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:42:05.887346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:42:05.887346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:42:05.887346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:42:05.887346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:05.887346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:05.887346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:05.887346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:05.887346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:05.887346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:05.887346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:05.887346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:05.887346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:05.887346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:05.887346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:05.887346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:05.888356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:05.888356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:05.888356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:05.888356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:05.888356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:42:05.888356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:42:05.888356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:42:05.888356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:42:05.888356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:42:05.888356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:42:05.888356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:42:05.888356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:42:05.888356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 578/1156] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:42:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:05.893493 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f949b-a167-48e2-ae7c-da688705d333 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:05.989929 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f949b-a167-48e2-ae7c-da688705d333 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:06.009195 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:06.023163 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988f7c5-4168-435a-baa6-3ca3f2e42211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:06.023775 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988f7c5-4168-435a-baa6-3ca3f2e42211 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:06.024060 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988f7c5-4168-435a-baa6-3ca3f2e42211 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:06.024339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988f7c5-4168-435a-baa6-3ca3f2e42211 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:06.025049 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988f7c5-4168-435a-baa6-3ca3f2e42211 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:06.025358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988f7c5-4168-435a-baa6-3ca3f2e42211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:06.026763 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988f7c5-4168-435a-baa6-3ca3f2e42211 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:06.035084 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 579/1157] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:42:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:06.041040 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3c08b-771f-4b79-bf1f-f7753cbff07d None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:06.139388 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3c08b-771f-4b79-bf1f-f7753cbff07d None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:06.148569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:06.172280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2de375-8df7-4c36-8d4f-dee008a12c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:06.172926 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2de375-8df7-4c36-8d4f-dee008a12c9b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:06.173199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2de375-8df7-4c36-8d4f-dee008a12c9b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:06.173479 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2de375-8df7-4c36-8d4f-dee008a12c9b None admin] PATH_INFO: `/v3/users/a4dbc1fceb6e49788914e2094c4d381b` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:06.174754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2de375-8df7-4c36-8d4f-dee008a12c9b None admin] RBAC: Authorizing `identity:get_user(user_id=a4dbc1fceb6e49788914e2094c4d381b)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:06.176186 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2de375-8df7-4c36-8d4f-dee008a12c9b None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:06.177780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 579/1158] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:42:06 2022] GET /identity/v3/users/a4dbc1fceb6e49788914e2094c4d381b => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:06.183547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988f7c5-4168-435a-baa6-3ca3f2e42211 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:06.282551 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988f7c5-4168-435a-baa6-3ca3f2e42211 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:06.318302 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10aa29-f76c-41e4-a12a-924f765963ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:06.319481 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10aa29-f76c-41e4-a12a-924f765963ab None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:06.319766 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10aa29-f76c-41e4-a12a-924f765963ab None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:06.320039 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10aa29-f76c-41e4-a12a-924f765963ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:06.368895 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:06.386764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10aa29-f76c-41e4-a12a-924f765963ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:06.388213 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10aa29-f76c-41e4-a12a-924f765963ab None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:06.485405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 580/1159] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:42:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:42:06.491272 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2de375-8df7-4c36-8d4f-dee008a12c9b None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:06.589356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2de375-8df7-4c36-8d4f-dee008a12c9b None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:06.621718 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baa3c8-5c56-4ab7-a6d7-6feb0147ebd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:06.622349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baa3c8-5c56-4ab7-a6d7-6feb0147ebd1 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:06.622661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baa3c8-5c56-4ab7-a6d7-6feb0147ebd1 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:06.622936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baa3c8-5c56-4ab7-a6d7-6feb0147ebd1 None admin] PATH_INFO: `/v3/projects/7c7a36df78784a6d88dbf54d0ee01661` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:06.624092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baa3c8-5c56-4ab7-a6d7-6feb0147ebd1 None admin] RBAC: Authorizing `identity:get_project(project_id=7c7a36df78784a6d88dbf54d0ee01661)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:06.625776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baa3c8-5c56-4ab7-a6d7-6feb0147ebd1 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:06.627778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 580/1160] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:42:06 2022] GET /identity/v3/projects/7c7a36df78784a6d88dbf54d0ee01661 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:06.634338 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10aa29-f76c-41e4-a12a-924f765963ab None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:06.714729 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:06.732238 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10aa29-f76c-41e4-a12a-924f765963ab None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:06.766105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0f519-9c4a-4823-b31b-eadb949c1e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:06.766740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0f519-9c4a-4823-b31b-eadb949c1e8b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:06.767020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0f519-9c4a-4823-b31b-eadb949c1e8b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:06.767291 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0f519-9c4a-4823-b31b-eadb949c1e8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:06.768196 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0f519-9c4a-4823-b31b-eadb949c1e8b None admin] RBAC: Adding query filter params (role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.project.id=7c7a36df78784a6d88dbf54d0ee01661, user.id=a4dbc1fceb6e49788914e2094c4d381b) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:06.768506 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0f519-9c4a-4823-b31b-eadb949c1e8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:06.769915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0f519-9c4a-4823-b31b-eadb949c1e8b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:06.775962 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 581/1161] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:42:06 2022] GET /identity/v3/role_assignments?user.id=a4dbc1fceb6e49788914e2094c4d381b&scope.project.id=7c7a36df78784a6d88dbf54d0ee01661&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:08.785855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034427ca-add3-41fc-ad25-3d13eb433532 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:08.786435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034427ca-add3-41fc-ad25-3d13eb433532 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:08.786435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034427ca-add3-41fc-ad25-3d13eb433532 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:08.787825 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 581/1162] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:42:08.792914 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aaa112-0a99-458a-a979-ed8a5a0ea2c5 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:08.793291 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aaa112-0a99-458a-a979-ed8a5a0ea2c5 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:08.793467 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aaa112-0a99-458a-a979-ed8a5a0ea2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:08.811682 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-84aaa112-0a99-458a-a979-ed8a5a0ea2c5 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:42:08.812860 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-84aaa112-0a99-458a-a979-ed8a5a0ea2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:42:08.877723 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 582/1163] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:42:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:42:08.900071 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034427ca-add3-41fc-ad25-3d13eb433532 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:08.949409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:09.001763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034427ca-add3-41fc-ad25-3d13eb433532 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:09.034652 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85363d32-be3a-4dd3-ae08-38480ca59c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:09.035187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85363d32-be3a-4dd3-ae08-38480ca59c95 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:09.035477 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85363d32-be3a-4dd3-ae08-38480ca59c95 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:09.035758 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85363d32-be3a-4dd3-ae08-38480ca59c95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:09.101993 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85363d32-be3a-4dd3-ae08-38480ca59c95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:09.103471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85363d32-be3a-4dd3-ae08-38480ca59c95 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:09.146276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:09.199873 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 582/1164] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:42:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:42:09.205815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aaa112-0a99-458a-a979-ed8a5a0ea2c5 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:09.279473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:09.301094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aaa112-0a99-458a-a979-ed8a5a0ea2c5 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:09.335709 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a2301-4e85-41ba-806d-197420d222d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:09.336335 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a2301-4e85-41ba-806d-197420d222d9 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:09.336702 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a2301-4e85-41ba-806d-197420d222d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:09.336975 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a2301-4e85-41ba-806d-197420d222d9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:09.343673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a2301-4e85-41ba-806d-197420d222d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:09.345110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a2301-4e85-41ba-806d-197420d222d9 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:09.360995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-e79a2301-4e85-41ba-806d-197420d222d9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 14:42:09.360995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:09.360995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 26 14:42:09.360995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 26 14:42:09.360995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:42:09.360995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:42:09.360995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:42:09.360995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:42:09.360995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 26 14:42:09.360995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:42:09.360995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:42:09.360995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:42:09.360995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:09.360995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:09.360995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:09.360995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:09.360995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:09.362222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:09.362222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:09.362222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:09.362222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:09.362222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:09.362222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:09.362222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:42:09.362222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:42:09.362222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:42:09.362222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:42:09.362222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:09.362222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:09.362222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:09.362222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:09.362222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:09.362222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:09.363245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:09.363245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:09.363245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:09.363245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:09.363245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:09.363245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:09.363245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:09.363245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:09.363245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:09.363245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:09.363245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 26 14:42:09.363245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:42:09.363245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 14:42:09.363245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:42:09.363245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 583/1165] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jul 26 14:42:09 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:09.369466 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85363d32-be3a-4dd3-ae08-38480ca59c95 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:09.472844 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85363d32-be3a-4dd3-ae08-38480ca59c95 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:09.506903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afeb16-ca39-4ac3-b194-fa99ef77da12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:09.507510 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afeb16-ca39-4ac3-b194-fa99ef77da12 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:09.507790 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afeb16-ca39-4ac3-b194-fa99ef77da12 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:09.508065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afeb16-ca39-4ac3-b194-fa99ef77da12 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:09.508743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afeb16-ca39-4ac3-b194-fa99ef77da12 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:09.509045 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afeb16-ca39-4ac3-b194-fa99ef77da12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:09.510424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afeb16-ca39-4ac3-b194-fa99ef77da12 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:09.517378 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 583/1166] 10.222.0.86 () {56 vars in 1115 bytes} [Tue Jul 26 14:42:09 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:11.500762 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e963f1-7e27-43e3-9066-130bba3986e4 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:11.501323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e963f1-7e27-43e3-9066-130bba3986e4 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:11.501323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e963f1-7e27-43e3-9066-130bba3986e4 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:11.502725 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 584/1167] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:42:11.508529 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e180a2-92f5-432a-ab0d-031d41f20c62 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:11.508935 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e180a2-92f5-432a-ab0d-031d41f20c62 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:11.509089 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e180a2-92f5-432a-ab0d-031d41f20c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:11.527368 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-89e180a2-92f5-432a-ab0d-031d41f20c62 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:42:11.528537 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-89e180a2-92f5-432a-ab0d-031d41f20c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:42:11.530465 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:11.595314 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 584/1168] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:42:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:42:11.617337 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e963f1-7e27-43e3-9066-130bba3986e4 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:11.719608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e963f1-7e27-43e3-9066-130bba3986e4 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:11.752711 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f03c7b-8852-4a3c-b969-be65a1c9e69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:11.753252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f03c7b-8852-4a3c-b969-be65a1c9e69a None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:11.754002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f03c7b-8852-4a3c-b969-be65a1c9e69a None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:11.754286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f03c7b-8852-4a3c-b969-be65a1c9e69a None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:11.755037 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f03c7b-8852-4a3c-b969-be65a1c9e69a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:11.757007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f03c7b-8852-4a3c-b969-be65a1c9e69a None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:11.761611 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:11.837558 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 585/1169] 10.222.0.86 () {60 vars in 1138 bytes} [Tue Jul 26 14:42:11 2022] POST /identity/v3/domains => generated 267 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:42:13.873643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bdb5f-603e-4e30-b222-290a346efb40 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:13.874266 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bdb5f-603e-4e30-b222-290a346efb40 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:13.874266 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bdb5f-603e-4e30-b222-290a346efb40 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:13.875935 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 585/1170] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:42:13.881006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cfcd6-3c84-4174-84fb-a712c4befa4f None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:13.881406 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cfcd6-3c84-4174-84fb-a712c4befa4f None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:13.881565 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cfcd6-3c84-4174-84fb-a712c4befa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:13.899730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-d14cfcd6-3c84-4174-84fb-a712c4befa4f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:42:13.900906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d14cfcd6-3c84-4174-84fb-a712c4befa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:42:13.964609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 586/1171] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:42:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:42:13.987154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bdb5f-603e-4e30-b222-290a346efb40 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:14.086415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bdb5f-603e-4e30-b222-290a346efb40 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:14.119940 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0566b6-a540-4cf0-a0bb-2906b9b0662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:14.120578 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0566b6-a540-4cf0-a0bb-2906b9b0662a None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:14.120860 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0566b6-a540-4cf0-a0bb-2906b9b0662a None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:14.121162 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0566b6-a540-4cf0-a0bb-2906b9b0662a None admin] PATH_INFO: `/v3/domains/9bb572b8a190490f87ea9b2ec92dbd2b` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:14.128039 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:14.132744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0566b6-a540-4cf0-a0bb-2906b9b0662a None admin] RBAC: Authorizing `identity:get_domain(domain_id=9bb572b8a190490f87ea9b2ec92dbd2b)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:14.134800 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0566b6-a540-4cf0-a0bb-2906b9b0662a None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:14.136036 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 586/1172] 10.222.0.86 () {56 vars in 1183 bytes} [Tue Jul 26 14:42:13 2022] GET /identity/v3/domains/9bb572b8a190490f87ea9b2ec92dbd2b => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:14.142092 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cfcd6-3c84-4174-84fb-a712c4befa4f None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:14.244069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cfcd6-3c84-4174-84fb-a712c4befa4f None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:14.269353 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:14.277611 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd6560-58d4-4c6b-9ddb-f64476fefcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:14.290230 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd6560-58d4-4c6b-9ddb-f64476fefcb6 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:14.290230 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd6560-58d4-4c6b-9ddb-f64476fefcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:14.290230 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd6560-58d4-4c6b-9ddb-f64476fefcb6 None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:14.290230 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd6560-58d4-4c6b-9ddb-f64476fefcb6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:14.290230 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd6560-58d4-4c6b-9ddb-f64476fefcb6 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:14.357826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 587/1173] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jul 26 14:42:14 2022] POST /identity/v3/projects => generated 361 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:42:16.393628 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870b6d6-a34f-4a22-a607-1053837c2849 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:16.394192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870b6d6-a34f-4a22-a607-1053837c2849 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:16.394192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870b6d6-a34f-4a22-a607-1053837c2849 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:16.395563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 587/1174] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:42:16.400642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eda190-90dc-45e1-88de-b3eb43d1fb11 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:16.401040 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eda190-90dc-45e1-88de-b3eb43d1fb11 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:16.401198 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eda190-90dc-45e1-88de-b3eb43d1fb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:16.418717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-35eda190-90dc-45e1-88de-b3eb43d1fb11 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:42:16.419896 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-35eda190-90dc-45e1-88de-b3eb43d1fb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:42:16.486321 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 588/1175] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:42:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:42:16.512315 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870b6d6-a34f-4a22-a607-1053837c2849 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:16.612947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870b6d6-a34f-4a22-a607-1053837c2849 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:16.646181 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164199a-cc04-4a1c-99b1-f057ed3537a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:16.646790 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164199a-cc04-4a1c-99b1-f057ed3537a8 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:16.647080 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164199a-cc04-4a1c-99b1-f057ed3537a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:16.647362 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164199a-cc04-4a1c-99b1-f057ed3537a8 None admin] PATH_INFO: `/v3/domains/9bb572b8a190490f87ea9b2ec92dbd2b` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:16.648514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164199a-cc04-4a1c-99b1-f057ed3537a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9bb572b8a190490f87ea9b2ec92dbd2b)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:16.649951 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164199a-cc04-4a1c-99b1-f057ed3537a8 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:16.651589 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 588/1176] 10.222.0.86 () {56 vars in 1183 bytes} [Tue Jul 26 14:42:16 2022] GET /identity/v3/domains/9bb572b8a190490f87ea9b2ec92dbd2b => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:16.657514 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eda190-90dc-45e1-88de-b3eb43d1fb11 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:16.755628 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eda190-90dc-45e1-88de-b3eb43d1fb11 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:16.764508 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:16.788792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759a840-54da-4d07-b9aa-6ae68e180792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:16.789402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759a840-54da-4d07-b9aa-6ae68e180792 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:16.789683 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759a840-54da-4d07-b9aa-6ae68e180792 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:16.789958 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759a840-54da-4d07-b9aa-6ae68e180792 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:16.790665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759a840-54da-4d07-b9aa-6ae68e180792 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:16.792090 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759a840-54da-4d07-b9aa-6ae68e180792 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:16.882674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 589/1177] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jul 26 14:42:16 2022] POST /identity/v3/users => generated 311 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:42:18.939886 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea0f3c-bcc2-4c43-b327-7961d028ee1e None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:18.940402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea0f3c-bcc2-4c43-b327-7961d028ee1e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:18.940402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea0f3c-bcc2-4c43-b327-7961d028ee1e None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:18.941691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 589/1178] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:42:18.947305 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e87618-e0ea-4de8-8755-d29791755cb8 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:18.947705 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e87618-e0ea-4de8-8755-d29791755cb8 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:18.947912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e87618-e0ea-4de8-8755-d29791755cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:18.965893 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-e2e87618-e0ea-4de8-8755-d29791755cb8 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:42:18.967115 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e2e87618-e0ea-4de8-8755-d29791755cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:42:19.032527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 590/1179] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:42:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:42:19.055813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea0f3c-bcc2-4c43-b327-7961d028ee1e None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:19.121107 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:19.156325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea0f3c-bcc2-4c43-b327-7961d028ee1e None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:19.188403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376930f-4e68-4324-b748-ef83edc4f1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:19.189026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376930f-4e68-4324-b748-ef83edc4f1fc None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:19.189358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376930f-4e68-4324-b748-ef83edc4f1fc None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:19.189582 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376930f-4e68-4324-b748-ef83edc4f1fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:19.199893 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376930f-4e68-4324-b748-ef83edc4f1fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:42:19.205101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-9376930f-4e68-4324-b748-ef83edc4f1fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:42:19.205101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:19.205101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:19.205101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:19.205101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:19.205101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:19.205101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:19.205101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:19.205101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:19.205101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:19.205101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:19.205101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:19.205101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:42:19.205101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:42:19.205101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:42:19.205101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:42:19.206274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:42:19.206274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:42:19.206274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:42:19.206274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:42:19.206274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:19.206274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:19.206274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:19.206274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:19.206274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:19.206274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:19.206274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:19.206274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:19.206274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:19.206274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:19.206274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:19.206274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:19.207622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:19.207622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:19.207622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:19.207622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:19.207622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:42:19.207622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:42:19.207622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:42:19.207622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:42:19.207622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:42:19.207622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:42:19.207622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:42:19.207622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:42:19.207622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 590/1180] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:42:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:19.212806 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e87618-e0ea-4de8-8755-d29791755cb8 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:19.317444 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:19.325792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e87618-e0ea-4de8-8755-d29791755cb8 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:19.364960 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c51332-d742-4d6f-9ce0-583c2fb543e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:19.365656 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c51332-d742-4d6f-9ce0-583c2fb543e0 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:19.365936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c51332-d742-4d6f-9ce0-583c2fb543e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:19.366210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c51332-d742-4d6f-9ce0-583c2fb543e0 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:19.366955 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c51332-d742-4d6f-9ce0-583c2fb543e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:19.367260 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c51332-d742-4d6f-9ce0-583c2fb543e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:19.368616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c51332-d742-4d6f-9ce0-583c2fb543e0 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:19.376585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 591/1181] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:42:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:19.383096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376930f-4e68-4324-b748-ef83edc4f1fc None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:19.496073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376930f-4e68-4324-b748-ef83edc4f1fc None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:19.520633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:19.529453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebe973-8486-4a19-9dbd-23a61a68a6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:19.530088 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebe973-8486-4a19-9dbd-23a61a68a6fb None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:19.530370 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebe973-8486-4a19-9dbd-23a61a68a6fb None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:19.530677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebe973-8486-4a19-9dbd-23a61a68a6fb None admin] PATH_INFO: `/v3/users/1a4e55b850d54dcab6136b4dce229020` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:19.543378 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebe973-8486-4a19-9dbd-23a61a68a6fb None admin] RBAC: Authorizing `identity:get_user(user_id=1a4e55b850d54dcab6136b4dce229020)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:19.544871 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebe973-8486-4a19-9dbd-23a61a68a6fb None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:19.546944 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 591/1182] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:42:19 2022] GET /identity/v3/users/1a4e55b850d54dcab6136b4dce229020 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:19.554783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c51332-d742-4d6f-9ce0-583c2fb543e0 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:19.653141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c51332-d742-4d6f-9ce0-583c2fb543e0 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:19.686707 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75a58b-d01a-49b1-9ea2-d9d9c33af56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:19.687331 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75a58b-d01a-49b1-9ea2-d9d9c33af56d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:19.687615 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75a58b-d01a-49b1-9ea2-d9d9c33af56d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:19.687892 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75a58b-d01a-49b1-9ea2-d9d9c33af56d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:19.712407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:19.754183 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75a58b-d01a-49b1-9ea2-d9d9c33af56d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:19.755699 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75a58b-d01a-49b1-9ea2-d9d9c33af56d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:19.849986 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 592/1183] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:42:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:42:19.855967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebe973-8486-4a19-9dbd-23a61a68a6fb None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:19.955702 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebe973-8486-4a19-9dbd-23a61a68a6fb None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:19.989392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24841c57-49d1-4ad0-a5c8-4384aa4b988b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:19.990036 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24841c57-49d1-4ad0-a5c8-4384aa4b988b None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:19.990875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24841c57-49d1-4ad0-a5c8-4384aa4b988b None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:19.991147 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24841c57-49d1-4ad0-a5c8-4384aa4b988b None admin] PATH_INFO: `/v3/projects/fcdab6ea315f42568f83d8c0bcd966aa` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:19.992281 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24841c57-49d1-4ad0-a5c8-4384aa4b988b None admin] RBAC: Authorizing `identity:get_project(project_id=fcdab6ea315f42568f83d8c0bcd966aa)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:19.993691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24841c57-49d1-4ad0-a5c8-4384aa4b988b None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:19.995331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 592/1184] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:42:19 2022] GET /identity/v3/projects/fcdab6ea315f42568f83d8c0bcd966aa => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:20.001730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75a58b-d01a-49b1-9ea2-d9d9c33af56d None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:20.056077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:20.099288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75a58b-d01a-49b1-9ea2-d9d9c33af56d None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:20.132497 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb0e28-afd9-4e7a-a35c-c566ef88ed64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:20.133102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb0e28-afd9-4e7a-a35c-c566ef88ed64 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:20.133385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb0e28-afd9-4e7a-a35c-c566ef88ed64 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:20.133665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb0e28-afd9-4e7a-a35c-c566ef88ed64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:20.134477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb0e28-afd9-4e7a-a35c-c566ef88ed64 None admin] RBAC: Adding query filter params (role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.project.id=fcdab6ea315f42568f83d8c0bcd966aa, user.id=1a4e55b850d54dcab6136b4dce229020) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:20.134794 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb0e28-afd9-4e7a-a35c-c566ef88ed64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:20.136221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb0e28-afd9-4e7a-a35c-c566ef88ed64 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:20.141713 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 593/1185] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:42:20 2022] GET /identity/v3/role_assignments?user.id=1a4e55b850d54dcab6136b4dce229020&scope.project.id=fcdab6ea315f42568f83d8c0bcd966aa&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:22.089236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473adae5-f752-4389-bd03-1d720bec0fdf None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:22.089762 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473adae5-f752-4389-bd03-1d720bec0fdf None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:22.089762 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473adae5-f752-4389-bd03-1d720bec0fdf None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:22.091142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 593/1186] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:42:22.096617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3329c-8e2f-4384-82d2-6d4a7e9d5a35 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:22.097046 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3329c-8e2f-4384-82d2-6d4a7e9d5a35 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:22.097178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3329c-8e2f-4384-82d2-6d4a7e9d5a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:22.114822 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-38d3329c-8e2f-4384-82d2-6d4a7e9d5a35 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:42:22.116491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-38d3329c-8e2f-4384-82d2-6d4a7e9d5a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:42:22.185075 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 594/1187] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:42:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:42:22.206677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473adae5-f752-4389-bd03-1d720bec0fdf None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:22.259777 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:22.306103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473adae5-f752-4389-bd03-1d720bec0fdf None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:22.338605 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf39b8-4c2f-4139-9e66-c3c8db57d7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:22.339226 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf39b8-4c2f-4139-9e66-c3c8db57d7f5 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:22.339553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf39b8-4c2f-4139-9e66-c3c8db57d7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:22.339778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf39b8-4c2f-4139-9e66-c3c8db57d7f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:22.350242 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf39b8-4c2f-4139-9e66-c3c8db57d7f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:42:22.355114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-3eaf39b8-4c2f-4139-9e66-c3c8db57d7f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:42:22.355114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:22.355114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:22.355114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:22.355114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:22.355114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:22.355114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:22.355114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:22.355114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:22.355114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:22.355114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:22.355114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:22.355114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:42:22.355114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:42:22.355114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:42:22.355114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:42:22.356184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:42:22.356184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:42:22.356184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:42:22.356184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:42:22.356184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:22.356184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:22.356184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:22.356184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:22.356184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:22.356184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:22.356184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:22.356184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:22.356184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:22.356184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:22.356184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:22.356184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:22.357347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:22.357347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:22.357347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:22.357347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:22.357347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:42:22.357347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:42:22.357347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:42:22.357347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:42:22.357347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:42:22.357347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:42:22.357347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:42:22.357347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:42:22.357347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 594/1188] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:42:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:22.362613 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3329c-8e2f-4384-82d2-6d4a7e9d5a35 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:22.409840 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:22.457530 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3329c-8e2f-4384-82d2-6d4a7e9d5a35 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:22.490729 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50209cb-4d10-413a-8656-3bbd7fb3f1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:22.491347 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50209cb-4d10-413a-8656-3bbd7fb3f1c0 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:22.491629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50209cb-4d10-413a-8656-3bbd7fb3f1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:22.491902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50209cb-4d10-413a-8656-3bbd7fb3f1c0 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:22.492609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50209cb-4d10-413a-8656-3bbd7fb3f1c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:22.492912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50209cb-4d10-413a-8656-3bbd7fb3f1c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:22.494261 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50209cb-4d10-413a-8656-3bbd7fb3f1c0 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:22.503080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 595/1189] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:42:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:22.508874 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf39b8-4c2f-4139-9e66-c3c8db57d7f5 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:22.608804 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf39b8-4c2f-4139-9e66-c3c8db57d7f5 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:22.621590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:22.641944 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85814ee-ad6a-45da-a3e4-c72b91ca2be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:22.642610 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85814ee-ad6a-45da-a3e4-c72b91ca2be4 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:22.642897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85814ee-ad6a-45da-a3e4-c72b91ca2be4 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:22.643178 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85814ee-ad6a-45da-a3e4-c72b91ca2be4 None admin] PATH_INFO: `/v3/users/1a4e55b850d54dcab6136b4dce229020` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:22.644361 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85814ee-ad6a-45da-a3e4-c72b91ca2be4 None admin] RBAC: Authorizing `identity:get_user(user_id=1a4e55b850d54dcab6136b4dce229020)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:22.645801 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85814ee-ad6a-45da-a3e4-c72b91ca2be4 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:22.647924 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 595/1190] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:42:22 2022] GET /identity/v3/users/1a4e55b850d54dcab6136b4dce229020 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:22.654166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50209cb-4d10-413a-8656-3bbd7fb3f1c0 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:22.752641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50209cb-4d10-413a-8656-3bbd7fb3f1c0 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:22.764814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:22.784954 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7910639-8ec6-40e3-95db-661873970a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:22.785591 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7910639-8ec6-40e3-95db-661873970a57 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:22.785873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7910639-8ec6-40e3-95db-661873970a57 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:22.786150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7910639-8ec6-40e3-95db-661873970a57 None admin] PATH_INFO: `/v3/projects/fcdab6ea315f42568f83d8c0bcd966aa` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:22.787916 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7910639-8ec6-40e3-95db-661873970a57 None admin] RBAC: Authorizing `identity:get_project(project_id=fcdab6ea315f42568f83d8c0bcd966aa)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:22.789336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7910639-8ec6-40e3-95db-661873970a57 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:22.791030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 596/1191] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:42:22 2022] GET /identity/v3/projects/fcdab6ea315f42568f83d8c0bcd966aa => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:22.797194 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85814ee-ad6a-45da-a3e4-c72b91ca2be4 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:22.896195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85814ee-ad6a-45da-a3e4-c72b91ca2be4 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:22.929770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaded1-3040-44b3-8124-95af6f912dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:22.930456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaded1-3040-44b3-8124-95af6f912dbb None admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:22.930746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaded1-3040-44b3-8124-95af6f912dbb None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:22.931027 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaded1-3040-44b3-8124-95af6f912dbb None admin] PATH_INFO: `/v3/projects/fcdab6ea315f42568f83d8c0bcd966aa/users/1a4e55b850d54dcab6136b4dce229020/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:22.932955 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eaded1-3040-44b3-8124-95af6f912dbb None admin] RBAC: Authorizing `identity:create_grant(project_id=fcdab6ea315f42568f83d8c0bcd966aa, user_id=1a4e55b850d54dcab6136b4dce229020, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:22.934411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eaded1-3040-44b3-8124-95af6f912dbb None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:23.002532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 596/1192] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:42:22 2022] PUT /identity/v3/projects/fcdab6ea315f42568f83d8c0bcd966aa/users/1a4e55b850d54dcab6136b4dce229020/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:42:24.983942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2500e-5d88-482f-8cf0-90ead2024a11 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:24.984440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2500e-5d88-482f-8cf0-90ead2024a11 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:24.984440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2500e-5d88-482f-8cf0-90ead2024a11 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:24.985753 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 597/1193] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:42:24.991491 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e5613-0f98-493c-aeb9-f5d75b960598 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:24.991908 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e5613-0f98-493c-aeb9-f5d75b960598 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:24.992047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e5613-0f98-493c-aeb9-f5d75b960598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:25.011214 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-599e5613-0f98-493c-aeb9-f5d75b960598 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:42:25.012408 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-599e5613-0f98-493c-aeb9-f5d75b960598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:42:25.045571 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:25.078804 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 597/1194] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:42:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:42:25.101932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2500e-5d88-482f-8cf0-90ead2024a11 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:25.202661 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2500e-5d88-482f-8cf0-90ead2024a11 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:25.235562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69b270-0289-411e-b093-2c218443226c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:25.236256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69b270-0289-411e-b093-2c218443226c None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:25.236536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69b270-0289-411e-b093-2c218443226c None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:25.236811 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69b270-0289-411e-b093-2c218443226c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:25.247360 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69b270-0289-411e-b093-2c218443226c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:42:25.252554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-4b69b270-0289-411e-b093-2c218443226c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:42:25.252554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:25.252554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:25.252554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:25.252554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:25.252554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:25.252554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:25.252554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:25.252554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:25.252554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:25.252554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:25.252554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:25.252554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:42:25.252554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:42:25.252554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:42:25.252554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:42:25.253664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:42:25.253664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:42:25.253664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:42:25.253664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:42:25.253664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:25.253664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:25.253664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:25.253664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:25.253664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:25.253664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:25.253664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:25.253664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:25.253664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:25.253664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:25.253664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:25.253664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:25.254724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:25.254724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:25.254724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:25.254724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:25.254724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:42:25.254724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:42:25.254724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:42:25.254724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:42:25.254724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:42:25.254724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:42:25.254724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:42:25.254724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:42:25.254724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 598/1195] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:42:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:25.260090 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e5613-0f98-493c-aeb9-f5d75b960598 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:25.357598 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e5613-0f98-493c-aeb9-f5d75b960598 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:25.396041 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d56e5-4dac-45c3-8e5c-14cca100bc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:25.399096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d56e5-4dac-45c3-8e5c-14cca100bc04 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:25.399404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d56e5-4dac-45c3-8e5c-14cca100bc04 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:25.399688 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d56e5-4dac-45c3-8e5c-14cca100bc04 None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:25.400417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d56e5-4dac-45c3-8e5c-14cca100bc04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:25.400728 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d56e5-4dac-45c3-8e5c-14cca100bc04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:25.402106 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d56e5-4dac-45c3-8e5c-14cca100bc04 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:25.410501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 598/1196] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:42:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:25.418903 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69b270-0289-411e-b093-2c218443226c None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:25.461428 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:25.521654 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69b270-0289-411e-b093-2c218443226c None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:25.556054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df613c-8ff7-477d-b033-2c7ea101bca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:25.556689 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df613c-8ff7-477d-b033-2c7ea101bca9 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:25.556975 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df613c-8ff7-477d-b033-2c7ea101bca9 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:25.557251 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df613c-8ff7-477d-b033-2c7ea101bca9 None admin] PATH_INFO: `/v3/users/1a4e55b850d54dcab6136b4dce229020` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:25.558427 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df613c-8ff7-477d-b033-2c7ea101bca9 None admin] RBAC: Authorizing `identity:get_user(user_id=1a4e55b850d54dcab6136b4dce229020)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:25.559859 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df613c-8ff7-477d-b033-2c7ea101bca9 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:25.561462 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 599/1197] 10.222.0.86 () {56 vars in 1177 bytes} [Tue Jul 26 14:42:25 2022] GET /identity/v3/users/1a4e55b850d54dcab6136b4dce229020 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:25.567277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d56e5-4dac-45c3-8e5c-14cca100bc04 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:25.600937 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:25.666786 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d56e5-4dac-45c3-8e5c-14cca100bc04 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:25.700316 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728ee87-4d39-447d-ab69-40c79f964846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:25.700937 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728ee87-4d39-447d-ab69-40c79f964846 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:25.701225 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728ee87-4d39-447d-ab69-40c79f964846 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:25.701505 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728ee87-4d39-447d-ab69-40c79f964846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:25.768908 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728ee87-4d39-447d-ab69-40c79f964846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:25.770360 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728ee87-4d39-447d-ab69-40c79f964846 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:25.800144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:25.867541 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 599/1198] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:42:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:42:25.873358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df613c-8ff7-477d-b033-2c7ea101bca9 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:25.969651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df613c-8ff7-477d-b033-2c7ea101bca9 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:25.979075 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:26.004230 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7ed84-bcc2-4418-a70d-27517e1502a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:26.004862 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7ed84-bcc2-4418-a70d-27517e1502a7 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:26.005142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7ed84-bcc2-4418-a70d-27517e1502a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:26.005416 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7ed84-bcc2-4418-a70d-27517e1502a7 None admin] PATH_INFO: `/v3/projects/fcdab6ea315f42568f83d8c0bcd966aa` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:26.006568 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7ed84-bcc2-4418-a70d-27517e1502a7 None admin] RBAC: Authorizing `identity:get_project(project_id=fcdab6ea315f42568f83d8c0bcd966aa)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:26.007983 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7ed84-bcc2-4418-a70d-27517e1502a7 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:26.009628 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 600/1199] 10.222.0.86 () {56 vars in 1186 bytes} [Tue Jul 26 14:42:25 2022] GET /identity/v3/projects/fcdab6ea315f42568f83d8c0bcd966aa => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:26.015731 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728ee87-4d39-447d-ab69-40c79f964846 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:26.113155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728ee87-4d39-447d-ab69-40c79f964846 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:26.142229 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:26.147114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf12311-c23f-4b32-9210-6da2300ca225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:26.147730 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf12311-c23f-4b32-9210-6da2300ca225 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:26.148017 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf12311-c23f-4b32-9210-6da2300ca225 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:26.148296 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf12311-c23f-4b32-9210-6da2300ca225 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:26.149078 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf12311-c23f-4b32-9210-6da2300ca225 None admin] RBAC: Adding query filter params (role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.project.id=fcdab6ea315f42568f83d8c0bcd966aa, user.id=1a4e55b850d54dcab6136b4dce229020) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:26.149414 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf12311-c23f-4b32-9210-6da2300ca225 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:26.150891 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf12311-c23f-4b32-9210-6da2300ca225 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:26.156492 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 600/1200] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:42:26 2022] GET /identity/v3/role_assignments?user.id=1a4e55b850d54dcab6136b4dce229020&scope.project.id=fcdab6ea315f42568f83d8c0bcd966aa&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:36.003584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=12 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:36.167902 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:37.384195 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deff22-3434-46d8-badd-0644d38b1936 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:37.384812 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deff22-3434-46d8-badd-0644d38b1936 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:37.384812 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deff22-3434-46d8-badd-0644d38b1936 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:37.386129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 601/1201] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:43:37.391725 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07358e18-5c6a-46f8-93a8-e79315a9028a None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:37.406174 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07358e18-5c6a-46f8-93a8-e79315a9028a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:37.406174 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07358e18-5c6a-46f8-93a8-e79315a9028a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:37.411171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-07358e18-5c6a-46f8-93a8-e79315a9028a None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:43:37.412379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-07358e18-5c6a-46f8-93a8-e79315a9028a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:43:37.480152 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 601/1202] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:43:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:43:37.505207 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0deff22-3434-46d8-badd-0644d38b1936 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:37.605103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0deff22-3434-46d8-badd-0644d38b1936 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:37.639131 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1311a-46a6-4f4e-9a13-9b18f3ba3abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:37.639702 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1311a-46a6-4f4e-9a13-9b18f3ba3abd None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:37.639979 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1311a-46a6-4f4e-9a13-9b18f3ba3abd None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:37.640249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1311a-46a6-4f4e-9a13-9b18f3ba3abd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:37.650160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1311a-46a6-4f4e-9a13-9b18f3ba3abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:37.651670 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1311a-46a6-4f4e-9a13-9b18f3ba3abd None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:37.666130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-fbc1311a-46a6-4f4e-9a13-9b18f3ba3abd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:37.666130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:37.666130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:37.666130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:37.666130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:37.666130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:37.666130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:37.666130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:37.666130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:37.666130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:37.666130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:37.666130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:37.666130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:43:37.666130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:43:37.666130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:43:37.667248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:43:37.667248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:37.667248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:37.667248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:37.667248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:37.667248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:37.667248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:37.667248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:37.667248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:37.667248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:37.667248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:37.667248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:37.667248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:37.667248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:37.667248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:37.667248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:37.667248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:37.668363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:43:37.668363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:43:37.668363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:37.668363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:43:37.668997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 602/1203] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:37.673841 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07358e18-5c6a-46f8-93a8-e79315a9028a None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:37.776533 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07358e18-5c6a-46f8-93a8-e79315a9028a None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:37.805187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:37.811594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad45d8-0deb-4ca3-948c-3b29e1a445a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:37.812215 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad45d8-0deb-4ca3-948c-3b29e1a445a0 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:37.812619 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad45d8-0deb-4ca3-948c-3b29e1a445a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:37.812896 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad45d8-0deb-4ca3-948c-3b29e1a445a0 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:37.813575 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad45d8-0deb-4ca3-948c-3b29e1a445a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:37.813880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad45d8-0deb-4ca3-948c-3b29e1a445a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:37.815285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad45d8-0deb-4ca3-948c-3b29e1a445a0 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:37.827712 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 602/1204] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:37.833320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1311a-46a6-4f4e-9a13-9b18f3ba3abd None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:37.886256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:37.933205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1311a-46a6-4f4e-9a13-9b18f3ba3abd None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:37.966314 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d634d-6d44-44fb-b67e-3165d57abf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:37.966950 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d634d-6d44-44fb-b67e-3165d57abf82 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:37.967228 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d634d-6d44-44fb-b67e-3165d57abf82 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:37.967501 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d634d-6d44-44fb-b67e-3165d57abf82 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:37.968173 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d634d-6d44-44fb-b67e-3165d57abf82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:37.969627 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d634d-6d44-44fb-b67e-3165d57abf82 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:38.041769 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 603/1205] 10.222.0.86 () {60 vars in 1132 bytes} [Tue Jul 26 14:43:37 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:43:40.126417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88b133-aacf-47fe-b5a0-e5a0d5651bd1 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:40.126962 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88b133-aacf-47fe-b5a0-e5a0d5651bd1 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:40.126962 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88b133-aacf-47fe-b5a0-e5a0d5651bd1 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:40.128329 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 603/1206] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:43:40.133971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4cf5b-a465-4b4c-aea7-05422aa761f2 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:40.134426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4cf5b-a465-4b4c-aea7-05422aa761f2 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:40.134553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4cf5b-a465-4b4c-aea7-05422aa761f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:40.152754 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-25f4cf5b-a465-4b4c-aea7-05422aa761f2 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:43:40.153940 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-25f4cf5b-a465-4b4c-aea7-05422aa761f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:43:40.220166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 604/1207] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:43:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:43:40.243729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88b133-aacf-47fe-b5a0-e5a0d5651bd1 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:40.345639 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88b133-aacf-47fe-b5a0-e5a0d5651bd1 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:40.383965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13ab9d-9af9-47a4-9be7-729262098ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:40.384528 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13ab9d-9af9-47a4-9be7-729262098ace None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:40.384814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13ab9d-9af9-47a4-9be7-729262098ace None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:40.385094 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13ab9d-9af9-47a4-9be7-729262098ace None admin] PATH_INFO: `/v3/roles/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:40.395551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13ab9d-9af9-47a4-9be7-729262098ace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:43:40.401279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-da13ab9d-9af9-47a4-9be7-729262098ace None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:43:40.401279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:40.401279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:40.401279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:40.401279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:40.401279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:40.401279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:40.401279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:40.401279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:40.401279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:40.401279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:40.401279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:40.401279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:43:40.401279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:43:40.401279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:43:40.401279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:43:40.402447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:43:40.402447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:43:40.402447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:43:40.402447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:43:40.402447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:40.402447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:40.402447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:40.402447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:40.402447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:40.402447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:40.402447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:40.402447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:40.402447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:40.402447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:40.402447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:40.402447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:40.403489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:40.403489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:40.403489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:40.403489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:40.403489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:43:40.403489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:43:40.403489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:43:40.403489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:43:40.403489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:43:40.403489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:43:40.403489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:43:40.403489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:43:40.403489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 604/1208] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:43:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:40.408701 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4cf5b-a465-4b4c-aea7-05422aa761f2 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:40.448194 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:40.506256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4cf5b-a465-4b4c-aea7-05422aa761f2 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:40.540584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b19f83-f08f-4d13-8c03-d1a28e51432f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:40.541195 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b19f83-f08f-4d13-8c03-d1a28e51432f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:40.541597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b19f83-f08f-4d13-8c03-d1a28e51432f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:40.541875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b19f83-f08f-4d13-8c03-d1a28e51432f None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:40.542643 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b19f83-f08f-4d13-8c03-d1a28e51432f None admin] RBAC: Adding query filter params (name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:40.542950 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b19f83-f08f-4d13-8c03-d1a28e51432f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:40.544382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b19f83-f08f-4d13-8c03-d1a28e51432f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:40.552102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 605/1209] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:43:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:40.557981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13ab9d-9af9-47a4-9be7-729262098ace None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:40.607441 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:40.657292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13ab9d-9af9-47a4-9be7-729262098ace None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:40.691155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843770d8-1f42-4e5d-8388-0438011d7180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:40.692529 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843770d8-1f42-4e5d-8388-0438011d7180 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:40.692529 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843770d8-1f42-4e5d-8388-0438011d7180 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:40.692529 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843770d8-1f42-4e5d-8388-0438011d7180 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:40.702728 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843770d8-1f42-4e5d-8388-0438011d7180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:40.704168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843770d8-1f42-4e5d-8388-0438011d7180 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:40.718447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-843770d8-1f42-4e5d-8388-0438011d7180 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:40.718447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:40.718447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:40.718447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:40.718447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:40.718447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:40.718447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:40.718447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:40.718447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:40.718447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:40.718447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:40.718447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:40.718447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:43:40.718447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:43:40.718447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:43:40.719524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:43:40.719524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:40.719524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:40.719524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:40.719524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:40.719524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:40.719524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:40.719524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:40.719524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:40.719524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:40.719524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:40.719524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:40.719524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:40.719524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:40.719524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:40.719524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:40.719524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:40.720592 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:43:40.720592 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:43:40.720592 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:40.720592 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:43:40.720592 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 605/1210] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:40.726159 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b19f83-f08f-4d13-8c03-d1a28e51432f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:40.823264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:40.826120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b19f83-f08f-4d13-8c03-d1a28e51432f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:40.859044 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e9d31-3331-491b-a521-25d3f28cf9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:40.859648 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e9d31-3331-491b-a521-25d3f28cf9ca None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:40.859928 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e9d31-3331-491b-a521-25d3f28cf9ca None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:40.860200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e9d31-3331-491b-a521-25d3f28cf9ca None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:40.860879 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e9d31-3331-491b-a521-25d3f28cf9ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:40.861178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e9d31-3331-491b-a521-25d3f28cf9ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:40.862556 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e9d31-3331-491b-a521-25d3f28cf9ca None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:40.873961 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 606/1211] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:40.880026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843770d8-1f42-4e5d-8388-0438011d7180 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:40.982587 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843770d8-1f42-4e5d-8388-0438011d7180 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:40.984054 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:41.016317 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40bf0a-c34e-407a-829b-fa3d6956df10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:41.016957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40bf0a-c34e-407a-829b-fa3d6956df10 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:41.017242 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40bf0a-c34e-407a-829b-fa3d6956df10 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:41.017519 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40bf0a-c34e-407a-829b-fa3d6956df10 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:41.025341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40bf0a-c34e-407a-829b-fa3d6956df10 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:41.026809 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40bf0a-c34e-407a-829b-fa3d6956df10 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:41.037689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-fe40bf0a-c34e-407a-829b-fa3d6956df10 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:43:41.037689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:41.037689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:41.037689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:41.037689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:41.037689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:41.037689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:41.037689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:41.037689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:41.037689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:41.037689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:41.037689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:41.037689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:43:41.037689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:43:41.037689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:43:41.037689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:43:41.038892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:41.038892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:41.038892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:43:41.038892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:43:41.038892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:43:41.038892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:43:41.038892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:41.038892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:41.038892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:41.038892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:41.038892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:41.038892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:41.038892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:41.038892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:41.038892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:41.038892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:41.038892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:41.038892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:41.040148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:41.040148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:41.040148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:43:41.040148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:43:41.040148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:43:41.040148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:43:41.040148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:43:41.040148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:43:41.040148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:43:41.040148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:43:41.040148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 606/1212] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:43:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:41.044716 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e9d31-3331-491b-a521-25d3f28cf9ca None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:41.144526 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e9d31-3331-491b-a521-25d3f28cf9ca None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:41.178539 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d035af-3df2-4cb6-be67-5544a88fdd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:41.179510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d035af-3df2-4cb6-be67-5544a88fdd6f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:41.179923 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d035af-3df2-4cb6-be67-5544a88fdd6f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:41.180338 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d035af-3df2-4cb6-be67-5544a88fdd6f None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:41.181351 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d035af-3df2-4cb6-be67-5544a88fdd6f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:41.181662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d035af-3df2-4cb6-be67-5544a88fdd6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:41.183112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d035af-3df2-4cb6-be67-5544a88fdd6f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:41.200843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 607/1213] 10.222.0.86 () {56 vars in 1143 bytes} [Tue Jul 26 14:43:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:41.206719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40bf0a-c34e-407a-829b-fa3d6956df10 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:41.308693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40bf0a-c34e-407a-829b-fa3d6956df10 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:41.344120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758415c4-2adf-4028-9b4f-18cbb4136d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:41.344742 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758415c4-2adf-4028-9b4f-18cbb4136d78 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:41.345027 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758415c4-2adf-4028-9b4f-18cbb4136d78 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:41.345304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758415c4-2adf-4028-9b4f-18cbb4136d78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:41.375192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:41.412670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758415c4-2adf-4028-9b4f-18cbb4136d78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:41.414134 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758415c4-2adf-4028-9b4f-18cbb4136d78 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:41.514042 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 607/1214] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:43:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:43:41.520250 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d035af-3df2-4cb6-be67-5544a88fdd6f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:41.541628 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:41.638229 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d035af-3df2-4cb6-be67-5544a88fdd6f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:41.677506 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb97bcc-618b-436b-8d8b-96783cde2d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:41.678156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb97bcc-618b-436b-8d8b-96783cde2d66 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:41.679021 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb97bcc-618b-436b-8d8b-96783cde2d66 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:41.679308 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb97bcc-618b-436b-8d8b-96783cde2d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:41.689626 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb97bcc-618b-436b-8d8b-96783cde2d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:41.691121 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb97bcc-618b-436b-8d8b-96783cde2d66 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:41.706826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-0fb97bcc-618b-436b-8d8b-96783cde2d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:41.706826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:41.706826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:41.706826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:41.706826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:41.706826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:41.706826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:41.706826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:41.706826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:41.706826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:41.706826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:41.706826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:41.706826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:43:41.706826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:43:41.706826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:43:41.711450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:43:41.711450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:41.711450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:41.711450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:41.711450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:41.711450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:41.711450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:41.711450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:41.711450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:41.711450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:41.711450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:41.711450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:41.711450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:41.711450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:41.711450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:41.711450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:41.711450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:41.712336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:43:41.712336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:43:41.712336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:41.712336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:43:41.712336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 608/1215] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:41.713845 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758415c4-2adf-4028-9b4f-18cbb4136d78 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:41.779174 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:41.818664 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758415c4-2adf-4028-9b4f-18cbb4136d78 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:41.852960 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7ca85-704f-49a2-b6cf-6a7e8dee9f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:41.853573 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7ca85-704f-49a2-b6cf-6a7e8dee9f06 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:41.853855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7ca85-704f-49a2-b6cf-6a7e8dee9f06 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:41.854130 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7ca85-704f-49a2-b6cf-6a7e8dee9f06 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:41.854855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7ca85-704f-49a2-b6cf-6a7e8dee9f06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:41.855166 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7ca85-704f-49a2-b6cf-6a7e8dee9f06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:41.856527 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7ca85-704f-49a2-b6cf-6a7e8dee9f06 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:41.868082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 608/1216] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:41.873723 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb97bcc-618b-436b-8d8b-96783cde2d66 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:41.942871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:41.972568 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb97bcc-618b-436b-8d8b-96783cde2d66 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:42.005374 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdb06c-43b3-4386-9cdb-773aa0b19d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:42.006054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdb06c-43b3-4386-9cdb-773aa0b19d21 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:42.006359 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdb06c-43b3-4386-9cdb-773aa0b19d21 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:42.006667 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdb06c-43b3-4386-9cdb-773aa0b19d21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:42.013586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdb06c-43b3-4386-9cdb-773aa0b19d21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:42.017710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdb06c-43b3-4386-9cdb-773aa0b19d21 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:42.027259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-78bdb06c-43b3-4386-9cdb-773aa0b19d21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:43:42.027259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:42.027259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:42.027259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:42.027259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:42.027259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:42.027259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:42.027259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:42.027259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:42.027259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:42.027259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:42.027259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:42.027259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:43:42.027259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:43:42.027259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:43:42.028309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:43:42.028309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:42.028309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:42.028309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:42.028309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:42.028309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:42.028309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:42.028309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:42.028309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:42.028309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:42.028309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:42.028309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:42.028309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:42.028309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:42.028309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:42.028309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:42.028309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:42.029404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:43:42.029404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:43:42.029404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:43:42.029404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:43:42.029404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:43:42.029404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:43:42.029404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:43:42.029404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:43:42.029404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 609/1217] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:43:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:42.034315 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7ca85-704f-49a2-b6cf-6a7e8dee9f06 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:42.135227 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7ca85-704f-49a2-b6cf-6a7e8dee9f06 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:42.157634 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:42.169496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e3214-237b-423e-a2e0-f94f4d205060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:42.170114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e3214-237b-423e-a2e0-f94f4d205060 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:42.170412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e3214-237b-423e-a2e0-f94f4d205060 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:42.170716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e3214-237b-423e-a2e0-f94f4d205060 None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:42.171471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e3214-237b-423e-a2e0-f94f4d205060 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:42.171779 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e3214-237b-423e-a2e0-f94f4d205060 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:42.173218 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e3214-237b-423e-a2e0-f94f4d205060 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:42.185035 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 609/1218] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:43:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:42.191167 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdb06c-43b3-4386-9cdb-773aa0b19d21 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:42.293294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdb06c-43b3-4386-9cdb-773aa0b19d21 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:42.320487 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:42.326161 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b2de7-9642-4252-9ff4-f149c34b276d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:42.326802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b2de7-9642-4252-9ff4-f149c34b276d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:42.327085 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b2de7-9642-4252-9ff4-f149c34b276d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:42.327362 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b2de7-9642-4252-9ff4-f149c34b276d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:42.328142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b2de7-9642-4252-9ff4-f149c34b276d None admin] RBAC: Adding query filter params (role.id=7f17a5a0295f42e793e343cff968367c, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=0fab620bc5d044479746d8ea17615a74) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:42.328454 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b2de7-9642-4252-9ff4-f149c34b276d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:42.329884 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b2de7-9642-4252-9ff4-f149c34b276d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:42.335763 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 610/1219] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:43:42 2022] GET /identity/v3/role_assignments?user.id=0fab620bc5d044479746d8ea17615a74&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=7f17a5a0295f42e793e343cff968367c => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:44.320971 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00afce-0e43-436f-9fda-7eaaaebedd70 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:44.321528 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00afce-0e43-436f-9fda-7eaaaebedd70 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:44.321528 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00afce-0e43-436f-9fda-7eaaaebedd70 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:44.322908 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 610/1220] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:43:44.328895 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5022004-15a0-40e8-a80d-c2f785f4544d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:44.329299 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5022004-15a0-40e8-a80d-c2f785f4544d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:44.329447 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5022004-15a0-40e8-a80d-c2f785f4544d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:44.349078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-b5022004-15a0-40e8-a80d-c2f785f4544d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:43:44.350633 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b5022004-15a0-40e8-a80d-c2f785f4544d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:43:44.416842 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 611/1221] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:43:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:43:44.439164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00afce-0e43-436f-9fda-7eaaaebedd70 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:44.541436 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00afce-0e43-436f-9fda-7eaaaebedd70 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:44.575839 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ab07f-5385-43be-98f3-17a8319d9669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:44.576409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ab07f-5385-43be-98f3-17a8319d9669 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:44.576696 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ab07f-5385-43be-98f3-17a8319d9669 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:44.576970 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ab07f-5385-43be-98f3-17a8319d9669 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:44.587082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ab07f-5385-43be-98f3-17a8319d9669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:43:44.591910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-ad0ab07f-5385-43be-98f3-17a8319d9669 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:43:44.591910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:44.591910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:44.591910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:44.591910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:44.591910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:44.591910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:44.591910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:44.591910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:44.591910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:44.591910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:44.591910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:44.591910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:43:44.591910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:43:44.591910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:43:44.591910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:43:44.592981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:43:44.592981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:43:44.592981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:43:44.592981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:43:44.592981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:44.592981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:44.592981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:44.592981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:44.592981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:44.592981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:44.592981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:44.592981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:44.592981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:44.592981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:44.592981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:44.592981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:44.594160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:44.594160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:44.594160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:44.594160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:44.594160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:43:44.594160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:43:44.594160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:43:44.594160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:43:44.594160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:43:44.594160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:43:44.594160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:43:44.594160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:43:44.594160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 611/1222] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:43:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:44.599118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5022004-15a0-40e8-a80d-c2f785f4544d None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:44.715740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5022004-15a0-40e8-a80d-c2f785f4544d None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:44.746358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:44.757229 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114caa0-ddf1-4768-bcdc-15855a7d6c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:44.757853 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114caa0-ddf1-4768-bcdc-15855a7d6c21 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:44.758133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114caa0-ddf1-4768-bcdc-15855a7d6c21 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:44.758428 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114caa0-ddf1-4768-bcdc-15855a7d6c21 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:44.759153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114caa0-ddf1-4768-bcdc-15855a7d6c21 None admin] RBAC: Adding query filter params (name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:44.759452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114caa0-ddf1-4768-bcdc-15855a7d6c21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:44.760802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114caa0-ddf1-4768-bcdc-15855a7d6c21 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:44.768646 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 612/1223] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:43:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:44.774488 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ab07f-5385-43be-98f3-17a8319d9669 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:44.818975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:44.876291 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ab07f-5385-43be-98f3-17a8319d9669 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:44.909651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5054ea-d1ba-4bd4-b1d5-e610600a9671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:44.910287 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5054ea-d1ba-4bd4-b1d5-e610600a9671 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:44.910597 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5054ea-d1ba-4bd4-b1d5-e610600a9671 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:44.910876 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5054ea-d1ba-4bd4-b1d5-e610600a9671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:44.921420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5054ea-d1ba-4bd4-b1d5-e610600a9671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:44.923096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5054ea-d1ba-4bd4-b1d5-e610600a9671 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:44.938677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-fb5054ea-d1ba-4bd4-b1d5-e610600a9671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:44.938677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:44.938677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:44.938677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:44.938677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:44.938677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:44.938677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:44.938677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:44.938677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:44.938677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:44.938677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:44.938677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:44.938677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:43:44.938677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:43:44.938677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:43:44.939763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:43:44.939763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:44.939763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:44.939763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:44.939763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:44.939763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:44.939763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:44.939763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:44.939763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:44.939763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:44.939763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:44.939763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:44.939763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:44.939763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:44.939763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:44.939763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:44.939763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:44.940712 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:43:44.940712 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:43:44.940712 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:44.940712 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:43:44.940712 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 612/1224] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:44.945605 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114caa0-ddf1-4768-bcdc-15855a7d6c21 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:45.048297 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114caa0-ddf1-4768-bcdc-15855a7d6c21 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:45.081172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c29f4-0ab0-4d88-87e8-65166881aab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:45.081787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c29f4-0ab0-4d88-87e8-65166881aab5 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:45.082072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c29f4-0ab0-4d88-87e8-65166881aab5 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:45.082349 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c29f4-0ab0-4d88-87e8-65166881aab5 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:45.083080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c29f4-0ab0-4d88-87e8-65166881aab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:45.083377 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c29f4-0ab0-4d88-87e8-65166881aab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:45.085285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c29f4-0ab0-4d88-87e8-65166881aab5 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:45.096843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 613/1225] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:45.103247 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5054ea-d1ba-4bd4-b1d5-e610600a9671 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:45.198362 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:45.205182 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5054ea-d1ba-4bd4-b1d5-e610600a9671 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:45.237762 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602bc46-4bdd-4cf1-b1d4-c3d3d0d84e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:45.238414 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602bc46-4bdd-4cf1-b1d4-c3d3d0d84e09 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:45.238841 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602bc46-4bdd-4cf1-b1d4-c3d3d0d84e09 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:45.239118 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602bc46-4bdd-4cf1-b1d4-c3d3d0d84e09 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:45.247867 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602bc46-4bdd-4cf1-b1d4-c3d3d0d84e09 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:45.249307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602bc46-4bdd-4cf1-b1d4-c3d3d0d84e09 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:45.261882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-6602bc46-4bdd-4cf1-b1d4-c3d3d0d84e09 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:43:45.261882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:45.261882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:45.261882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:45.261882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:45.261882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:45.261882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:45.261882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:45.261882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:45.261882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:45.261882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:45.261882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:45.261882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:43:45.261882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:43:45.261882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:43:45.261882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:43:45.266797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:45.266797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:45.266797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:43:45.266797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:43:45.266797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:43:45.266797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:43:45.266797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:45.266797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:45.266797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:45.266797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:45.266797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:45.266797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:45.266797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:45.266797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:45.266797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:45.266797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:45.266797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:45.266797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:45.267822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:45.267822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:45.267822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:43:45.267822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:43:45.267822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:43:45.267822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:43:45.267822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:43:45.267822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:43:45.267822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:43:45.267822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:43:45.267822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 613/1226] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:43:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:45.269066 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c29f4-0ab0-4d88-87e8-65166881aab5 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:45.314837 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:45.366659 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c29f4-0ab0-4d88-87e8-65166881aab5 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:45.400256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53d724-3a95-431d-ac15-2a133a429ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:45.400864 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53d724-3a95-431d-ac15-2a133a429ef6 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:45.401142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53d724-3a95-431d-ac15-2a133a429ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:45.401413 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53d724-3a95-431d-ac15-2a133a429ef6 None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:45.402198 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53d724-3a95-431d-ac15-2a133a429ef6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:45.402538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53d724-3a95-431d-ac15-2a133a429ef6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:45.403983 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53d724-3a95-431d-ac15-2a133a429ef6 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:45.421284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 614/1227] 10.222.0.86 () {56 vars in 1143 bytes} [Tue Jul 26 14:43:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:45.427016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602bc46-4bdd-4cf1-b1d4-c3d3d0d84e09 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:45.526871 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602bc46-4bdd-4cf1-b1d4-c3d3d0d84e09 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:45.560962 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca88563-c52d-4490-80ec-4cb39801c96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:45.561599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca88563-c52d-4490-80ec-4cb39801c96e None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:45.561885 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca88563-c52d-4490-80ec-4cb39801c96e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:45.562164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca88563-c52d-4490-80ec-4cb39801c96e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:45.572892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca88563-c52d-4490-80ec-4cb39801c96e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:45.574326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca88563-c52d-4490-80ec-4cb39801c96e None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:45.588402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-8ca88563-c52d-4490-80ec-4cb39801c96e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:45.588402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:45.588402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:45.588402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:45.588402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:45.588402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:45.588402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:45.588402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:45.588402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:45.588402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:45.588402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:45.588402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:45.588402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:43:45.588402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:43:45.588402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:43:45.590750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:43:45.590750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:45.590750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:45.590750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:45.590750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:45.590750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:45.590750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:45.590750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:45.590750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:45.590750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:45.590750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:45.590750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:45.590750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:45.590750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:45.590750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:45.590750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:45.590750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:45.591695 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:43:45.591695 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:43:45.591695 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:45.591695 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:43:45.591695 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 614/1228] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:45.603779 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53d724-3a95-431d-ac15-2a133a429ef6 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:45.704428 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53d724-3a95-431d-ac15-2a133a429ef6 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:45.706714 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:45.737481 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787abcce-7abe-4516-8ba1-c67f8c883e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:45.738093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787abcce-7abe-4516-8ba1-c67f8c883e06 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:45.738372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787abcce-7abe-4516-8ba1-c67f8c883e06 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:45.738674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787abcce-7abe-4516-8ba1-c67f8c883e06 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:45.739352 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787abcce-7abe-4516-8ba1-c67f8c883e06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:45.739653 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787abcce-7abe-4516-8ba1-c67f8c883e06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:45.741605 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787abcce-7abe-4516-8ba1-c67f8c883e06 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:45.752722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 615/1229] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:45.759047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca88563-c52d-4490-80ec-4cb39801c96e None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:45.768280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:45.858375 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca88563-c52d-4490-80ec-4cb39801c96e None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:45.890113 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb46174-dec1-497c-bd5c-6e7a0353aed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:45.890790 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb46174-dec1-497c-bd5c-6e7a0353aed4 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:45.891078 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb46174-dec1-497c-bd5c-6e7a0353aed4 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:45.891366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb46174-dec1-497c-bd5c-6e7a0353aed4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:45.899449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb46174-dec1-497c-bd5c-6e7a0353aed4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:45.900933 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb46174-dec1-497c-bd5c-6e7a0353aed4 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:45.913356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-0fb46174-dec1-497c-bd5c-6e7a0353aed4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:43:45.913356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:45.913356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:45.913356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:45.913356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:45.913356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:45.913356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:45.913356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:45.913356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:45.913356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:45.913356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:45.913356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:45.913356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:43:45.913356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:43:45.913356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:43:45.925154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:43:45.925154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:45.925154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:45.925154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:45.925154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:45.925154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:45.925154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:45.925154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:45.925154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:45.925154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:45.925154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:45.925154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:45.925154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:45.925154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:45.925154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:45.925154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:45.925154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:45.926422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:43:45.926422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:43:45.926422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:43:45.926422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:43:45.926422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:43:45.926422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:43:45.926422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:43:45.926422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:43:45.926422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 615/1230] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:45.927086 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787abcce-7abe-4516-8ba1-c67f8c883e06 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:46.018366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787abcce-7abe-4516-8ba1-c67f8c883e06 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:46.051576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4deb3-dfd1-4524-a0cb-750ab08ce70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:46.052195 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4deb3-dfd1-4524-a0cb-750ab08ce70c None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:46.052478 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4deb3-dfd1-4524-a0cb-750ab08ce70c None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:46.052753 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4deb3-dfd1-4524-a0cb-750ab08ce70c None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:46.053557 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4deb3-dfd1-4524-a0cb-750ab08ce70c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:46.053865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4deb3-dfd1-4524-a0cb-750ab08ce70c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:46.055324 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4deb3-dfd1-4524-a0cb-750ab08ce70c None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:46.067373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 616/1231] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:46.073659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb46174-dec1-497c-bd5c-6e7a0353aed4 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:46.139332 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:46.173663 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb46174-dec1-497c-bd5c-6e7a0353aed4 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:46.208519 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f0532-fe08-4c72-8d10-3e653a08252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:46.209182 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f0532-fe08-4c72-8d10-3e653a08252a None admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:46.210002 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f0532-fe08-4c72-8d10-3e653a08252a None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:46.210290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f0532-fe08-4c72-8d10-3e653a08252a None admin] PATH_INFO: `/v3/projects/12937bc17f02483285f18c492fe237e3/users/0fab620bc5d044479746d8ea17615a74/roles/7f17a5a0295f42e793e343cff968367c` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:46.224512 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f0532-fe08-4c72-8d10-3e653a08252a None admin] RBAC: Authorizing `identity:create_grant(project_id=12937bc17f02483285f18c492fe237e3, user_id=0fab620bc5d044479746d8ea17615a74, role_id=7f17a5a0295f42e793e343cff968367c)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:46.225958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f0532-fe08-4c72-8d10-3e653a08252a None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:46.310482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 616/1232] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:43:46 2022] PUT /identity/v3/projects/12937bc17f02483285f18c492fe237e3/users/0fab620bc5d044479746d8ea17615a74/roles/7f17a5a0295f42e793e343cff968367c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:43:48.311155 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97080c8a-0e65-4f7c-96d3-2ff77dd6c603 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:48.311711 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97080c8a-0e65-4f7c-96d3-2ff77dd6c603 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:48.311711 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97080c8a-0e65-4f7c-96d3-2ff77dd6c603 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:48.313053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 617/1233] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:43:48.318145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ee3a2-f00d-436b-93b0-5c8ed1e70e68 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:48.318568 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ee3a2-f00d-436b-93b0-5c8ed1e70e68 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:48.318812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ee3a2-f00d-436b-93b0-5c8ed1e70e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:48.337900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-7f2ee3a2-f00d-436b-93b0-5c8ed1e70e68 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:43:48.339129 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-7f2ee3a2-f00d-436b-93b0-5c8ed1e70e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:43:48.408275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 617/1234] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:43:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:43:48.431470 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97080c8a-0e65-4f7c-96d3-2ff77dd6c603 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:48.460188 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:48.537104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97080c8a-0e65-4f7c-96d3-2ff77dd6c603 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:48.571714 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcb190-8b4b-4e85-8078-f9bf40365cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:48.572319 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcb190-8b4b-4e85-8078-f9bf40365cb8 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:48.572596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcb190-8b4b-4e85-8078-f9bf40365cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:48.572866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcb190-8b4b-4e85-8078-f9bf40365cb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:48.582764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bcb190-8b4b-4e85-8078-f9bf40365cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:43:48.588141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-c3bcb190-8b4b-4e85-8078-f9bf40365cb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:43:48.588141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:48.588141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:48.588141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:48.588141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:48.588141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:48.588141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:48.588141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:48.588141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:48.588141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:48.588141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:48.588141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:48.588141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:43:48.588141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:43:48.588141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:43:48.588141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:43:48.589245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:43:48.589245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:43:48.589245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:43:48.589245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:43:48.589245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:48.589245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:48.589245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:48.589245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:48.589245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:48.589245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:48.589245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:48.589245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:48.589245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:48.589245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:48.589245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:48.589245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:48.590126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:48.590126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:48.590126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:48.590126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:48.590126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:43:48.590126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:43:48.590126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:43:48.590126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:43:48.590126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:43:48.590126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:43:48.590126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:43:48.590126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:43:48.590126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 618/1235] 10.222.0.86 () {56 vars in 1102 bytes} [Tue Jul 26 14:43:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:48.595278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ee3a2-f00d-436b-93b0-5c8ed1e70e68 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:48.641737 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:48.692945 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ee3a2-f00d-436b-93b0-5c8ed1e70e68 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:48.726674 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319463f-1208-4bab-a7be-975e91d046cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:48.727285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319463f-1208-4bab-a7be-975e91d046cf None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:48.727565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319463f-1208-4bab-a7be-975e91d046cf None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:48.727841 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319463f-1208-4bab-a7be-975e91d046cf None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:48.728546 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319463f-1208-4bab-a7be-975e91d046cf None admin] RBAC: Adding query filter params (name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:48.728851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319463f-1208-4bab-a7be-975e91d046cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:48.730219 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319463f-1208-4bab-a7be-975e91d046cf None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:48.738277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 618/1236] 10.222.0.86 () {56 vars in 1103 bytes} [Tue Jul 26 14:43:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:48.744522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcb190-8b4b-4e85-8078-f9bf40365cb8 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:48.828375 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:48.843942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcb190-8b4b-4e85-8078-f9bf40365cb8 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:48.878137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79962a0-b549-4901-9b76-351b0fd8c82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:48.878802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79962a0-b549-4901-9b76-351b0fd8c82d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:48.879083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79962a0-b549-4901-9b76-351b0fd8c82d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:48.879352 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79962a0-b549-4901-9b76-351b0fd8c82d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:48.889442 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79962a0-b549-4901-9b76-351b0fd8c82d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:48.890921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79962a0-b549-4901-9b76-351b0fd8c82d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:48.905054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-f79962a0-b549-4901-9b76-351b0fd8c82d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:48.905054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:48.905054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:48.905054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:48.905054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:48.905054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:48.905054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:48.905054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:48.905054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:48.905054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:48.905054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:48.905054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:48.905054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:43:48.905054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:43:48.905054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:43:48.912953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:43:48.912953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:48.912953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:48.912953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:48.912953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:48.912953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:48.912953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:48.912953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:48.912953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:48.912953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:48.912953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:48.912953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:48.912953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:48.912953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:48.912953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:48.912953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:48.912953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:48.913964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:43:48.913964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:43:48.913964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:48.913964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:43:48.913964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 619/1237] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:48.914506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319463f-1208-4bab-a7be-975e91d046cf None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:49.012984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319463f-1208-4bab-a7be-975e91d046cf None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:49.022370 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:49.047091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c2e06-884c-4e68-9f25-578381aaf4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:49.047722 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c2e06-884c-4e68-9f25-578381aaf4bd None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:49.048005 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c2e06-884c-4e68-9f25-578381aaf4bd None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:49.048281 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c2e06-884c-4e68-9f25-578381aaf4bd None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:49.048964 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c2e06-884c-4e68-9f25-578381aaf4bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:49.049270 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c2e06-884c-4e68-9f25-578381aaf4bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:49.050673 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c2e06-884c-4e68-9f25-578381aaf4bd None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:49.061965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 619/1238] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:49.067660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79962a0-b549-4901-9b76-351b0fd8c82d None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:49.168418 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79962a0-b549-4901-9b76-351b0fd8c82d None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:49.201094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58d03e-c959-4aef-88f2-707755f1b25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:49.201727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58d03e-c959-4aef-88f2-707755f1b25e None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:49.202010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58d03e-c959-4aef-88f2-707755f1b25e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:49.202283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58d03e-c959-4aef-88f2-707755f1b25e None admin] PATH_INFO: `/v3/users/placement` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:49.205008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:49.209996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58d03e-c959-4aef-88f2-707755f1b25e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:49.211562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58d03e-c959-4aef-88f2-707755f1b25e None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:49.222584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-4e58d03e-c959-4aef-88f2-707755f1b25e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:43:49.222584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:49.222584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:49.222584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:49.222584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:49.222584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:49.222584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:49.222584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:49.222584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:49.222584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:49.222584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:49.222584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:49.222584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:43:49.222584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:43:49.222584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:43:49.222584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:43:49.223665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:49.223665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:49.223665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:43:49.223665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:43:49.223665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:43:49.223665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:43:49.223665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:49.223665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:49.223665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:49.223665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:49.223665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:49.223665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:49.223665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:49.223665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:49.223665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:49.223665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:49.223665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:49.223665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:49.225610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:49.225610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:49.225610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:43:49.225610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:43:49.225610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:43:49.225610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:43:49.225610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:43:49.225610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:43:49.225610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:43:49.225610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:43:49.225610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 620/1239] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:43:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:49.230223 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c2e06-884c-4e68-9f25-578381aaf4bd None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:49.334157 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c2e06-884c-4e68-9f25-578381aaf4bd None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:49.369000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01db06-585b-44f5-9e50-a26b85e18cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:49.369611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01db06-585b-44f5-9e50-a26b85e18cce None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:49.370011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01db06-585b-44f5-9e50-a26b85e18cce None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:49.370296 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01db06-585b-44f5-9e50-a26b85e18cce None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:49.371122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01db06-585b-44f5-9e50-a26b85e18cce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:49.371434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01db06-585b-44f5-9e50-a26b85e18cce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:49.372862 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01db06-585b-44f5-9e50-a26b85e18cce None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:49.390680 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 620/1240] 10.222.0.86 () {56 vars in 1143 bytes} [Tue Jul 26 14:43:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:49.396687 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58d03e-c959-4aef-88f2-707755f1b25e None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:49.500021 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58d03e-c959-4aef-88f2-707755f1b25e None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:49.534308 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920577d-abe5-45e2-9db4-cdc523df5923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:49.534961 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920577d-abe5-45e2-9db4-cdc523df5923 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:49.535245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920577d-abe5-45e2-9db4-cdc523df5923 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:49.535523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920577d-abe5-45e2-9db4-cdc523df5923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:49.595807 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:49.602191 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920577d-abe5-45e2-9db4-cdc523df5923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:49.603677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920577d-abe5-45e2-9db4-cdc523df5923 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:49.712715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 621/1241] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:43:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:43:49.721217 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01db06-585b-44f5-9e50-a26b85e18cce None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:49.749863 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:49.824237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01db06-585b-44f5-9e50-a26b85e18cce None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:49.858418 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551c57f-419b-4d8e-8bd1-635439e82ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:49.859066 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551c57f-419b-4d8e-8bd1-635439e82ac3 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:49.859392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551c57f-419b-4d8e-8bd1-635439e82ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:49.859644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551c57f-419b-4d8e-8bd1-635439e82ac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:49.870329 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551c57f-419b-4d8e-8bd1-635439e82ac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:49.871854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551c57f-419b-4d8e-8bd1-635439e82ac3 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:49.887483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-7551c57f-419b-4d8e-8bd1-635439e82ac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:49.887483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:49.887483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:49.887483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:49.887483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:49.887483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:49.887483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:49.887483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:49.887483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:49.887483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:49.887483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:49.887483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:49.887483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:43:49.887483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:43:49.887483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:43:49.888506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:43:49.888506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:49.888506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:49.888506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:49.888506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:49.888506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:49.888506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:49.888506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:49.888506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:49.888506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:49.888506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:49.888506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:49.888506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:49.888506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:49.888506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:49.888506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:49.888506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:49.889462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:43:49.889462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:43:49.889462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:49.889462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:43:49.889462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 621/1242] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:43:49.894796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920577d-abe5-45e2-9db4-cdc523df5923 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:49.987851 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:49.993998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920577d-abe5-45e2-9db4-cdc523df5923 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:50.028407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2263c6d-520f-4ea4-9f00-193e04582c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:50.029020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2263c6d-520f-4ea4-9f00-193e04582c04 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:50.029305 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2263c6d-520f-4ea4-9f00-193e04582c04 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:50.029582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2263c6d-520f-4ea4-9f00-193e04582c04 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:50.030269 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2263c6d-520f-4ea4-9f00-193e04582c04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:50.030602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2263c6d-520f-4ea4-9f00-193e04582c04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:50.031982 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2263c6d-520f-4ea4-9f00-193e04582c04 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:50.044316 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 622/1243] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:50.050127 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551c57f-419b-4d8e-8bd1-635439e82ac3 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:50.157393 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:50.179031 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551c57f-419b-4d8e-8bd1-635439e82ac3 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:50.211960 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d99b7d-e90a-4f45-9599-194a39823808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:50.212594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d99b7d-e90a-4f45-9599-194a39823808 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:50.212873 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d99b7d-e90a-4f45-9599-194a39823808 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:50.213147 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d99b7d-e90a-4f45-9599-194a39823808 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:50.219888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d99b7d-e90a-4f45-9599-194a39823808 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:50.224520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d99b7d-e90a-4f45-9599-194a39823808 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:50.233380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-17d99b7d-e90a-4f45-9599-194a39823808 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:43:50.233380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:50.233380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:50.233380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:50.233380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:50.233380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:50.233380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:50.233380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:50.233380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:50.233380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:50.233380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:50.233380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:50.233380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:43:50.233380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:43:50.233380 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:43:50.234434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:43:50.234434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:50.234434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:50.234434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:50.234434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:50.234434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:50.234434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:50.234434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:50.234434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:50.234434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:50.234434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:50.234434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:50.234434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:50.234434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:50.234434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:50.234434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:50.234434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:50.235403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:43:50.235403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:43:50.235403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:43:50.235403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:43:50.235403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:43:50.235403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:43:50.235403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:43:50.235403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:43:50.235403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 622/1244] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:43:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:50.241999 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2263c6d-520f-4ea4-9f00-193e04582c04 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:50.341077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2263c6d-520f-4ea4-9f00-193e04582c04 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:50.374702 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee7f75-e725-42bb-ade1-9136c21baffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:50.375318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee7f75-e725-42bb-ade1-9136c21baffb None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:50.375601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee7f75-e725-42bb-ade1-9136c21baffb None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:50.376193 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee7f75-e725-42bb-ade1-9136c21baffb None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:50.376889 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee7f75-e725-42bb-ade1-9136c21baffb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:50.377195 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee7f75-e725-42bb-ade1-9136c21baffb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:50.378640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee7f75-e725-42bb-ade1-9136c21baffb None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:50.390974 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 623/1245] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:43:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:50.397097 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d99b7d-e90a-4f45-9599-194a39823808 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:50.520474 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d99b7d-e90a-4f45-9599-194a39823808 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:50.554437 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250da57-4d0e-4d2c-a277-00bb1ad816d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:50.555056 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250da57-4d0e-4d2c-a277-00bb1ad816d1 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:50.555336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250da57-4d0e-4d2c-a277-00bb1ad816d1 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:50.555609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250da57-4d0e-4d2c-a277-00bb1ad816d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:50.556384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250da57-4d0e-4d2c-a277-00bb1ad816d1 None admin] RBAC: Adding query filter params (role.id=7f17a5a0295f42e793e343cff968367c, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=0fab620bc5d044479746d8ea17615a74) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:50.556694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250da57-4d0e-4d2c-a277-00bb1ad816d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:50.558115 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250da57-4d0e-4d2c-a277-00bb1ad816d1 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:50.563750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 623/1246] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:43:50 2022] GET /identity/v3/role_assignments?user.id=0fab620bc5d044479746d8ea17615a74&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=7f17a5a0295f42e793e343cff968367c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:52.642468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49043556-3b5e-4fef-8f41-0dd2951fc357 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:52.643053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49043556-3b5e-4fef-8f41-0dd2951fc357 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:52.643053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49043556-3b5e-4fef-8f41-0dd2951fc357 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:52.644378 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 624/1247] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:43:52.650059 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71526f1-c545-4ec4-8772-e0bb2cb911e1 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:52.650479 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71526f1-c545-4ec4-8772-e0bb2cb911e1 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:52.650661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71526f1-c545-4ec4-8772-e0bb2cb911e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:52.657046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:52.670137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-f71526f1-c545-4ec4-8772-e0bb2cb911e1 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:43:52.671447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-f71526f1-c545-4ec4-8772-e0bb2cb911e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:43:52.735056 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 624/1248] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:43:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:43:52.758624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49043556-3b5e-4fef-8f41-0dd2951fc357 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:52.777130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:52.859359 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49043556-3b5e-4fef-8f41-0dd2951fc357 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:52.895852 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc1025-c2b6-494f-a74e-d0a8e40224e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:52.896442 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc1025-c2b6-494f-a74e-d0a8e40224e8 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:52.896791 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc1025-c2b6-494f-a74e-d0a8e40224e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:52.897575 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc1025-c2b6-494f-a74e-d0a8e40224e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:52.907610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc1025-c2b6-494f-a74e-d0a8e40224e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:43:52.913156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-2ecc1025-c2b6-494f-a74e-d0a8e40224e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:43:52.913156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:52.913156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:52.913156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:52.913156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:52.913156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:52.913156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:52.913156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:52.913156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:52.913156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:52.913156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:52.913156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:52.913156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:43:52.913156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:43:52.913156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:43:52.913156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:43:52.914283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:43:52.914283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:43:52.914283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:43:52.914283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:43:52.914283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:52.914283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:52.914283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:52.914283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:52.914283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:52.914283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:52.914283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:52.914283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:52.914283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:52.914283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:52.914283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:52.914283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:52.915273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:52.915273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:52.915273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:52.915273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:52.915273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:43:52.915273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:43:52.915273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:43:52.915273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:43:52.915273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:43:52.915273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:43:52.915273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:43:52.915273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:43:52.915273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 625/1249] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:43:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:52.920300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71526f1-c545-4ec4-8772-e0bb2cb911e1 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:53.018097 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71526f1-c545-4ec4-8772-e0bb2cb911e1 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:53.047477 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:53.052290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62625a83-6651-4ffc-9e14-ecdfa552f1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:53.052911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62625a83-6651-4ffc-9e14-ecdfa552f1be None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:53.053757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62625a83-6651-4ffc-9e14-ecdfa552f1be None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:53.054040 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62625a83-6651-4ffc-9e14-ecdfa552f1be None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:53.054933 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62625a83-6651-4ffc-9e14-ecdfa552f1be None admin] RBAC: Adding query filter params (name=admin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:53.055105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62625a83-6651-4ffc-9e14-ecdfa552f1be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:53.056482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62625a83-6651-4ffc-9e14-ecdfa552f1be None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:53.064589 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 625/1250] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:43:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:53.070663 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc1025-c2b6-494f-a74e-d0a8e40224e8 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:53.147192 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:53.169439 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc1025-c2b6-494f-a74e-d0a8e40224e8 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:53.201664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6698ab-2c93-4b1b-8ffc-96d05fc33b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:53.202342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6698ab-2c93-4b1b-8ffc-96d05fc33b3f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:53.202660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6698ab-2c93-4b1b-8ffc-96d05fc33b3f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:53.202939 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6698ab-2c93-4b1b-8ffc-96d05fc33b3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:53.214242 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6698ab-2c93-4b1b-8ffc-96d05fc33b3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:53.215729 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6698ab-2c93-4b1b-8ffc-96d05fc33b3f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:53.230116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-4a6698ab-2c93-4b1b-8ffc-96d05fc33b3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:53.230116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:53.230116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:53.230116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:53.230116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:53.230116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:53.230116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:53.230116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:53.230116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:53.230116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:53.230116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:53.230116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:53.230116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:43:53.230116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:43:53.230116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:43:53.231294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:43:53.231294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:53.231294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:53.231294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:53.231294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:53.231294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:53.231294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:53.231294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:53.231294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:53.231294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:53.231294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:53.231294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:53.231294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:53.231294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:53.231294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:53.231294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:53.231294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:53.232400 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:43:53.232400 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:43:53.232400 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:53.232400 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:43:53.232400 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 626/1251] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:53.237745 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62625a83-6651-4ffc-9e14-ecdfa552f1be None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:53.346676 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62625a83-6651-4ffc-9e14-ecdfa552f1be None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:53.380599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1bf0c-a701-4a43-98b7-00afee3b16d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:53.381215 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1bf0c-a701-4a43-98b7-00afee3b16d6 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:53.381499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1bf0c-a701-4a43-98b7-00afee3b16d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:53.381778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1bf0c-a701-4a43-98b7-00afee3b16d6 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:53.382496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1bf0c-a701-4a43-98b7-00afee3b16d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:53.382836 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1bf0c-a701-4a43-98b7-00afee3b16d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:53.384253 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1bf0c-a701-4a43-98b7-00afee3b16d6 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:53.396610 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 626/1252] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:53.402979 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6698ab-2c93-4b1b-8ffc-96d05fc33b3f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:53.505733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6698ab-2c93-4b1b-8ffc-96d05fc33b3f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:53.533882 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:53.541950 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e36bb1-8b19-40ba-839a-d9f1b350aff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:53.542642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e36bb1-8b19-40ba-839a-d9f1b350aff2 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:53.542934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e36bb1-8b19-40ba-839a-d9f1b350aff2 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:53.543209 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e36bb1-8b19-40ba-839a-d9f1b350aff2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:53.550689 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e36bb1-8b19-40ba-839a-d9f1b350aff2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:53.552126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e36bb1-8b19-40ba-839a-d9f1b350aff2 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:53.563285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-33e36bb1-8b19-40ba-839a-d9f1b350aff2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:43:53.563285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:53.563285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:53.563285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:53.563285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:53.563285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:53.563285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:53.563285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:53.563285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:53.563285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:53.563285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:53.563285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:53.563285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:43:53.563285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:43:53.563285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:43:53.563285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:43:53.564402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:53.564402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:53.564402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:43:53.564402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:43:53.564402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:43:53.564402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:43:53.564402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:53.564402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:53.564402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:53.564402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:53.564402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:53.564402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:53.564402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:53.564402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:53.564402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:53.564402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:53.564402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:53.564402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:53.565523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:53.565523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:53.565523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:43:53.565523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:43:53.565523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:43:53.565523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:43:53.565523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:43:53.565523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:43:53.565523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:43:53.565523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:43:53.565523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 627/1253] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:43:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:53.570523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1bf0c-a701-4a43-98b7-00afee3b16d6 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:53.626738 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:53.682494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1bf0c-a701-4a43-98b7-00afee3b16d6 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:53.716980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118a456-a98b-41c4-a1ff-c7e777789074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:53.717596 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118a456-a98b-41c4-a1ff-c7e777789074 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:53.717879 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118a456-a98b-41c4-a1ff-c7e777789074 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:53.718160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118a456-a98b-41c4-a1ff-c7e777789074 None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:53.718976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118a456-a98b-41c4-a1ff-c7e777789074 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:53.719282 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118a456-a98b-41c4-a1ff-c7e777789074 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:53.720708 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118a456-a98b-41c4-a1ff-c7e777789074 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:53.737696 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 627/1254] 10.222.0.86 () {56 vars in 1143 bytes} [Tue Jul 26 14:43:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:53.743619 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e36bb1-8b19-40ba-839a-d9f1b350aff2 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:53.848395 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e36bb1-8b19-40ba-839a-d9f1b350aff2 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:53.882737 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca010ad-e617-46a9-8fd4-65124d8538c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:53.883383 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca010ad-e617-46a9-8fd4-65124d8538c2 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:53.883659 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca010ad-e617-46a9-8fd4-65124d8538c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:53.884006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca010ad-e617-46a9-8fd4-65124d8538c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:53.939644 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:53.951872 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca010ad-e617-46a9-8fd4-65124d8538c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:53.956416 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca010ad-e617-46a9-8fd4-65124d8538c2 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:54.061989 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 628/1255] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:43:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:43:54.069821 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118a456-a98b-41c4-a1ff-c7e777789074 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:54.185261 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118a456-a98b-41c4-a1ff-c7e777789074 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:54.200520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:54.223153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41301e9-adec-469e-a1a6-eb77a5d110f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:54.225642 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41301e9-adec-469e-a1a6-eb77a5d110f1 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:54.225642 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41301e9-adec-469e-a1a6-eb77a5d110f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:54.225642 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41301e9-adec-469e-a1a6-eb77a5d110f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:54.235771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41301e9-adec-469e-a1a6-eb77a5d110f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:54.237235 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41301e9-adec-469e-a1a6-eb77a5d110f1 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:54.252499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-a41301e9-adec-469e-a1a6-eb77a5d110f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:54.252499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:54.252499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:54.252499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:54.252499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:54.252499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:54.252499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:54.252499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:54.252499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:54.252499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:54.252499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:54.252499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:54.252499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:43:54.252499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:43:54.252499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:43:54.253569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:43:54.253569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:54.253569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:54.253569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:54.253569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:54.253569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:54.253569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:54.253569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:54.253569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:54.253569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:54.253569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:54.253569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:54.253569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:54.253569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:54.253569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:54.253569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:54.253569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:54.256124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:43:54.256124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:43:54.256124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:54.256124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:43:54.256124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 628/1256] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:54.259886 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca010ad-e617-46a9-8fd4-65124d8538c2 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:54.362136 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:54.378174 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca010ad-e617-46a9-8fd4-65124d8538c2 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:54.418409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a1dde-5b34-45cb-b25a-791c52e7ec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:54.419069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a1dde-5b34-45cb-b25a-791c52e7ec33 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:54.420609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a1dde-5b34-45cb-b25a-791c52e7ec33 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:54.421203 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a1dde-5b34-45cb-b25a-791c52e7ec33 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:54.422707 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a1dde-5b34-45cb-b25a-791c52e7ec33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:54.423067 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a1dde-5b34-45cb-b25a-791c52e7ec33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:54.424504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a1dde-5b34-45cb-b25a-791c52e7ec33 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:54.436582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 629/1257] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:54.442664 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41301e9-adec-469e-a1a6-eb77a5d110f1 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:54.564058 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41301e9-adec-469e-a1a6-eb77a5d110f1 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:54.603063 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14106fa2-f376-41a9-a85a-6aa4d193c2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:54.603705 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14106fa2-f376-41a9-a85a-6aa4d193c2bc None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:54.604038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14106fa2-f376-41a9-a85a-6aa4d193c2bc None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:54.604315 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14106fa2-f376-41a9-a85a-6aa4d193c2bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:54.611892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14106fa2-f376-41a9-a85a-6aa4d193c2bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:54.613503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14106fa2-f376-41a9-a85a-6aa4d193c2bc None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:54.626212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-14106fa2-f376-41a9-a85a-6aa4d193c2bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:43:54.626212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:54.626212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:54.626212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:54.626212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:54.626212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:54.626212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:54.626212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:54.626212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:54.626212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:54.626212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:54.626212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:54.626212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:43:54.626212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:43:54.626212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:43:54.628299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:43:54.628299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:54.628299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:54.628299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:54.628299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:54.628299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:54.628299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:54.628299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:54.628299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:54.628299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:54.628299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:54.628299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:54.628299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:54.628299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:54.628299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:54.628299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:54.628299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:54.629912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:43:54.629912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:43:54.629912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:43:54.629912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:43:54.629912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:43:54.629912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:43:54.629912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:43:54.629912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:43:54.629912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 629/1258] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:54.634495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a1dde-5b34-45cb-b25a-791c52e7ec33 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:54.749902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a1dde-5b34-45cb-b25a-791c52e7ec33 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:54.790151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c72d5-8a7f-4224-bc0d-3cb39a4e0d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:54.790799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c72d5-8a7f-4224-bc0d-3cb39a4e0d2d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:54.792500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c72d5-8a7f-4224-bc0d-3cb39a4e0d2d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:54.792500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c72d5-8a7f-4224-bc0d-3cb39a4e0d2d None admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:54.792500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c72d5-8a7f-4224-bc0d-3cb39a4e0d2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:54.792500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c72d5-8a7f-4224-bc0d-3cb39a4e0d2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:54.793778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c72d5-8a7f-4224-bc0d-3cb39a4e0d2d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:54.806477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 630/1259] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:43:54.813797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14106fa2-f376-41a9-a85a-6aa4d193c2bc None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:54.842613 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:54.924556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14106fa2-f376-41a9-a85a-6aa4d193c2bc None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:54.962883 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c482b-cc8c-4c2c-86ea-841ca1366695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:54.963500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c482b-cc8c-4c2c-86ea-841ca1366695 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:54.963786 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c482b-cc8c-4c2c-86ea-841ca1366695 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:54.964086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c482b-cc8c-4c2c-86ea-841ca1366695 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:54.964846 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c482b-cc8c-4c2c-86ea-841ca1366695 None admin] RBAC: Adding query filter params (role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=0fab620bc5d044479746d8ea17615a74) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:54.965158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c482b-cc8c-4c2c-86ea-841ca1366695 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:54.966610 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c482b-cc8c-4c2c-86ea-841ca1366695 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:54.972006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 630/1260] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:43:54 2022] GET /identity/v3/role_assignments?user.id=0fab620bc5d044479746d8ea17615a74&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:57.000297 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce31ee4-bd5f-4641-9f22-0209a8c031e6 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:57.000835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce31ee4-bd5f-4641-9f22-0209a8c031e6 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:57.000835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce31ee4-bd5f-4641-9f22-0209a8c031e6 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:57.002535 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 631/1261] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:43:57.007739 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379303db-5c78-4e10-8775-cabf2d5f374d None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:57.008152 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379303db-5c78-4e10-8775-cabf2d5f374d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:57.008305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379303db-5c78-4e10-8775-cabf2d5f374d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:57.027600 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-379303db-5c78-4e10-8775-cabf2d5f374d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:43:57.028801 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-379303db-5c78-4e10-8775-cabf2d5f374d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:43:57.096291 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 631/1262] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:43:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:43:57.119553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce31ee4-bd5f-4641-9f22-0209a8c031e6 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:57.130838 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:57.220472 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce31ee4-bd5f-4641-9f22-0209a8c031e6 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:57.254464 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73998db1-b10d-4c48-818a-acbf4c597554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:57.255066 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73998db1-b10d-4c48-818a-acbf4c597554 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:57.255394 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73998db1-b10d-4c48-818a-acbf4c597554 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:57.255673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73998db1-b10d-4c48-818a-acbf4c597554 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:57.266532 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73998db1-b10d-4c48-818a-acbf4c597554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:43:57.271482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-73998db1-b10d-4c48-818a-acbf4c597554 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:43:57.271482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:57.271482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:57.271482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:57.271482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:57.271482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:57.271482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:57.271482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:57.271482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:57.271482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:57.271482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:57.271482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:57.271482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:43:57.271482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:43:57.271482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:43:57.271482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:43:57.273391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:43:57.273391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:43:57.273391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:43:57.273391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:43:57.273391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:57.273391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:57.273391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:57.273391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:57.273391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:57.273391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:57.273391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:57.273391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:57.273391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:57.273391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:57.273391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:57.273391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:57.274205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:57.274205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:57.274205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:57.274205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:57.274205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:43:57.274205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:43:57.274205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:43:57.274205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:43:57.274205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:43:57.274205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:43:57.274205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:43:57.274205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:43:57.274205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 632/1263] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:43:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:57.279370 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379303db-5c78-4e10-8775-cabf2d5f374d None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:57.304059 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:57.383709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379303db-5c78-4e10-8775-cabf2d5f374d None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:57.417135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1f8f7-b47c-4631-a7ca-0b431b39336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:57.417785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1f8f7-b47c-4631-a7ca-0b431b39336f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:57.418064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1f8f7-b47c-4631-a7ca-0b431b39336f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:57.418338 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1f8f7-b47c-4631-a7ca-0b431b39336f None admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:57.419077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1f8f7-b47c-4631-a7ca-0b431b39336f None admin] RBAC: Adding query filter params (name=admin) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:57.419382 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1f8f7-b47c-4631-a7ca-0b431b39336f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:57.420749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1f8f7-b47c-4631-a7ca-0b431b39336f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:57.429307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 632/1264] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:43:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:57.435157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73998db1-b10d-4c48-818a-acbf4c597554 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:57.513081 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:57.546612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73998db1-b10d-4c48-818a-acbf4c597554 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:57.583072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0bd8b9-1635-4246-b82b-d1cea568e4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:57.583772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bd8b9-1635-4246-b82b-d1cea568e4a7 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:57.584062 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bd8b9-1635-4246-b82b-d1cea568e4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:57.584926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bd8b9-1635-4246-b82b-d1cea568e4a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:57.597569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bd8b9-1635-4246-b82b-d1cea568e4a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:57.599078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bd8b9-1635-4246-b82b-d1cea568e4a7 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:57.613704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-3b0bd8b9-1635-4246-b82b-d1cea568e4a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:57.613704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:57.613704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:57.613704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:57.613704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:57.613704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:57.613704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:57.613704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:57.613704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:57.613704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:57.613704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:57.613704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:57.613704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:43:57.613704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:43:57.613704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:43:57.614747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:43:57.614747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:57.614747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:57.614747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:57.614747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:57.614747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:57.614747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:57.614747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:57.614747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:57.614747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:57.614747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:57.614747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:57.614747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:57.614747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:57.614747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:57.614747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:57.614747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:57.616094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:43:57.616094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:43:57.616094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:57.616094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:43:57.616094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 633/1265] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:57.620719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1f8f7-b47c-4631-a7ca-0b431b39336f None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:57.708588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:57.728734 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1f8f7-b47c-4631-a7ca-0b431b39336f None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:57.764200 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec3bc6-b43d-4e95-a4c6-c782561e68a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:57.764748 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec3bc6-b43d-4e95-a4c6-c782561e68a6 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:57.765147 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec3bc6-b43d-4e95-a4c6-c782561e68a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:57.765439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec3bc6-b43d-4e95-a4c6-c782561e68a6 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:57.766143 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec3bc6-b43d-4e95-a4c6-c782561e68a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:57.766747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec3bc6-b43d-4e95-a4c6-c782561e68a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:57.768897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec3bc6-b43d-4e95-a4c6-c782561e68a6 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:57.780828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 633/1266] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:57.789475 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0bd8b9-1635-4246-b82b-d1cea568e4a7 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:57.890191 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0bd8b9-1635-4246-b82b-d1cea568e4a7 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:57.913465 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:57.927200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbcfa5-438f-4384-83d8-81e4b979433b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:57.928447 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbcfa5-438f-4384-83d8-81e4b979433b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:57.928795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbcfa5-438f-4384-83d8-81e4b979433b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:57.929080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbcfa5-438f-4384-83d8-81e4b979433b None admin] PATH_INFO: `/v3/users/placement` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:57.937900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbcfa5-438f-4384-83d8-81e4b979433b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:57.939368 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbcfa5-438f-4384-83d8-81e4b979433b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:57.950863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-93bbcfa5-438f-4384-83d8-81e4b979433b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:43:57.950863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:57.950863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:57.950863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:57.950863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:57.950863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:57.950863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:57.950863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:57.950863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:57.950863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:57.950863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:57.950863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:57.950863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:43:57.950863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:43:57.950863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:43:57.950863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:43:57.958327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:57.958327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:57.958327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:43:57.958327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:43:57.958327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:43:57.958327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:43:57.958327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:57.958327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:57.958327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:57.958327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:57.958327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:57.958327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:57.958327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:57.958327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:57.958327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:57.958327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:57.958327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:57.958327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:57.959604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:57.959604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:57.959604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:43:57.959604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:43:57.959604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:43:57.959604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:43:57.959604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:43:57.959604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:43:57.959604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:43:57.959604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:43:57.959604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 634/1267] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:43:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:57.960245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec3bc6-b43d-4e95-a4c6-c782561e68a6 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:58.059063 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec3bc6-b43d-4e95-a4c6-c782561e68a6 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:58.092513 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae6468-7c3a-4737-ba2e-f4e57a600a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:58.093138 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae6468-7c3a-4737-ba2e-f4e57a600a40 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:58.093486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae6468-7c3a-4737-ba2e-f4e57a600a40 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:58.093700 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae6468-7c3a-4737-ba2e-f4e57a600a40 None admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:58.094516 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae6468-7c3a-4737-ba2e-f4e57a600a40 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:58.094832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae6468-7c3a-4737-ba2e-f4e57a600a40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:58.096275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae6468-7c3a-4737-ba2e-f4e57a600a40 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:58.105325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:58.113698 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 634/1268] 10.222.0.86 () {56 vars in 1143 bytes} [Tue Jul 26 14:43:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:43:58.119734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbcfa5-438f-4384-83d8-81e4b979433b None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:58.219600 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbcfa5-438f-4384-83d8-81e4b979433b None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:58.252160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158dbe5-e2c7-4737-b0cd-fe1d787b764b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:58.252790 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158dbe5-e2c7-4737-b0cd-fe1d787b764b None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:58.253067 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158dbe5-e2c7-4737-b0cd-fe1d787b764b None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:58.253339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158dbe5-e2c7-4737-b0cd-fe1d787b764b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:58.264186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158dbe5-e2c7-4737-b0cd-fe1d787b764b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:58.265752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158dbe5-e2c7-4737-b0cd-fe1d787b764b None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:58.280051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-5158dbe5-e2c7-4737-b0cd-fe1d787b764b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:58.280051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:58.280051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:58.280051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:58.280051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:58.280051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:58.280051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:58.280051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:58.280051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:58.280051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:58.280051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:58.280051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:58.280051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:43:58.280051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:43:58.280051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:43:58.281253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:43:58.281253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:58.281253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:58.281253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:58.281253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:58.281253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:58.281253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:58.281253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:58.281253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:58.281253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:58.281253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:58.281253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:58.281253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:58.281253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:58.281253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:58.281253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:58.281253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:58.291249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:43:58.291249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:43:58.291249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:43:58.291249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:43:58.291249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 635/1269] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:58.291594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae6468-7c3a-4737-ba2e-f4e57a600a40 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:58.385884 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae6468-7c3a-4737-ba2e-f4e57a600a40 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:58.421055 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b61485-540d-42dd-94f9-62d56666f080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:58.421689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b61485-540d-42dd-94f9-62d56666f080 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:58.421979 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b61485-540d-42dd-94f9-62d56666f080 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:58.422290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b61485-540d-42dd-94f9-62d56666f080 None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:58.423061 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b61485-540d-42dd-94f9-62d56666f080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:58.423370 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b61485-540d-42dd-94f9-62d56666f080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:58.424776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b61485-540d-42dd-94f9-62d56666f080 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:58.436753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 635/1270] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:58.442609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158dbe5-e2c7-4737-b0cd-fe1d787b764b None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:58.473860 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:58.543569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158dbe5-e2c7-4737-b0cd-fe1d787b764b None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:58.579391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef3f84-3475-4028-813e-101392265d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:58.580034 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef3f84-3475-4028-813e-101392265d7d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:58.580317 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef3f84-3475-4028-813e-101392265d7d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:58.580595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef3f84-3475-4028-813e-101392265d7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:58.590517 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef3f84-3475-4028-813e-101392265d7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:58.591963 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef3f84-3475-4028-813e-101392265d7d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:58.606008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-13ef3f84-3475-4028-813e-101392265d7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:43:58.606008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:58.606008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:58.606008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:58.606008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:58.606008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:58.606008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:58.606008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:58.606008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:58.606008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:58.606008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:58.606008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:58.606008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:43:58.606008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:43:58.606008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:43:58.607139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:43:58.607139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:58.607139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:58.607139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:58.607139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:58.607139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:58.607139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:58.607139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:58.607139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:58.607139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:58.607139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:58.607139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:58.607139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:58.607139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:58.607139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:58.607139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:58.607139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:58.608440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:43:58.608440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:43:58.608440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:43:58.608440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:43:58.608440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:43:58.608440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:43:58.608440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:43:58.608440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:43:58.608440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 636/1271] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:43:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:58.613357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b61485-540d-42dd-94f9-62d56666f080 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:58.675701 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:58.717875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b61485-540d-42dd-94f9-62d56666f080 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:58.752567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26469e7f-e65a-4589-bf2a-b596f3fce003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:58.753212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26469e7f-e65a-4589-bf2a-b596f3fce003 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:58.753485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26469e7f-e65a-4589-bf2a-b596f3fce003 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:58.753765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26469e7f-e65a-4589-bf2a-b596f3fce003 None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:58.754635 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26469e7f-e65a-4589-bf2a-b596f3fce003 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:58.754950 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26469e7f-e65a-4589-bf2a-b596f3fce003 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:58.756959 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26469e7f-e65a-4589-bf2a-b596f3fce003 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:58.769746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 636/1272] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:58.775842 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef3f84-3475-4028-813e-101392265d7d None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:58.867963 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:58.876642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef3f84-3475-4028-813e-101392265d7d None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:58.910905 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3444433-b78d-4797-98d2-5356b2fdbbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:58.911574 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3444433-b78d-4797-98d2-5356b2fdbbea None admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:58.911852 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3444433-b78d-4797-98d2-5356b2fdbbea None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:58.912123 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3444433-b78d-4797-98d2-5356b2fdbbea None admin] PATH_INFO: `/v3/projects/12937bc17f02483285f18c492fe237e3/users/0fab620bc5d044479746d8ea17615a74/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:58.914808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3444433-b78d-4797-98d2-5356b2fdbbea None admin] RBAC: Authorizing `identity:create_grant(project_id=12937bc17f02483285f18c492fe237e3, user_id=0fab620bc5d044479746d8ea17615a74, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:58.916223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3444433-b78d-4797-98d2-5356b2fdbbea None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:59.059886 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 637/1273] 10.222.0.86 () {58 vars in 1439 bytes} [Tue Jul 26 14:43:58 2022] PUT /identity/v3/projects/12937bc17f02483285f18c492fe237e3/users/0fab620bc5d044479746d8ea17615a74/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:44:01.090273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03603e94-5c9f-4b85-9652-6ecde35ad7ef None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:01.090828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03603e94-5c9f-4b85-9652-6ecde35ad7ef None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:01.090946 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03603e94-5c9f-4b85-9652-6ecde35ad7ef None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:01.092342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 637/1274] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:44:01.097379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09401a-5530-4c77-963f-568ae7a549f7 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:01.097797 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09401a-5530-4c77-963f-568ae7a549f7 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:01.097937 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09401a-5530-4c77-963f-568ae7a549f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:01.116904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-eb09401a-5530-4c77-963f-568ae7a549f7 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:44:01.118094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-eb09401a-5530-4c77-963f-568ae7a549f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:44:01.184546 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 638/1275] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:44:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:44:01.208535 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03603e94-5c9f-4b85-9652-6ecde35ad7ef None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:01.311114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03603e94-5c9f-4b85-9652-6ecde35ad7ef None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:01.328702 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:01.345388 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69206c-bd8f-41fa-99af-efd9a552b861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:01.345968 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69206c-bd8f-41fa-99af-efd9a552b861 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:01.346255 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69206c-bd8f-41fa-99af-efd9a552b861 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:01.346609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69206c-bd8f-41fa-99af-efd9a552b861 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:01.357304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69206c-bd8f-41fa-99af-efd9a552b861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:44:01.362288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-df69206c-bd8f-41fa-99af-efd9a552b861 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:44:01.362288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:44:01.362288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:44:01.362288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:44:01.362288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:44:01.362288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:44:01.362288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:44:01.362288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:44:01.362288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:44:01.362288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:44:01.362288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:44:01.362288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:44:01.362288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:44:01.362288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:44:01.362288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:44:01.362288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:44:01.367359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:44:01.367359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:44:01.367359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:44:01.367359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:44:01.367359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:44:01.367359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:44:01.367359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:44:01.367359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:44:01.367359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:44:01.367359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:44:01.367359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:44:01.367359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:44:01.367359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:44:01.367359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:44:01.367359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:44:01.367359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:44:01.368366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:44:01.368366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:44:01.368366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:44:01.368366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:44:01.368366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:44:01.368366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:44:01.368366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:44:01.368366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:44:01.368366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:44:01.368366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:44:01.368366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:44:01.368366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:44:01.368366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 638/1276] 10.222.0.86 () {56 vars in 1096 bytes} [Tue Jul 26 14:44:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:44:01.370374 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09401a-5530-4c77-963f-568ae7a549f7 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:01.451864 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:01.469101 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09401a-5530-4c77-963f-568ae7a549f7 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:01.502490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9e21d-dcd0-47a9-847c-94f7613e2fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:01.503068 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9e21d-dcd0-47a9-847c-94f7613e2fa0 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:01.503348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9e21d-dcd0-47a9-847c-94f7613e2fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:01.503621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9e21d-dcd0-47a9-847c-94f7613e2fa0 None admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:01.504322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9e21d-dcd0-47a9-847c-94f7613e2fa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:44:01.504624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9e21d-dcd0-47a9-847c-94f7613e2fa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:01.505996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9e21d-dcd0-47a9-847c-94f7613e2fa0 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:01.514134 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 639/1277] 10.222.0.86 () {56 vars in 1099 bytes} [Tue Jul 26 14:44:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:44:01.520037 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69206c-bd8f-41fa-99af-efd9a552b861 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:01.622799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69206c-bd8f-41fa-99af-efd9a552b861 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:01.656753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7518e7c-fe3f-4e08-b0c0-5b66bd474813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:01.657396 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7518e7c-fe3f-4e08-b0c0-5b66bd474813 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:01.657683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7518e7c-fe3f-4e08-b0c0-5b66bd474813 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:01.657962 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7518e7c-fe3f-4e08-b0c0-5b66bd474813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:01.668506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7518e7c-fe3f-4e08-b0c0-5b66bd474813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:01.670062 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7518e7c-fe3f-4e08-b0c0-5b66bd474813 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:01.685312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-d7518e7c-fe3f-4e08-b0c0-5b66bd474813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:44:01.685312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:44:01.685312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:44:01.685312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:44:01.685312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:44:01.685312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:44:01.685312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:44:01.685312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:44:01.685312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:44:01.685312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:44:01.685312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:44:01.685312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:44:01.685312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:44:01.685312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:44:01.685312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:44:01.686424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:44:01.686424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:44:01.686424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:44:01.686424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:44:01.686424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:44:01.686424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:44:01.686424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:44:01.686424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:44:01.686424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:44:01.686424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:44:01.686424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:44:01.686424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:44:01.686424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:44:01.686424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:44:01.686424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:44:01.686424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:44:01.686424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:44:01.687763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:44:01.687763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:44:01.687763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:44:01.687763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:44:01.687763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 639/1278] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:44:01.692264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9e21d-dcd0-47a9-847c-94f7613e2fa0 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:01.802227 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9e21d-dcd0-47a9-847c-94f7613e2fa0 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:01.837277 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad925f1e-4fe8-4eaf-bd0d-9f635ca50220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:01.837888 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad925f1e-4fe8-4eaf-bd0d-9f635ca50220 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:01.838170 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad925f1e-4fe8-4eaf-bd0d-9f635ca50220 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:01.838471 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad925f1e-4fe8-4eaf-bd0d-9f635ca50220 None admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:01.839152 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad925f1e-4fe8-4eaf-bd0d-9f635ca50220 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:44:01.839453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad925f1e-4fe8-4eaf-bd0d-9f635ca50220 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:01.840861 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad925f1e-4fe8-4eaf-bd0d-9f635ca50220 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:01.853943 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 640/1279] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:44:01.861792 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7518e7c-fe3f-4e08-b0c0-5b66bd474813 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:01.892767 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:01.966993 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7518e7c-fe3f-4e08-b0c0-5b66bd474813 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:02.002910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f915cd-a739-4427-b4c7-287c5838c642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:02.003555 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f915cd-a739-4427-b4c7-287c5838c642 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:02.003838 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f915cd-a739-4427-b4c7-287c5838c642 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:02.005812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f915cd-a739-4427-b4c7-287c5838c642 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:02.012640 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f915cd-a739-4427-b4c7-287c5838c642 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:02.014113 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f915cd-a739-4427-b4c7-287c5838c642 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:02.028814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-20f915cd-a739-4427-b4c7-287c5838c642 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:44:02.028814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:44:02.028814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:44:02.028814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:44:02.028814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:44:02.028814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:44:02.028814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:44:02.028814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:44:02.028814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:44:02.028814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:44:02.028814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:44:02.028814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:44:02.028814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:44:02.028814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:44:02.028814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:44:02.028814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:44:02.034556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:44:02.034556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:44:02.034556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:44:02.034556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:44:02.034556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:44:02.034556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:44:02.034556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:44:02.034556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:44:02.034556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:44:02.034556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:44:02.034556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:44:02.034556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:44:02.034556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:44:02.034556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:44:02.034556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:44:02.034556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:44:02.034556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:44:02.034556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:44:02.035733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:44:02.035733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:44:02.035733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:44:02.035733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:44:02.035733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:44:02.035733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:44:02.035733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:44:02.035733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:44:02.035733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:44:02.035733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:44:02.035733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 640/1280] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:44:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:44:02.036933 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad925f1e-4fe8-4eaf-bd0d-9f635ca50220 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:02.041811 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:02.141011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad925f1e-4fe8-4eaf-bd0d-9f635ca50220 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:02.177045 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032dbd5-b3f5-42d3-b648-40572ae2752f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:02.177632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032dbd5-b3f5-42d3-b648-40572ae2752f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:02.177957 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032dbd5-b3f5-42d3-b648-40572ae2752f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:02.178313 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032dbd5-b3f5-42d3-b648-40572ae2752f None admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:02.179128 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032dbd5-b3f5-42d3-b648-40572ae2752f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:44:02.179434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032dbd5-b3f5-42d3-b648-40572ae2752f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:02.180853 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032dbd5-b3f5-42d3-b648-40572ae2752f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:02.199871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 641/1281] 10.222.0.86 () {56 vars in 1143 bytes} [Tue Jul 26 14:44:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:44:02.205819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f915cd-a739-4427-b4c7-287c5838c642 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:02.298203 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:02.307982 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f915cd-a739-4427-b4c7-287c5838c642 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:02.346515 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f8625-bf24-43ff-af97-c0388a738722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:02.347157 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f8625-bf24-43ff-af97-c0388a738722 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:02.347485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f8625-bf24-43ff-af97-c0388a738722 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:02.347767 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f8625-bf24-43ff-af97-c0388a738722 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:02.419238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f8625-bf24-43ff-af97-c0388a738722 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:02.420838 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f8625-bf24-43ff-af97-c0388a738722 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:02.512833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:02.523289 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 641/1282] 10.222.0.86 () {58 vars in 1282 bytes} [Tue Jul 26 14:44:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:44:02.529528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032dbd5-b3f5-42d3-b648-40572ae2752f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:02.589831 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:02.628128 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032dbd5-b3f5-42d3-b648-40572ae2752f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:02.665611 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe696e-b95e-4266-b530-a1aaa56e401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:02.666783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe696e-b95e-4266-b530-a1aaa56e401f None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:02.667288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe696e-b95e-4266-b530-a1aaa56e401f None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:02.667759 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe696e-b95e-4266-b530-a1aaa56e401f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:02.686059 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe696e-b95e-4266-b530-a1aaa56e401f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:02.687720 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe696e-b95e-4266-b530-a1aaa56e401f None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:02.704490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-61fe696e-b95e-4266-b530-a1aaa56e401f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:44:02.704490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:44:02.704490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:44:02.704490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:44:02.704490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:44:02.704490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:44:02.704490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:44:02.704490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:44:02.704490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:44:02.704490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:44:02.704490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:44:02.704490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:44:02.704490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:44:02.704490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:44:02.704490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:44:02.705624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:44:02.705624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:44:02.705624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:44:02.705624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:44:02.705624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:44:02.705624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:44:02.705624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:44:02.705624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:44:02.705624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:44:02.705624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:44:02.705624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:44:02.705624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:44:02.705624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:44:02.705624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:44:02.705624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:44:02.705624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:44:02.705624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:44:02.706563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:44:02.706563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:44:02.706563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:44:02.706563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:44:02.706563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 642/1283] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:44:02.712694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f8625-bf24-43ff-af97-c0388a738722 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:02.821819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f8625-bf24-43ff-af97-c0388a738722 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:02.857705 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a5cf4-ea40-42dc-af09-7dd4e4340dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:02.858350 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a5cf4-ea40-42dc-af09-7dd4e4340dff None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:02.858676 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a5cf4-ea40-42dc-af09-7dd4e4340dff None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:02.858960 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a5cf4-ea40-42dc-af09-7dd4e4340dff None admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:02.859678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a5cf4-ea40-42dc-af09-7dd4e4340dff None admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:44:02.860040 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a5cf4-ea40-42dc-af09-7dd4e4340dff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:02.861571 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a5cf4-ea40-42dc-af09-7dd4e4340dff None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:02.879573 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 642/1284] 10.222.0.86 () {56 vars in 1109 bytes} [Tue Jul 26 14:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:44:02.880704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe696e-b95e-4266-b530-a1aaa56e401f None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:02.988599 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe696e-b95e-4266-b530-a1aaa56e401f None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:03.003356 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:03.025270 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f9ecf-5555-4a8f-9b29-020ec42d8101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:03.025912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f9ecf-5555-4a8f-9b29-020ec42d8101 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:03.026191 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f9ecf-5555-4a8f-9b29-020ec42d8101 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:03.026600 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f9ecf-5555-4a8f-9b29-020ec42d8101 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:03.033164 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f9ecf-5555-4a8f-9b29-020ec42d8101 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:03.034614 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f9ecf-5555-4a8f-9b29-020ec42d8101 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:03.046171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application [None req-8e6f9ecf-5555-4a8f-9b29-020ec42d8101 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:44:03.046171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:44:03.046171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:44:03.046171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:44:03.046171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:44:03.046171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:44:03.046171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:44:03.046171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:44:03.046171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:44:03.046171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:44:03.046171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:44:03.046171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:44:03.046171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:44:03.046171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:44:03.046171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:44:03.047240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:44:03.047240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:44:03.047240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:44:03.047240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:44:03.047240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:44:03.047240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:44:03.047240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:44:03.047240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:44:03.047240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application with Lock( Jul 26 14:44:03.047240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:44:03.047240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:44:03.047240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:44:03.047240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:44:03.047240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:44:03.047240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:44:03.047240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:44:03.047240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:44:03.048419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:44:03.048419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:44:03.048419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:44:03.048419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:44:03.048419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:44:03.048419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:44:03.048419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:44:03.048419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: ERROR keystone.server.flask.application Jul 26 14:44:03.048419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 643/1285] 10.222.0.86 () {56 vars in 1111 bytes} [Tue Jul 26 14:44:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:44:03.054192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a5cf4-ea40-42dc-af09-7dd4e4340dff None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:03.111738 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:03.162086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a5cf4-ea40-42dc-af09-7dd4e4340dff None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:03.194609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f788f8-2222-4e72-ad60-88e0c027d07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:03.195231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f788f8-2222-4e72-ad60-88e0c027d07d None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:03.195517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f788f8-2222-4e72-ad60-88e0c027d07d None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:03.195797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f788f8-2222-4e72-ad60-88e0c027d07d None admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:03.196542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f788f8-2222-4e72-ad60-88e0c027d07d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:44:03.196854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f788f8-2222-4e72-ad60-88e0c027d07d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:03.198293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f788f8-2222-4e72-ad60-88e0c027d07d None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:03.210685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 643/1286] 10.222.0.86 () {56 vars in 1148 bytes} [Tue Jul 26 14:44:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:44:03.216874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f9ecf-5555-4a8f-9b29-020ec42d8101 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:03.316700 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f9ecf-5555-4a8f-9b29-020ec42d8101 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:03.350497 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47a90e-dfa2-4ba3-a020-20cd4211250d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:03.351123 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47a90e-dfa2-4ba3-a020-20cd4211250d None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:03.351387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47a90e-dfa2-4ba3-a020-20cd4211250d None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:03.351662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47a90e-dfa2-4ba3-a020-20cd4211250d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:03.352449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47a90e-dfa2-4ba3-a020-20cd4211250d None admin] RBAC: Adding query filter params (role.id=2dbdd0a2fb714172ab27b1ceec0a3b80, scope.project.id=12937bc17f02483285f18c492fe237e3, user.id=0fab620bc5d044479746d8ea17615a74) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:44:03.352759 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47a90e-dfa2-4ba3-a020-20cd4211250d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:03.354184 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47a90e-dfa2-4ba3-a020-20cd4211250d None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:03.360152 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 644/1287] 10.222.0.86 () {56 vars in 1374 bytes} [Tue Jul 26 14:44:03 2022] GET /identity/v3/role_assignments?user.id=0fab620bc5d044479746d8ea17615a74&scope.project.id=12937bc17f02483285f18c492fe237e3&role.id=2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:44:05.439710 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810630e-a6d5-4e95-a322-cf63f9cbf74a None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:05.440229 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810630e-a6d5-4e95-a322-cf63f9cbf74a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:05.440348 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810630e-a6d5-4e95-a322-cf63f9cbf74a None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:05.441616 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 644/1288] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:44:05.447575 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a37d8-11bb-4485-8242-e1cef3a11f23 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:05.447953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a37d8-11bb-4485-8242-e1cef3a11f23 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:05.448131 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a37d8-11bb-4485-8242-e1cef3a11f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:05.466106 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-4a6a37d8-11bb-4485-8242-e1cef3a11f23 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:44:05.467328 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4a6a37d8-11bb-4485-8242-e1cef3a11f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:44:05.497269 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:05.534998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 645/1289] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:44:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:44:05.557868 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810630e-a6d5-4e95-a322-cf63f9cbf74a None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:05.664486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810630e-a6d5-4e95-a322-cf63f9cbf74a None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:05.676327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:05.701368 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b779714-140e-4bb5-b7af-380203aa276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:05.701992 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b779714-140e-4bb5-b7af-380203aa276e None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:05.702342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b779714-140e-4bb5-b7af-380203aa276e None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:05.706536 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b779714-140e-4bb5-b7af-380203aa276e None admin] PATH_INFO: `/v3/services/placement` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:05.706536 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b779714-140e-4bb5-b7af-380203aa276e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:05.706536 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b779714-140e-4bb5-b7af-380203aa276e None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:05.714299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-0b779714-140e-4bb5-b7af-380203aa276e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 14:44:05.714299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:44:05.714299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:44:05.714299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:44:05.714299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:44:05.714299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:44:05.714299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:44:05.714299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:44:05.714299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 14:44:05.714299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:44:05.714299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:44:05.714299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:44:05.714299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:44:05.714299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:44:05.714299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:44:05.714299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:44:05.714299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:44:05.715768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:44:05.715768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:44:05.715768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:44:05.715768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:44:05.715768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:44:05.715768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:44:05.715768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:44:05.715768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:44:05.715768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:44:05.715768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:44:05.715768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:44:05.715768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:44:05.715768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:44:05.715768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:44:05.715768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:44:05.715768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:44:05.716709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:44:05.716709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:44:05.716709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:44:05.716709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:44:05.716709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:44:05.716709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:44:05.716709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:44:05.716709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:44:05.716709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:44:05.716709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:44:05.716709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:44:05.716709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:44:05.716709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 14:44:05.716709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:44:05.716709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 645/1290] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jul 26 14:44:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:44:05.725194 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a37d8-11bb-4485-8242-e1cef3a11f23 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:05.832711 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a37d8-11bb-4485-8242-e1cef3a11f23 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:05.867205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a54c0-827d-4cbf-b7c5-9558d4e15691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:05.867840 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a54c0-827d-4cbf-b7c5-9558d4e15691 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:05.868124 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a54c0-827d-4cbf-b7c5-9558d4e15691 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:05.868407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a54c0-827d-4cbf-b7c5-9558d4e15691 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:05.869084 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a54c0-827d-4cbf-b7c5-9558d4e15691 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:44:05.869394 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a54c0-827d-4cbf-b7c5-9558d4e15691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:05.870793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a54c0-827d-4cbf-b7c5-9558d4e15691 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:05.875588 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 646/1291] 10.222.0.86 () {56 vars in 1116 bytes} [Tue Jul 26 14:44:05 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:44:05.882316 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b779714-140e-4bb5-b7af-380203aa276e None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:05.992695 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b779714-140e-4bb5-b7af-380203aa276e None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:06.030273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7fcdf-28b8-4019-b82d-5f8524e2c050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:06.030988 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7fcdf-28b8-4019-b82d-5f8524e2c050 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:06.031275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7fcdf-28b8-4019-b82d-5f8524e2c050 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:06.031587 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7fcdf-28b8-4019-b82d-5f8524e2c050 None admin] PATH_INFO: `/v3/services` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:06.032251 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7fcdf-28b8-4019-b82d-5f8524e2c050 None admin] RBAC: Adding query filter params (type=placement) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:44:06.032558 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7fcdf-28b8-4019-b82d-5f8524e2c050 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:06.033920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7fcdf-28b8-4019-b82d-5f8524e2c050 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:06.038583 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 646/1292] 10.222.0.86 () {56 vars in 1116 bytes} [Tue Jul 26 14:44:05 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:44:08.074512 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0c172-2772-4053-a8f1-d77e5c010e0c None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:08.075095 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0c172-2772-4053-a8f1-d77e5c010e0c None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:08.075095 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0c172-2772-4053-a8f1-d77e5c010e0c None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:08.076490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 647/1293] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:44:08.081953 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09279a-4337-46c8-a8d8-54527c2d451c None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:08.082381 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09279a-4337-46c8-a8d8-54527c2d451c None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:08.084608 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09279a-4337-46c8-a8d8-54527c2d451c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:08.101136 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-bc09279a-4337-46c8-a8d8-54527c2d451c None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:44:08.102340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-bc09279a-4337-46c8-a8d8-54527c2d451c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:44:08.132280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:08.170350 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 647/1294] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:44:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:44:08.192680 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0c172-2772-4053-a8f1-d77e5c010e0c None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:08.222610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:08.294802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0c172-2772-4053-a8f1-d77e5c010e0c None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:08.328468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9955c73-9a63-4a37-af1c-ef8b10cf6470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:08.329019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9955c73-9a63-4a37-af1c-ef8b10cf6470 None admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:08.329302 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9955c73-9a63-4a37-af1c-ef8b10cf6470 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:08.329577 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9955c73-9a63-4a37-af1c-ef8b10cf6470 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:08.330270 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9955c73-9a63-4a37-af1c-ef8b10cf6470 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:08.331706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9955c73-9a63-4a37-af1c-ef8b10cf6470 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:08.402239 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 648/1295] 10.222.0.86 () {60 vars in 1141 bytes} [Tue Jul 26 14:44:08 2022] POST /identity/v3/services => generated 246 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:44:10.409095 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434e8ff-af81-4a2f-b026-0446376fecca None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:10.409648 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434e8ff-af81-4a2f-b026-0446376fecca None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:10.409648 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434e8ff-af81-4a2f-b026-0446376fecca None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:10.411058 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 648/1296] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:44:10.416873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493d736-bba2-4681-9992-2c6eb82c71a0 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:10.417271 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493d736-bba2-4681-9992-2c6eb82c71a0 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:10.417458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493d736-bba2-4681-9992-2c6eb82c71a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:10.436206 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-f493d736-bba2-4681-9992-2c6eb82c71a0 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:44:10.437446 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f493d736-bba2-4681-9992-2c6eb82c71a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:44:10.511342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 649/1297] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:44:10 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:44:10.534839 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434e8ff-af81-4a2f-b026-0446376fecca None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:10.638411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434e8ff-af81-4a2f-b026-0446376fecca None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:10.673079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ee322-7e73-4088-b5c0-91df16e49986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:10.673728 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ee322-7e73-4088-b5c0-91df16e49986 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:10.674014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ee322-7e73-4088-b5c0-91df16e49986 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:10.674293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ee322-7e73-4088-b5c0-91df16e49986 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:10.674964 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ee322-7e73-4088-b5c0-91df16e49986 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:10.676340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ee322-7e73-4088-b5c0-91df16e49986 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:10.685311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-e74ee322-7e73-4088-b5c0-91df16e49986 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 14:44:10.685311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:44:10.685311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:44:10.685311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:44:10.685311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:44:10.685311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:44:10.685311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:44:10.685311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:44:10.685311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 14:44:10.685311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:44:10.685311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:44:10.685311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:44:10.685311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:44:10.685311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:44:10.685311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:44:10.685311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:44:10.685311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:44:10.686503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:44:10.686503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:44:10.686503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:44:10.686503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:44:10.686503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:44:10.686503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:44:10.686503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:44:10.686503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:44:10.686503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:44:10.686503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:44:10.686503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:44:10.686503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:44:10.686503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:44:10.686503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:44:10.686503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:44:10.686503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:44:10.687363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:44:10.687363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:44:10.687363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:44:10.687363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:44:10.687363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:44:10.687363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:44:10.687363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:44:10.687363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:44:10.687363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:44:10.687363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:44:10.687363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:44:10.687363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:44:10.687363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 14:44:10.687363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:44:10.687363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 649/1298] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jul 26 14:44:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:44:10.693235 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493d736-bba2-4681-9992-2c6eb82c71a0 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:10.711976 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:10.794858 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493d736-bba2-4681-9992-2c6eb82c71a0 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:10.828738 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9b638-59d3-4e56-814b-90d0fbbeb5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:10.829360 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9b638-59d3-4e56-814b-90d0fbbeb5c1 None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:10.829641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9b638-59d3-4e56-814b-90d0fbbeb5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:10.829923 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9b638-59d3-4e56-814b-90d0fbbeb5c1 None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:10.830621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9b638-59d3-4e56-814b-90d0fbbeb5c1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:44:10.830930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9b638-59d3-4e56-814b-90d0fbbeb5c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:10.832292 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9b638-59d3-4e56-814b-90d0fbbeb5c1 None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:10.837933 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 650/1299] 10.222.0.86 () {56 vars in 1116 bytes} [Tue Jul 26 14:44:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:44:10.844081 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ee322-7e73-4088-b5c0-91df16e49986 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:10.875928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:10.946087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ee322-7e73-4088-b5c0-91df16e49986 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:10.980567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52aaef2-394e-4059-a571-b3e8a23b3e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:10.981188 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52aaef2-394e-4059-a571-b3e8a23b3e3f None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:10.981476 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52aaef2-394e-4059-a571-b3e8a23b3e3f None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:10.981755 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52aaef2-394e-4059-a571-b3e8a23b3e3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:10.982596 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52aaef2-394e-4059-a571-b3e8a23b3e3f None admin] RBAC: Adding query filter params (interface=public, service_id=a1823408f94248df8041ce9c34d27819, region_id=RegionOne) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:44:10.982912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52aaef2-394e-4059-a571-b3e8a23b3e3f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:10.984287 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52aaef2-394e-4059-a571-b3e8a23b3e3f None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:10.989579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 650/1300] 10.222.0.86 () {56 vars in 1251 bytes} [Tue Jul 26 14:44:10 2022] GET /identity/v3/endpoints?service_id=a1823408f94248df8041ce9c34d27819&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:44:10.996022 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9b638-59d3-4e56-814b-90d0fbbeb5c1 None admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:11.077145 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:11.094683 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9b638-59d3-4e56-814b-90d0fbbeb5c1 None admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:11.128129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6288b0-9487-4c5c-81f8-7bc5ac660a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:11.128745 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6288b0-9487-4c5c-81f8-7bc5ac660a4e None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:11.129026 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6288b0-9487-4c5c-81f8-7bc5ac660a4e None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:11.129367 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6288b0-9487-4c5c-81f8-7bc5ac660a4e None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:11.129982 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6288b0-9487-4c5c-81f8-7bc5ac660a4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:11.131399 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6288b0-9487-4c5c-81f8-7bc5ac660a4e None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:11.138275 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 651/1301] 10.222.0.86 () {56 vars in 1087 bytes} [Tue Jul 26 14:44:10 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:44:13.208500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56577fc6-4c72-4da9-99d4-de5706ede8d5 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:13.209610 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56577fc6-4c72-4da9-99d4-de5706ede8d5 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:13.209858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56577fc6-4c72-4da9-99d4-de5706ede8d5 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:13.211342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 651/1302] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:44:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:44:13.216367 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4902a-a3f2-4c6d-a1b6-eb51a0b5fa89 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:13.216784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4902a-a3f2-4c6d-a1b6-eb51a0b5fa89 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:13.216920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4902a-a3f2-4c6d-a1b6-eb51a0b5fa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:13.235599 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-c1b4902a-a3f2-4c6d-a1b6-eb51a0b5fa89 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:44:13.236788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-c1b4902a-a3f2-4c6d-a1b6-eb51a0b5fa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:44:13.303750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 652/1303] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:44:13 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:44:13.326549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56577fc6-4c72-4da9-99d4-de5706ede8d5 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:13.424421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:13.432064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56577fc6-4c72-4da9-99d4-de5706ede8d5 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:13.475607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab59b55-009f-46a9-a1ae-be1bf4f97703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:13.476465 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab59b55-009f-46a9-a1ae-be1bf4f97703 None admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:13.476878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab59b55-009f-46a9-a1ae-be1bf4f97703 None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:13.477286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab59b55-009f-46a9-a1ae-be1bf4f97703 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:13.477915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab59b55-009f-46a9-a1ae-be1bf4f97703 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:13.479305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab59b55-009f-46a9-a1ae-be1bf4f97703 None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:13.491327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application [None req-fab59b55-009f-46a9-a1ae-be1bf4f97703 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 14:44:13.491327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:44:13.491327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:44:13.491327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:44:13.491327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:44:13.491327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:44:13.491327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:44:13.491327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:44:13.491327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 14:44:13.491327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:44:13.491327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:44:13.491327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:44:13.491327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:44:13.491327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:44:13.491327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:44:13.491327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:44:13.491327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:44:13.492485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:44:13.492485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:44:13.492485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:44:13.492485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:44:13.492485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:44:13.492485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:44:13.492485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:44:13.492485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:44:13.492485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:44:13.492485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:44:13.492485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:44:13.492485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:44:13.492485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:44:13.492485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:44:13.492485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:44:13.492485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:44:13.493385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:44:13.493385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application with Lock( Jul 26 14:44:13.493385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:44:13.493385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:44:13.493385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:44:13.493385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:44:13.493385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:44:13.493385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:44:13.493385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:44:13.493385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:44:13.493385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:44:13.493385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:44:13.493385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 14:44:13.493385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: ERROR keystone.server.flask.application Jul 26 14:44:13.493385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 652/1304] 10.222.0.86 () {56 vars in 1117 bytes} [Tue Jul 26 14:44:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:44:13.500908 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4902a-a3f2-4c6d-a1b6-eb51a0b5fa89 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:13.582799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:13.604541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4902a-a3f2-4c6d-a1b6-eb51a0b5fa89 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:13.638890 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5487e-a777-478a-89be-82da7858efbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:13.639513 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5487e-a777-478a-89be-82da7858efbc None admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:13.639801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5487e-a777-478a-89be-82da7858efbc None admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:13.640176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5487e-a777-478a-89be-82da7858efbc None admin] PATH_INFO: `/v3/services` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:13.640898 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5487e-a777-478a-89be-82da7858efbc None admin] RBAC: Adding query filter params (name=placement) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:44:13.641416 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5487e-a777-478a-89be-82da7858efbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:13.643141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5487e-a777-478a-89be-82da7858efbc None admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:13.648606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 653/1305] 10.222.0.86 () {56 vars in 1116 bytes} [Tue Jul 26 14:44:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:44:13.654514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab59b55-009f-46a9-a1ae-be1bf4f97703 None admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:44:13.757726 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab59b55-009f-46a9-a1ae-be1bf4f97703 None admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:44:13.791201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e209c-3d0a-4f9f-989e-746e71faa7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:44:13.791812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e209c-3d0a-4f9f-989e-746e71faa7ba None admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:44:13.792097 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e209c-3d0a-4f9f-989e-746e71faa7ba None admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:44:13.792377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e209c-3d0a-4f9f-989e-746e71faa7ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:44:13.793094 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e209c-3d0a-4f9f-989e-746e71faa7ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:44:13.794493 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e209c-3d0a-4f9f-989e-746e71faa7ba None admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:44:13.853595 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 653/1306] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:44:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:44:23.645578 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=30 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:23.848291 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:27.125875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ea448-b14a-4530-bcbf-541cd6c46664 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:27.126499 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ea448-b14a-4530-bcbf-541cd6c46664 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:27.126499 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ea448-b14a-4530-bcbf-541cd6c46664 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:27.128514 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 654/1307] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:50:27.134353 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7382f-b25d-4024-bdfd-2f5a0cb1b5ea None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:27.134914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7382f-b25d-4024-bdfd-2f5a0cb1b5ea None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:27.134999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7382f-b25d-4024-bdfd-2f5a0cb1b5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:27.294628 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-32f7382f-b25d-4024-bdfd-2f5a0cb1b5ea None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:50:27.295786 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-32f7382f-b25d-4024-bdfd-2f5a0cb1b5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:27.515008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 654/1308] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:50:27.584718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25c9f9-2443-4d1d-84dc-50a42f226b24 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:27.585007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25c9f9-2443-4d1d-84dc-50a42f226b24 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:27.585285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25c9f9-2443-4d1d-84dc-50a42f226b24 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:27.586960 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 655/1309] 10.222.0.86 () {54 vars in 965 bytes} [Tue Jul 26 14:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:50:27.603661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26116e-6b8a-4fc0-b8e9-82e5f8f02b15 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:27.603962 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26116e-6b8a-4fc0-b8e9-82e5f8f02b15 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:27.604252 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26116e-6b8a-4fc0-b8e9-82e5f8f02b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:27.769114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-cd26116e-6b8a-4fc0-b8e9-82e5f8f02b15 None None] MFA Rules not processed for user `e71086ec00454e26b24337e0876bfe89`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:50:27.771890 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-cd26116e-6b8a-4fc0-b8e9-82e5f8f02b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:27.826066 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:27.959159 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 655/1310] 10.222.0.86 () {58 vars in 1062 bytes} [Tue Jul 26 14:50:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:50:27.968533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25c9f9-2443-4d1d-84dc-50a42f226b24 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:50:27.970383 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8a25c9f9-2443-4d1d-84dc-50a42f226b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:28.115589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25c9f9-2443-4d1d-84dc-50a42f226b24 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:50:28.209061 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbb34e-aa92-40a9-8267-86a4d4d77bb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:50:28.210531 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbb34e-aa92-40a9-8267-86a4d4d77bb9 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:28.211024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbb34e-aa92-40a9-8267-86a4d4d77bb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:28.211741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbb34e-aa92-40a9-8267-86a4d4d77bb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:28.213751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2fcbb34e-aa92-40a9-8267-86a4d4d77bb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:28.279704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:28.340895 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbb34e-aa92-40a9-8267-86a4d4d77bb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:50:28.342517 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbb34e-aa92-40a9-8267-86a4d4d77bb9 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:50:28.363643 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 656/1311] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:50:30.713256 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45e25b-4376-45df-856f-e384f9ce19a2 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:30.713808 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45e25b-4376-45df-856f-e384f9ce19a2 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:30.713921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45e25b-4376-45df-856f-e384f9ce19a2 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:30.715264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 656/1312] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:50:30.720520 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fff78c-0dd3-4ab7-8212-c2cf9a61f8a1 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:30.720927 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fff78c-0dd3-4ab7-8212-c2cf9a61f8a1 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:30.721709 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fff78c-0dd3-4ab7-8212-c2cf9a61f8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:30.804758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-28fff78c-0dd3-4ab7-8212-c2cf9a61f8a1 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:50:30.806066 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-28fff78c-0dd3-4ab7-8212-c2cf9a61f8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:30.906057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 657/1313] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:50:30.944545 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45e25b-4376-45df-856f-e384f9ce19a2 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:50:30.946083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-fd45e25b-4376-45df-856f-e384f9ce19a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:31.051148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45e25b-4376-45df-856f-e384f9ce19a2 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:50:31.124054 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:31.126737 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde56e46-be88-43a8-b7f8-32831d06ae20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:50:31.127381 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde56e46-be88-43a8-b7f8-32831d06ae20 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:31.128217 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde56e46-be88-43a8-b7f8-32831d06ae20 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:31.128501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde56e46-be88-43a8-b7f8-32831d06ae20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:31.130101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-dde56e46-be88-43a8-b7f8-32831d06ae20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:31.240258 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde56e46-be88-43a8-b7f8-32831d06ae20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:50:31.241630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde56e46-be88-43a8-b7f8-32831d06ae20 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:50:31.263027 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 657/1314] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:50:33.935829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf8928-b11a-4f46-8495-5c23241f194d None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:33.936338 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf8928-b11a-4f46-8495-5c23241f194d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:33.936338 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf8928-b11a-4f46-8495-5c23241f194d None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:33.937834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 658/1315] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:50:33.943720 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fe988-f2a0-47e4-bb62-37a5726861c9 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:33.944153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fe988-f2a0-47e4-bb62-37a5726861c9 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:33.944266 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fe988-f2a0-47e4-bb62-37a5726861c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:34.010058 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-b33fe988-f2a0-47e4-bb62-37a5726861c9 None None] MFA Rules not processed for user `f8bac1b49f25469994adf34dd214fd0c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:50:34.011286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-b33fe988-f2a0-47e4-bb62-37a5726861c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:34.062961 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:34.108929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 658/1316] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:50:33 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:50:34.162003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95208f2a-5e95-4c9b-99ce-c9a30d3520ce None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:34.162300 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95208f2a-5e95-4c9b-99ce-c9a30d3520ce None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:34.162619 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95208f2a-5e95-4c9b-99ce-c9a30d3520ce None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:34.164001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 659/1317] 10.222.0.86 () {54 vars in 965 bytes} [Tue Jul 26 14:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:50:34.170046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f33b2f-730a-4e04-a483-11da9049fa9f None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:34.170344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f33b2f-730a-4e04-a483-11da9049fa9f None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:34.170655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f33b2f-730a-4e04-a483-11da9049fa9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:34.246483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-82f33b2f-730a-4e04-a483-11da9049fa9f None None] MFA Rules not processed for user `e71086ec00454e26b24337e0876bfe89`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:50:34.247647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-82f33b2f-730a-4e04-a483-11da9049fa9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:34.337241 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 659/1318] 10.222.0.86 () {58 vars in 1062 bytes} [Tue Jul 26 14:50:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:50:34.348364 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95208f2a-5e95-4c9b-99ce-c9a30d3520ce None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:50:34.349422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-95208f2a-5e95-4c9b-99ce-c9a30d3520ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:34.359537 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:34.453101 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95208f2a-5e95-4c9b-99ce-c9a30d3520ce None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:50:34.524755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f338dd-7864-47d6-a641-ecbc3ec8b1c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:50:34.525362 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f338dd-7864-47d6-a641-ecbc3ec8b1c0 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:34.525640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f338dd-7864-47d6-a641-ecbc3ec8b1c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:34.525913 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f338dd-7864-47d6-a641-ecbc3ec8b1c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:34.527548 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-73f338dd-7864-47d6-a641-ecbc3ec8b1c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:34.589396 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:34.635600 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f338dd-7864-47d6-a641-ecbc3ec8b1c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:50:34.637035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f338dd-7864-47d6-a641-ecbc3ec8b1c0 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:50:34.654859 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 660/1319] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:50:34 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:50:37.799086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd5288-1bf3-4233-8acf-b3f7ea89991d None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:37.799647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd5288-1bf3-4233-8acf-b3f7ea89991d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:37.799647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd5288-1bf3-4233-8acf-b3f7ea89991d None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:37.801029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 660/1320] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:50:37.806024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce703ab6-fed2-41eb-8e28-af565f25c78d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:37.806464 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce703ab6-fed2-41eb-8e28-af565f25c78d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:37.806609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce703ab6-fed2-41eb-8e28-af565f25c78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:37.870162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-ce703ab6-fed2-41eb-8e28-af565f25c78d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:50:37.871396 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ce703ab6-fed2-41eb-8e28-af565f25c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:37.966255 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 661/1321] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:50:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:50:38.012002 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd5288-1bf3-4233-8acf-b3f7ea89991d None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:50:38.013576 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-bfcd5288-1bf3-4233-8acf-b3f7ea89991d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:38.063914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:38.116315 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd5288-1bf3-4233-8acf-b3f7ea89991d None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:50:38.194627 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c79a2d-68cf-4528-a0f3-580a3712b8a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:50:38.195324 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c79a2d-68cf-4528-a0f3-580a3712b8a3 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:38.195612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c79a2d-68cf-4528-a0f3-580a3712b8a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:38.195897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c79a2d-68cf-4528-a0f3-580a3712b8a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:38.197693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c5c79a2d-68cf-4528-a0f3-580a3712b8a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:38.313617 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:38.328301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c79a2d-68cf-4528-a0f3-580a3712b8a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:50:38.329748 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c79a2d-68cf-4528-a0f3-580a3712b8a3 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:50:38.353107 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 661/1322] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:50:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:50:41.667964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd77c4d-b8b4-4389-9316-0758afe16d18 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:41.668424 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd77c4d-b8b4-4389-9316-0758afe16d18 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:41.668526 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd77c4d-b8b4-4389-9316-0758afe16d18 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:41.670086 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 662/1323] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:50:41.675688 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957ef21-1e02-4f65-aa1f-00a61ad69a1e None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:41.676065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957ef21-1e02-4f65-aa1f-00a61ad69a1e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:41.676252 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957ef21-1e02-4f65-aa1f-00a61ad69a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:41.743034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-3957ef21-1e02-4f65-aa1f-00a61ad69a1e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:50:41.744292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3957ef21-1e02-4f65-aa1f-00a61ad69a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:41.842871 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 662/1324] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:50:41.880715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd77c4d-b8b4-4389-9316-0758afe16d18 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:50:41.882354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4fd77c4d-b8b4-4389-9316-0758afe16d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:41.903245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:41.995146 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd77c4d-b8b4-4389-9316-0758afe16d18 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:50:42.073972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c602d3-ac4b-4de9-972e-74b3b33efd53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:50:42.074643 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c602d3-ac4b-4de9-972e-74b3b33efd53 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:42.074930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c602d3-ac4b-4de9-972e-74b3b33efd53 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:42.075215 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c602d3-ac4b-4de9-972e-74b3b33efd53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:42.076904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-c8c602d3-ac4b-4de9-972e-74b3b33efd53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:42.151649 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:42.189730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c602d3-ac4b-4de9-972e-74b3b33efd53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:50:42.191192 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c602d3-ac4b-4de9-972e-74b3b33efd53 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:50:42.210848 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 663/1325] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:50:44.290989 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da076e-c572-437d-9717-c3a7631904a9 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:44.291522 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da076e-c572-437d-9717-c3a7631904a9 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:44.291522 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da076e-c572-437d-9717-c3a7631904a9 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:44.293048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 663/1326] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:50:44.298114 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df65e37-3950-4592-bbcb-c899eb9df749 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:44.298540 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df65e37-3950-4592-bbcb-c899eb9df749 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:44.298713 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df65e37-3950-4592-bbcb-c899eb9df749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:44.365141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-8df65e37-3950-4592-bbcb-c899eb9df749 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:50:44.366278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8df65e37-3950-4592-bbcb-c899eb9df749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:44.468663 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 664/1327] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:50:44.505129 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da076e-c572-437d-9717-c3a7631904a9 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:50:44.506706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-49da076e-c572-437d-9717-c3a7631904a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:44.570056 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:44.613942 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da076e-c572-437d-9717-c3a7631904a9 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:50:44.694854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dd6ac-564a-431d-973e-748344e77513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:50:44.695478 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dd6ac-564a-431d-973e-748344e77513 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:44.695762 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dd6ac-564a-431d-973e-748344e77513 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:44.696040 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dd6ac-564a-431d-973e-748344e77513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:44.697736 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-db0dd6ac-564a-431d-973e-748344e77513 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:44.806826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:44.809067 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dd6ac-564a-431d-973e-748344e77513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:50:44.810536 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dd6ac-564a-431d-973e-748344e77513 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:50:44.828304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 664/1328] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:50:46.905668 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba760eb2-74cf-4a5e-ad58-4705ba0496b4 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:46.906221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba760eb2-74cf-4a5e-ad58-4705ba0496b4 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:46.906221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba760eb2-74cf-4a5e-ad58-4705ba0496b4 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:46.907604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 665/1329] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:50:46.913357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa92fc-2769-4675-8a00-ca4b17b7c894 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:46.913764 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa92fc-2769-4675-8a00-ca4b17b7c894 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:46.914000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa92fc-2769-4675-8a00-ca4b17b7c894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:46.983532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-79fa92fc-2769-4675-8a00-ca4b17b7c894 None None] MFA Rules not processed for user `f8bac1b49f25469994adf34dd214fd0c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:50:46.984700 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-79fa92fc-2769-4675-8a00-ca4b17b7c894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:47.085612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 665/1330] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:50:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:50:47.125013 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba760eb2-74cf-4a5e-ad58-4705ba0496b4 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:50:47.126656 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ba760eb2-74cf-4a5e-ad58-4705ba0496b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:47.157178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:47.232462 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba760eb2-74cf-4a5e-ad58-4705ba0496b4 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:50:47.318806 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec74eb5-d1ee-4916-af99-764eb87920b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:50:47.319424 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec74eb5-d1ee-4916-af99-764eb87920b9 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:47.319705 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec74eb5-d1ee-4916-af99-764eb87920b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:47.319979 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec74eb5-d1ee-4916-af99-764eb87920b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:47.321594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-cec74eb5-d1ee-4916-af99-764eb87920b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:47.403595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:47.434489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec74eb5-d1ee-4916-af99-764eb87920b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:50:47.435932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec74eb5-d1ee-4916-af99-764eb87920b9 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:50:47.454296 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 666/1331] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:50:47 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:50:49.884824 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf94f8-8f3e-447c-a50b-fd596ddbb3d3 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:49.885431 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf94f8-8f3e-447c-a50b-fd596ddbb3d3 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:49.885431 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf94f8-8f3e-447c-a50b-fd596ddbb3d3 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:49.886854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 666/1332] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:50:49.892826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84091607-ea02-4936-b4cd-57137f12fae9 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:49.893274 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84091607-ea02-4936-b4cd-57137f12fae9 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:49.893369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84091607-ea02-4936-b4cd-57137f12fae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:49.958365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-84091607-ea02-4936-b4cd-57137f12fae9 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:50:49.959643 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-84091607-ea02-4936-b4cd-57137f12fae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:50.055017 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 667/1333] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:50:50.090530 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf94f8-8f3e-447c-a50b-fd596ddbb3d3 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:50:50.092055 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d6cf94f8-8f3e-447c-a50b-fd596ddbb3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:50.161297 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:50.196727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf94f8-8f3e-447c-a50b-fd596ddbb3d3 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:50:50.271593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62e55a-8369-40ec-b2e6-11e528e00c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:50:50.272213 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62e55a-8369-40ec-b2e6-11e528e00c94 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:50.272496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62e55a-8369-40ec-b2e6-11e528e00c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:50.272771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62e55a-8369-40ec-b2e6-11e528e00c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:50.274408 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-cd62e55a-8369-40ec-b2e6-11e528e00c94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:50.381678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62e55a-8369-40ec-b2e6-11e528e00c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:50:50.383078 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62e55a-8369-40ec-b2e6-11e528e00c94 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:50:50.393678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:50.401631 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 667/1334] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:50:52.447659 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f629c94-7999-451e-a4f6-0f8e2b2c1ebb None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:52.448223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f629c94-7999-451e-a4f6-0f8e2b2c1ebb None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:52.448223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f629c94-7999-451e-a4f6-0f8e2b2c1ebb None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:52.449588 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 668/1335] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:50:52.454813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3204c0-7c13-4c18-b4cf-0dc271dbc534 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:52.455774 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3204c0-7c13-4c18-b4cf-0dc271dbc534 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:52.455972 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3204c0-7c13-4c18-b4cf-0dc271dbc534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:52.521689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-8d3204c0-7c13-4c18-b4cf-0dc271dbc534 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:50:52.522937 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-8d3204c0-7c13-4c18-b4cf-0dc271dbc534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:52.619880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 668/1336] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:50:52.660554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f629c94-7999-451e-a4f6-0f8e2b2c1ebb None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:50:52.662091 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-3f629c94-7999-451e-a4f6-0f8e2b2c1ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:52.702606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:52.765427 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f629c94-7999-451e-a4f6-0f8e2b2c1ebb None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:50:52.837358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd405a24-531b-4152-9d9a-70873bf14482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:50:52.837969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd405a24-531b-4152-9d9a-70873bf14482 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:52.838249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd405a24-531b-4152-9d9a-70873bf14482 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:52.838586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd405a24-531b-4152-9d9a-70873bf14482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:52.840155 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-cd405a24-531b-4152-9d9a-70873bf14482 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:52.921239 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:52.947716 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd405a24-531b-4152-9d9a-70873bf14482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:50:52.949376 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd405a24-531b-4152-9d9a-70873bf14482 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:50:52.967450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 669/1337] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:50:55.889556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4bf72-cf91-40f8-a644-3ed16f88ac74 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:55.890082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4bf72-cf91-40f8-a644-3ed16f88ac74 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:55.890196 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4bf72-cf91-40f8-a644-3ed16f88ac74 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:55.891515 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 669/1338] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:50:55.896839 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3bb75-8c1a-4d30-87cd-cd1ad9c2bd5b None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:55.897252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3bb75-8c1a-4d30-87cd-cd1ad9c2bd5b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:55.897397 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3bb75-8c1a-4d30-87cd-cd1ad9c2bd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:55.964268 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-74d3bb75-8c1a-4d30-87cd-cd1ad9c2bd5b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:50:55.965412 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-74d3bb75-8c1a-4d30-87cd-cd1ad9c2bd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:56.061657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 670/1339] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:50:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:50:56.097175 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4bf72-cf91-40f8-a644-3ed16f88ac74 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:50:56.099271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-07e4bf72-cf91-40f8-a644-3ed16f88ac74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:56.174679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:56.202592 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4bf72-cf91-40f8-a644-3ed16f88ac74 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:50:56.282433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e5a78-986c-44b8-92c3-6a39218fbf53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:50:56.299572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e5a78-986c-44b8-92c3-6a39218fbf53 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:50:56.299572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e5a78-986c-44b8-92c3-6a39218fbf53 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:50:56.299572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e5a78-986c-44b8-92c3-6a39218fbf53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:50:56.299572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-922e5a78-986c-44b8-92c3-6a39218fbf53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:50:56.396402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e5a78-986c-44b8-92c3-6a39218fbf53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:50:56.397852 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e5a78-986c-44b8-92c3-6a39218fbf53 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:50:56.418666 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 670/1340] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:50:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:00.874268 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f268f-a201-435d-8f97-2102f3b691ec None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:00.874867 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f268f-a201-435d-8f97-2102f3b691ec None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:00.874867 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f268f-a201-435d-8f97-2102f3b691ec None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:00.876369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 671/1341] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:00.882350 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b672b6-e31b-4faf-bd96-767f732fc4cc None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:00.883109 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b672b6-e31b-4faf-bd96-767f732fc4cc None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:00.883109 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b672b6-e31b-4faf-bd96-767f732fc4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:00.889626 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:00.960235 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-c4b672b6-e31b-4faf-bd96-767f732fc4cc None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:00.961631 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c4b672b6-e31b-4faf-bd96-767f732fc4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:01.068870 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 671/1342] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:01.107504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f268f-a201-435d-8f97-2102f3b691ec None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:01.109118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-288f268f-a201-435d-8f97-2102f3b691ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:01.159204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:01.215444 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f268f-a201-435d-8f97-2102f3b691ec None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:01.288863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288d150-0a01-4d5b-96e6-eecee6ce0d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:01.289482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288d150-0a01-4d5b-96e6-eecee6ce0d8b service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:01.289763 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288d150-0a01-4d5b-96e6-eecee6ce0d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:01.290039 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288d150-0a01-4d5b-96e6-eecee6ce0d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:01.291678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-5288d150-0a01-4d5b-96e6-eecee6ce0d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:01.385368 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:01.401760 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288d150-0a01-4d5b-96e6-eecee6ce0d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:01.403211 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288d150-0a01-4d5b-96e6-eecee6ce0d8b service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:01.420722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 672/1343] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:04.448667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f75b3a-41aa-4b06-ab21-38aaa6ebdda1 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:04.449201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f75b3a-41aa-4b06-ab21-38aaa6ebdda1 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:04.449321 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f75b3a-41aa-4b06-ab21-38aaa6ebdda1 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:04.450618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 672/1344] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:04.456036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b858e26-41eb-460f-a278-ddbaf36ffdf5 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:04.456492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b858e26-41eb-460f-a278-ddbaf36ffdf5 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:04.456795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b858e26-41eb-460f-a278-ddbaf36ffdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:04.523069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-6b858e26-41eb-460f-a278-ddbaf36ffdf5 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:04.524360 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-6b858e26-41eb-460f-a278-ddbaf36ffdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:04.622016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 673/1345] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:04.659443 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f75b3a-41aa-4b06-ab21-38aaa6ebdda1 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:04.661555 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-13f75b3a-41aa-4b06-ab21-38aaa6ebdda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:04.754269 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:04.771858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f75b3a-41aa-4b06-ab21-38aaa6ebdda1 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:04.847626 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca751989-57bd-49a7-8023-bc699e28f811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:04.848288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca751989-57bd-49a7-8023-bc699e28f811 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:04.848574 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca751989-57bd-49a7-8023-bc699e28f811 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:04.848850 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca751989-57bd-49a7-8023-bc699e28f811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:04.850481 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ca751989-57bd-49a7-8023-bc699e28f811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:04.961998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca751989-57bd-49a7-8023-bc699e28f811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:04.963512 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca751989-57bd-49a7-8023-bc699e28f811 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:04.982788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 673/1346] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:09.181451 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df480c02-2446-4117-9c57-31c01ae447c1 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:09.181912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df480c02-2446-4117-9c57-31c01ae447c1 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:09.182019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df480c02-2446-4117-9c57-31c01ae447c1 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:09.186887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 674/1347] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:51:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:09.188897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cd277-820b-4392-9c02-11ee9d8608f8 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:09.189304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cd277-820b-4392-9c02-11ee9d8608f8 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:09.189527 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cd277-820b-4392-9c02-11ee9d8608f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:09.209079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:09.269574 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-bc5cd277-820b-4392-9c02-11ee9d8608f8 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:09.271355 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-bc5cd277-820b-4392-9c02-11ee9d8608f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:09.378606 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 674/1348] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:51:09.418602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df480c02-2446-4117-9c57-31c01ae447c1 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:09.420154 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-df480c02-2446-4117-9c57-31c01ae447c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:09.483123 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:09.532040 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df480c02-2446-4117-9c57-31c01ae447c1 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:09.608355 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943030a-ea1c-477b-b708-00f6e3cf8cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:09.608906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943030a-ea1c-477b-b708-00f6e3cf8cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:09.609191 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943030a-ea1c-477b-b708-00f6e3cf8cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:09.609472 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943030a-ea1c-477b-b708-00f6e3cf8cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:09.611151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-3943030a-ea1c-477b-b708-00f6e3cf8cf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:09.739199 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:09.742928 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943030a-ea1c-477b-b708-00f6e3cf8cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:09.744392 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943030a-ea1c-477b-b708-00f6e3cf8cf6 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:09.768047 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 675/1349] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:14.761853 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c699b65-5545-496a-8659-25262220fe63 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:14.762367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c699b65-5545-496a-8659-25262220fe63 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:14.762481 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c699b65-5545-496a-8659-25262220fe63 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:14.764042 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 675/1350] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jul 26 14:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:14.769571 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea76b7-a02b-4df2-8844-f10772adb7bb None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:14.770047 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea76b7-a02b-4df2-8844-f10772adb7bb None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:14.770334 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea76b7-a02b-4df2-8844-f10772adb7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:14.865357 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-b5ea76b7-a02b-4df2-8844-f10772adb7bb None None] MFA Rules not processed for user `0fab620bc5d044479746d8ea17615a74`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:14.866884 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b5ea76b7-a02b-4df2-8844-f10772adb7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:14.991435 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 676/1351] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jul 26 14:51:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:19.288658 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac255b44-b29d-416a-bc49-98ec40ddb3d2 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:19.289219 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac255b44-b29d-416a-bc49-98ec40ddb3d2 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:19.289219 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac255b44-b29d-416a-bc49-98ec40ddb3d2 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:19.290972 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 676/1352] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jul 26 14:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:19.296407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0668208-70d5-4f02-985b-932cb496266e None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:19.297387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0668208-70d5-4f02-985b-932cb496266e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:19.297887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0668208-70d5-4f02-985b-932cb496266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:19.362477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:19.376569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=59 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:19.393965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-a0668208-70d5-4f02-985b-932cb496266e None None] MFA Rules not processed for user `0fab620bc5d044479746d8ea17615a74`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:19.396595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-a0668208-70d5-4f02-985b-932cb496266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:19.558846 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 677/1353] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jul 26 14:51:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:20.768515 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bbc39-6a01-423f-8df9-5cfba5b3ef56 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:20.769077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bbc39-6a01-423f-8df9-5cfba5b3ef56 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:20.769077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bbc39-6a01-423f-8df9-5cfba5b3ef56 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:20.770606 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 677/1354] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jul 26 14:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:20.775442 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9262c2-bc4a-486e-9526-0520174f2b65 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:20.775854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9262c2-bc4a-486e-9526-0520174f2b65 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:20.776062 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9262c2-bc4a-486e-9526-0520174f2b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:20.852847 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-6f9262c2-bc4a-486e-9526-0520174f2b65 None None] MFA Rules not processed for user `0fab620bc5d044479746d8ea17615a74`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:20.854061 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-6f9262c2-bc4a-486e-9526-0520174f2b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:20.895837 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:20.973712 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 678/1355] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jul 26 14:51:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:24.229190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef680e-b51d-48a4-a1a5-808ad637b41d None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:24.230024 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef680e-b51d-48a4-a1a5-808ad637b41d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:24.230505 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef680e-b51d-48a4-a1a5-808ad637b41d None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:24.235725 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 678/1356] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:51:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:24.237661 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52ddd8-935c-4cb5-8b10-287b4006ad31 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:24.238463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52ddd8-935c-4cb5-8b10-287b4006ad31 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:24.238929 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52ddd8-935c-4cb5-8b10-287b4006ad31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:24.335703 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-db52ddd8-935c-4cb5-8b10-287b4006ad31 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:24.336967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-db52ddd8-935c-4cb5-8b10-287b4006ad31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:24.453117 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 679/1357] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:24.508786 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbbf8b-e7a6-4f66-ad55-18460bff8ae3 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:24.508786 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbbf8b-e7a6-4f66-ad55-18460bff8ae3 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:24.509064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbbf8b-e7a6-4f66-ad55-18460bff8ae3 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:24.510876 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 679/1358] 10.222.0.86 () {54 vars in 962 bytes} [Tue Jul 26 14:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:24.525495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7b07c-575f-4db5-958f-6aaeb5bd854c None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:24.525885 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7b07c-575f-4db5-958f-6aaeb5bd854c None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:24.526754 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7b07c-575f-4db5-958f-6aaeb5bd854c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:24.545775 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:24.612891 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-c3c7b07c-575f-4db5-958f-6aaeb5bd854c None None] MFA Rules not processed for user `d12fc26e640f4337b4a4da60cc4d9adc`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:24.614281 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-c3c7b07c-575f-4db5-958f-6aaeb5bd854c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:24.751935 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 680/1359] 10.222.0.86 () {58 vars in 1059 bytes} [Tue Jul 26 14:51:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:24.759829 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbbf8b-e7a6-4f66-ad55-18460bff8ae3 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:24.761768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-73dbbf8b-e7a6-4f66-ad55-18460bff8ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:24.917907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbbf8b-e7a6-4f66-ad55-18460bff8ae3 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:25.000101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:25.048369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0b295-6f64-468a-8b46-4e59c55d6fc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:25.049149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0b295-6f64-468a-8b46-4e59c55d6fc8 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:25.049688 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0b295-6f64-468a-8b46-4e59c55d6fc8 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:25.049952 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0b295-6f64-468a-8b46-4e59c55d6fc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:25.051756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-b0f0b295-6f64-468a-8b46-4e59c55d6fc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:25.147024 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0b295-6f64-468a-8b46-4e59c55d6fc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:25.148798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0b295-6f64-468a-8b46-4e59c55d6fc8 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:25.168961 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 680/1360] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:27.441273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893605d-a27c-4934-90c2-b494ab948a2e None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:27.442358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893605d-a27c-4934-90c2-b494ab948a2e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:27.442358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893605d-a27c-4934-90c2-b494ab948a2e None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:27.443884 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 681/1361] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:27.448840 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9db5ca-d6f2-46fd-97f6-1cec9c6d89b0 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:27.449643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9db5ca-d6f2-46fd-97f6-1cec9c6d89b0 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:27.449925 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9db5ca-d6f2-46fd-97f6-1cec9c6d89b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:27.519337 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-1c9db5ca-d6f2-46fd-97f6-1cec9c6d89b0 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:27.521082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-1c9db5ca-d6f2-46fd-97f6-1cec9c6d89b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:27.562686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:27.631332 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 681/1362] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:27.679053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893605d-a27c-4934-90c2-b494ab948a2e None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:27.681075 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-0893605d-a27c-4934-90c2-b494ab948a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:27.763074 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:27.848495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893605d-a27c-4934-90c2-b494ab948a2e None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:27.989014 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574615b-922f-4ce1-8a57-aa4ed112ff1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:27.989807 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574615b-922f-4ce1-8a57-aa4ed112ff1b service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:27.990205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574615b-922f-4ce1-8a57-aa4ed112ff1b service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:27.990621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574615b-922f-4ce1-8a57-aa4ed112ff1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:27.992373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4574615b-922f-4ce1-8a57-aa4ed112ff1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:28.021828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:28.093583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574615b-922f-4ce1-8a57-aa4ed112ff1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:28.095385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574615b-922f-4ce1-8a57-aa4ed112ff1b service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:28.116941 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 682/1363] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:30.567078 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea44b4-0f8c-4d8f-8a2f-709856b517e9 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:30.568059 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea44b4-0f8c-4d8f-8a2f-709856b517e9 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:30.568491 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea44b4-0f8c-4d8f-8a2f-709856b517e9 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:30.570018 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 682/1364] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:51:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:30.575625 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144cb10-0642-4fed-8f31-127f4ff4fa7c None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:30.576197 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144cb10-0642-4fed-8f31-127f4ff4fa7c None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:30.576197 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144cb10-0642-4fed-8f31-127f4ff4fa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:30.648235 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-1144cb10-0642-4fed-8f31-127f4ff4fa7c None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:30.649444 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-1144cb10-0642-4fed-8f31-127f4ff4fa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:30.763010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:30.772320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 683/1365] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:30.814888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a7323-affa-439e-9f29-7def723f91f5 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:30.815180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a7323-affa-439e-9f29-7def723f91f5 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:30.815667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a7323-affa-439e-9f29-7def723f91f5 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:30.817145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 683/1366] 10.222.0.86 () {54 vars in 962 bytes} [Tue Jul 26 14:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:30.823151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97c389-3511-449f-9bfc-dfdc188fc706 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:30.823612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97c389-3511-449f-9bfc-dfdc188fc706 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:30.824112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97c389-3511-449f-9bfc-dfdc188fc706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:30.905177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-5b97c389-3511-449f-9bfc-dfdc188fc706 None None] MFA Rules not processed for user `d12fc26e640f4337b4a4da60cc4d9adc`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:30.906421 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-5b97c389-3511-449f-9bfc-dfdc188fc706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:31.041671 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 684/1367] 10.222.0.86 () {58 vars in 1059 bytes} [Tue Jul 26 14:51:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:51:31.050577 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a7323-affa-439e-9f29-7def723f91f5 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:31.053467 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3c1a7323-affa-439e-9f29-7def723f91f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:31.233840 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a7323-affa-439e-9f29-7def723f91f5 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:31.259486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:31.360540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc92f8e-87bc-4c9f-bd73-1529a0c87bd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:31.361151 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc92f8e-87bc-4c9f-bd73-1529a0c87bd8 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:31.361433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc92f8e-87bc-4c9f-bd73-1529a0c87bd8 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:31.361712 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc92f8e-87bc-4c9f-bd73-1529a0c87bd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:31.363482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5fc92f8e-87bc-4c9f-bd73-1529a0c87bd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:31.467407 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc92f8e-87bc-4c9f-bd73-1529a0c87bd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:31.468969 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc92f8e-87bc-4c9f-bd73-1529a0c87bd8 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:31.489687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 684/1368] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:32.379252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93a0a4-e37a-449e-9ec7-a71af82f089b None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:32.380439 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93a0a4-e37a-449e-9ec7-a71af82f089b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:32.380751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93a0a4-e37a-449e-9ec7-a71af82f089b None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:32.382157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 685/1369] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:32.387803 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78effc-fb33-4bba-ae4a-792eb918067b None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:32.388248 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78effc-fb33-4bba-ae4a-792eb918067b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:32.388349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78effc-fb33-4bba-ae4a-792eb918067b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:32.422704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:32.461151 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-da78effc-fb33-4bba-ae4a-792eb918067b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:32.462348 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-da78effc-fb33-4bba-ae4a-792eb918067b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:32.566069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 685/1370] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:32.916207 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977dcfb-300d-4558-b92c-ad79ef50c8d7 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:32.916498 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977dcfb-300d-4558-b92c-ad79ef50c8d7 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:32.916779 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977dcfb-300d-4558-b92c-ad79ef50c8d7 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:32.918281 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 686/1371] 10.222.0.86 () {54 vars in 964 bytes} [Tue Jul 26 14:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:32.923230 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b942f-84f9-4a89-9657-3440bf13cf8e None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:32.923523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b942f-84f9-4a89-9657-3440bf13cf8e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:32.923805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b942f-84f9-4a89-9657-3440bf13cf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:33.012820 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-8f0b942f-84f9-4a89-9657-3440bf13cf8e None None] MFA Rules not processed for user `6f495077bafd4fd18cc682fe0a6b7f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:33.014312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-8f0b942f-84f9-4a89-9657-3440bf13cf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:33.070743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:33.111661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 686/1372] 10.222.0.86 () {58 vars in 1061 bytes} [Tue Jul 26 14:51:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:33.112061 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977dcfb-300d-4558-b92c-ad79ef50c8d7 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:33.114209 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-3977dcfb-300d-4558-b92c-ad79ef50c8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:33.171298 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:33.235799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977dcfb-300d-4558-b92c-ad79ef50c8d7 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:33.316970 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70c306-da0d-4310-a2cb-39ce573e5345 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:33.317549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70c306-da0d-4310-a2cb-39ce573e5345 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:33.317838 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70c306-da0d-4310-a2cb-39ce573e5345 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:33.318399 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70c306-da0d-4310-a2cb-39ce573e5345 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:33.320091 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-3d70c306-da0d-4310-a2cb-39ce573e5345 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:33.434418 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:33.449262 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70c306-da0d-4310-a2cb-39ce573e5345 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:33.450926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70c306-da0d-4310-a2cb-39ce573e5345 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:33.473980 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 687/1373] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:33.724343 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73cb73-3953-4ed1-bf74-d4b3badd0721 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:33.724771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73cb73-3953-4ed1-bf74-d4b3badd0721 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:33.724984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73cb73-3953-4ed1-bf74-d4b3badd0721 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:33.727165 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 687/1374] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:51:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:33.732482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ecb3f-40c9-4971-a4fc-7eae2f359110 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:33.733040 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ecb3f-40c9-4971-a4fc-7eae2f359110 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:33.733437 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ecb3f-40c9-4971-a4fc-7eae2f359110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:33.815518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-7a7ecb3f-40c9-4971-a4fc-7eae2f359110 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:33.817392 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-7a7ecb3f-40c9-4971-a4fc-7eae2f359110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:33.926426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 688/1375] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:33.975039 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73cb73-3953-4ed1-bf74-d4b3badd0721 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:33.976763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-cf73cb73-3953-4ed1-bf74-d4b3badd0721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:34.133835 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73cb73-3953-4ed1-bf74-d4b3badd0721 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:34.186410 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:34.247803 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4cfcd-920f-4038-a40f-7b3de8fa8c4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:34.248423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4cfcd-920f-4038-a40f-7b3de8fa8c4c service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:34.248705 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4cfcd-920f-4038-a40f-7b3de8fa8c4c service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:34.248979 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4cfcd-920f-4038-a40f-7b3de8fa8c4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:34.250632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-efa4cfcd-920f-4038-a40f-7b3de8fa8c4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:34.345429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4cfcd-920f-4038-a40f-7b3de8fa8c4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:34.347212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4cfcd-920f-4038-a40f-7b3de8fa8c4c service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:34.365650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 688/1376] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:36.595767 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c62d3-eaad-4873-99f7-fdb3a3d55e92 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:36.596731 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c62d3-eaad-4873-99f7-fdb3a3d55e92 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:36.597204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c62d3-eaad-4873-99f7-fdb3a3d55e92 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:36.599540 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 689/1377] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:51:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:36.604718 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcd4be-72c9-4070-9106-b3e7b65566dd None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:36.605160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcd4be-72c9-4070-9106-b3e7b65566dd None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:36.605281 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcd4be-72c9-4070-9106-b3e7b65566dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:36.686450 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-5dfcd4be-72c9-4070-9106-b3e7b65566dd None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:36.686450 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5dfcd4be-72c9-4070-9106-b3e7b65566dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:36.693360 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:36.794046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 689/1378] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:36.837663 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c62d3-eaad-4873-99f7-fdb3a3d55e92 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:36.839335 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f24c62d3-eaad-4873-99f7-fdb3a3d55e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:36.901900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:36.995711 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c62d3-eaad-4873-99f7-fdb3a3d55e92 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:37.140368 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2055e-eed2-42c4-9f94-b53917a650b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:37.142443 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2055e-eed2-42c4-9f94-b53917a650b3 service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:37.142443 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2055e-eed2-42c4-9f94-b53917a650b3 service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:37.143921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2055e-eed2-42c4-9f94-b53917a650b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:37.144609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-dbb2055e-eed2-42c4-9f94-b53917a650b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:37.173902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:37.270965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2055e-eed2-42c4-9f94-b53917a650b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:37.272638 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2055e-eed2-42c4-9f94-b53917a650b3 service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:37.292111 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 690/1379] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:39.529838 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf325b-b3db-4bc6-8298-8d8ccdaaffe9 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:39.530310 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf325b-b3db-4bc6-8298-8d8ccdaaffe9 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:39.530611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf325b-b3db-4bc6-8298-8d8ccdaaffe9 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:39.534433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 690/1380] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:39.537452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66027518-2309-472f-affc-b290dc5d32b6 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:39.537860 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66027518-2309-472f-affc-b290dc5d32b6 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:39.538025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66027518-2309-472f-affc-b290dc5d32b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:39.608573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-66027518-2309-472f-affc-b290dc5d32b6 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:39.609792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-66027518-2309-472f-affc-b290dc5d32b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:39.717416 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:39.729434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 691/1381] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:39.770072 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf325b-b3db-4bc6-8298-8d8ccdaaffe9 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:39.771758 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-31bf325b-b3db-4bc6-8298-8d8ccdaaffe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:39.917625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:39.928499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf325b-b3db-4bc6-8298-8d8ccdaaffe9 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:40.073631 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab983700-577e-4ace-8ea5-bbea1f691f7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:40.074254 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab983700-577e-4ace-8ea5-bbea1f691f7a service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:40.074588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab983700-577e-4ace-8ea5-bbea1f691f7a service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:40.074854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab983700-577e-4ace-8ea5-bbea1f691f7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:40.076487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ab983700-577e-4ace-8ea5-bbea1f691f7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:40.176230 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab983700-577e-4ace-8ea5-bbea1f691f7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:40.178524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab983700-577e-4ace-8ea5-bbea1f691f7a service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:40.190332 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:40.199162 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 691/1382] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:42.651234 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6f46b-e1d6-4c72-af86-50044bf7c1f5 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:42.651926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6f46b-e1d6-4c72-af86-50044bf7c1f5 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:42.651926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6f46b-e1d6-4c72-af86-50044bf7c1f5 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:42.653791 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 692/1383] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:42.660113 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a8671-4345-48a6-a0d6-cc2cdcfe080d None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:42.660698 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a8671-4345-48a6-a0d6-cc2cdcfe080d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:42.660698 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a8671-4345-48a6-a0d6-cc2cdcfe080d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:42.751579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-2c9a8671-4345-48a6-a0d6-cc2cdcfe080d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:42.752844 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2c9a8671-4345-48a6-a0d6-cc2cdcfe080d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:42.869782 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 692/1384] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:42.912979 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6f46b-e1d6-4c72-af86-50044bf7c1f5 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:42.914877 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-0ff6f46b-e1d6-4c72-af86-50044bf7c1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:43.085346 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6f46b-e1d6-4c72-af86-50044bf7c1f5 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:43.285441 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:43.341652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c4348-e0ac-4ebf-b798-3b53d584e2cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:43.342275 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c4348-e0ac-4ebf-b798-3b53d584e2cf service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:43.342585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c4348-e0ac-4ebf-b798-3b53d584e2cf service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:43.342865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c4348-e0ac-4ebf-b798-3b53d584e2cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:43.344479 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ab6c4348-e0ac-4ebf-b798-3b53d584e2cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:43.464417 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c4348-e0ac-4ebf-b798-3b53d584e2cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:43.466457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c4348-e0ac-4ebf-b798-3b53d584e2cf service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:43.490855 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 693/1385] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:45.538690 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d2994-090a-4c5f-9036-4345ca21bd10 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:45.539408 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d2994-090a-4c5f-9036-4345ca21bd10 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:45.540879 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d2994-090a-4c5f-9036-4345ca21bd10 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:45.541614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 693/1386] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:51:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:45.547261 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fd597-dea8-49c4-9672-dc1074feae8e None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:45.547726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fd597-dea8-49c4-9672-dc1074feae8e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:45.547957 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fd597-dea8-49c4-9672-dc1074feae8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:45.630758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-160fd597-dea8-49c4-9672-dc1074feae8e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:45.632320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-160fd597-dea8-49c4-9672-dc1074feae8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:45.670798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:45.740191 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 694/1387] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:45.787597 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d2994-090a-4c5f-9036-4345ca21bd10 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:45.789349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-162d2994-090a-4c5f-9036-4345ca21bd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:45.875477 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:45.954780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d2994-090a-4c5f-9036-4345ca21bd10 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:46.084637 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892d493-2b21-4e9d-a645-7d979900c540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:46.085370 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892d493-2b21-4e9d-a645-7d979900c540 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:46.085862 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892d493-2b21-4e9d-a645-7d979900c540 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:46.086475 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892d493-2b21-4e9d-a645-7d979900c540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:46.088536 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-f892d493-2b21-4e9d-a645-7d979900c540 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:46.137560 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:46.197728 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892d493-2b21-4e9d-a645-7d979900c540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:46.199404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892d493-2b21-4e9d-a645-7d979900c540 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:46.218937 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 694/1388] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:48.428134 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d209fe8-1d0f-41e9-8c0f-93da674c5b96 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:48.428792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d209fe8-1d0f-41e9-8c0f-93da674c5b96 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:48.428792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d209fe8-1d0f-41e9-8c0f-93da674c5b96 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:48.430098 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 695/1389] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:48.435336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059f80d-d023-4518-b3dc-4057b08d4a82 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:48.435778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059f80d-d023-4518-b3dc-4057b08d4a82 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:48.435886 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059f80d-d023-4518-b3dc-4057b08d4a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:48.502905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-b059f80d-d023-4518-b3dc-4057b08d4a82 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:48.504147 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-b059f80d-d023-4518-b3dc-4057b08d4a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:48.606018 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 695/1390] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:48.651046 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d209fe8-1d0f-41e9-8c0f-93da674c5b96 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:48.652620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-5d209fe8-1d0f-41e9-8c0f-93da674c5b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:48.806673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d209fe8-1d0f-41e9-8c0f-93da674c5b96 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:48.823768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:48.921046 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e3a2a-b86f-42d9-92ff-b2f81934a266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:48.921660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e3a2a-b86f-42d9-92ff-b2f81934a266 service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:48.921941 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e3a2a-b86f-42d9-92ff-b2f81934a266 service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:48.922213 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e3a2a-b86f-42d9-92ff-b2f81934a266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:48.923842 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2d0e3a2a-b86f-42d9-92ff-b2f81934a266 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:49.013162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e3a2a-b86f-42d9-92ff-b2f81934a266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:49.014786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e3a2a-b86f-42d9-92ff-b2f81934a266 service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:49.033213 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 696/1391] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:49.239704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f316ee2-f763-469b-b3d4-dad543355d84 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:49.240003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f316ee2-f763-469b-b3d4-dad543355d84 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:49.240290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f316ee2-f763-469b-b3d4-dad543355d84 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:49.241666 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 696/1392] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:49.247861 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328d239-4eca-4cd5-8599-0c5fc43824cc None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:49.248734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328d239-4eca-4cd5-8599-0c5fc43824cc None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:49.248734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328d239-4eca-4cd5-8599-0c5fc43824cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:49.279560 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:49.325903 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-8328d239-4eca-4cd5-8599-0c5fc43824cc None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:49.327180 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8328d239-4eca-4cd5-8599-0c5fc43824cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:49.434023 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 697/1393] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:51:49.491386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0a5a7-2e21-4c95-afb9-5f7e32796036 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:49.491874 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0a5a7-2e21-4c95-afb9-5f7e32796036 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:49.492113 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0a5a7-2e21-4c95-afb9-5f7e32796036 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:49.493484 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 697/1394] 10.222.0.86 () {54 vars in 966 bytes} [Tue Jul 26 14:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:49.498708 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7440c-78fb-46cd-a8e1-52a89f1fb0be None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:49.499122 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7440c-78fb-46cd-a8e1-52a89f1fb0be None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:49.499463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7440c-78fb-46cd-a8e1-52a89f1fb0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:49.576281 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-95a7440c-78fb-46cd-a8e1-52a89f1fb0be None None] MFA Rules not processed for user `aa31ecab10a6499f92da49bc7abb403a`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:49.577495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-95a7440c-78fb-46cd-a8e1-52a89f1fb0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:49.622931 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:49.661000 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 698/1395] 10.222.0.86 () {58 vars in 1063 bytes} [Tue Jul 26 14:51:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:49.670457 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0a5a7-2e21-4c95-afb9-5f7e32796036 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:49.671981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e5c0a5a7-2e21-4c95-afb9-5f7e32796036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:49.688501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:49.784195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0a5a7-2e21-4c95-afb9-5f7e32796036 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:49.859110 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba14420-2d76-4bf5-99c6-53a75a945a7c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa31ecab10a6499f92da49bc7abb403a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:49.859747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14420-2d76-4bf5-99c6-53a75a945a7c service glance] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:49.860038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14420-2d76-4bf5-99c6-53a75a945a7c service glance] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:49.860322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14420-2d76-4bf5-99c6-53a75a945a7c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:49.862002 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-1ba14420-2d76-4bf5-99c6-53a75a945a7c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:49.932078 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:49.975908 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba14420-2d76-4bf5-99c6-53a75a945a7c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:49.977285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba14420-2d76-4bf5-99c6-53a75a945a7c service glance] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:49.995504 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 698/1396] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:50.923099 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41c8c0-899a-4ca4-9f6a-b013bb1f88a7 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:50.923576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41c8c0-899a-4ca4-9f6a-b013bb1f88a7 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:50.923771 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41c8c0-899a-4ca4-9f6a-b013bb1f88a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:50.989720 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-7c41c8c0-899a-4ca4-9f6a-b013bb1f88a7 None None] MFA Rules not processed for user `0834be7405cd4c968763099251d37154`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:50.990945 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-7c41c8c0-899a-4ca4-9f6a-b013bb1f88a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:51.079336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 699/1397] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jul 26 14:51:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:51.126592 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64170d39-aa43-484f-b4c5-bc6eab4d4450 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:51.127116 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64170d39-aa43-484f-b4c5-bc6eab4d4450 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:51.127243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64170d39-aa43-484f-b4c5-bc6eab4d4450 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:51.128502 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 699/1398] 10.222.0.86 () {54 vars in 943 bytes} [Tue Jul 26 14:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:51.135504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2f307-da56-4bf0-9cd9-09d26dbb0b08 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:51.135799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2f307-da56-4bf0-9cd9-09d26dbb0b08 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:51.136077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2f307-da56-4bf0-9cd9-09d26dbb0b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:51.216865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:51.224832 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-62e2f307-da56-4bf0-9cd9-09d26dbb0b08 None None] MFA Rules not processed for user `462ecbb85c6b4a17a952fb74fa2de65e`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:51.226068 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-62e2f307-da56-4bf0-9cd9-09d26dbb0b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:51.233819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c127ed-fafa-4870-8bcd-13dcc91487d9 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:51.234091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c127ed-fafa-4870-8bcd-13dcc91487d9 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:51.234348 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c127ed-fafa-4870-8bcd-13dcc91487d9 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:51.235731 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 700/1399] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:51.240845 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb4ced-8959-4f3d-897d-f00b4f4a7ded None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:51.241131 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb4ced-8959-4f3d-897d-f00b4f4a7ded None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:51.241406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb4ced-8959-4f3d-897d-f00b4f4a7ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:51.309081 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-6cfb4ced-8959-4f3d-897d-f00b4f4a7ded None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:51.310289 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-6cfb4ced-8959-4f3d-897d-f00b4f4a7ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:51.336461 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 700/1400] 10.222.0.86 () {58 vars in 1040 bytes} [Tue Jul 26 14:51:51 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:51.345842 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2f307-da56-4bf0-9cd9-09d26dbb0b08 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:51.355433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2f307-da56-4bf0-9cd9-09d26dbb0b08 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:51.416970 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 701/1401] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:51:51.461843 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb4ced-8959-4f3d-897d-f00b4f4a7ded None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:51.462836 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ac0bc-1041-4362-bf2b-431b7e638d81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '462ecbb85c6b4a17a952fb74fa2de65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:51.463203 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-6cfb4ced-8959-4f3d-897d-f00b4f4a7ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:51.463457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ac0bc-1041-4362-bf2b-431b7e638d81 service swift] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:51.463733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ac0bc-1041-4362-bf2b-431b7e638d81 service swift] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:51.464002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ac0bc-1041-4362-bf2b-431b7e638d81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:51.465610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-971ac0bc-1041-4362-bf2b-431b7e638d81 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:51.468311 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:51.492432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:51.552864 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ac0bc-1041-4362-bf2b-431b7e638d81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:51.554489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ac0bc-1041-4362-bf2b-431b7e638d81 service swift] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:51.562509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 701/1402] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jul 26 14:51:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 14:51:51.591453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb4ced-8959-4f3d-897d-f00b4f4a7ded None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:51.706622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d753b-361f-424b-8a9e-f13b5fa85eeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:51.707662 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d753b-361f-424b-8a9e-f13b5fa85eeb service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:51.708069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d753b-361f-424b-8a9e-f13b5fa85eeb service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:51.708489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d753b-361f-424b-8a9e-f13b5fa85eeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:51.710585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-049d753b-361f-424b-8a9e-f13b5fa85eeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:51.729190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:51.801604 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d753b-361f-424b-8a9e-f13b5fa85eeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:51.803264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d753b-361f-424b-8a9e-f13b5fa85eeb service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:51.822848 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 702/1403] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:51:54.082212 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42aab4-9eee-49d8-9ef4-e1a7c7feb169 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:54.082791 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42aab4-9eee-49d8-9ef4-e1a7c7feb169 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:54.082906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42aab4-9eee-49d8-9ef4-e1a7c7feb169 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:54.084373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 702/1404] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:54.090153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb3b2a-7afc-4e40-9c65-d21fb6a43cf8 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:54.090609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb3b2a-7afc-4e40-9c65-d21fb6a43cf8 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:54.090818 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb3b2a-7afc-4e40-9c65-d21fb6a43cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:54.173725 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-28eb3b2a-7afc-4e40-9c65-d21fb6a43cf8 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:54.175066 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-28eb3b2a-7afc-4e40-9c65-d21fb6a43cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:54.287892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:54.294268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 703/1405] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:54.346231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42aab4-9eee-49d8-9ef4-e1a7c7feb169 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:54.348447 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-0c42aab4-9eee-49d8-9ef4-e1a7c7feb169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:54.522208 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:54.524970 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42aab4-9eee-49d8-9ef4-e1a7c7feb169 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:54.647750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ebc7c-b1c9-4eac-848d-e9102d7a20a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:54.648293 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ebc7c-b1c9-4eac-848d-e9102d7a20a8 service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:54.648576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ebc7c-b1c9-4eac-848d-e9102d7a20a8 service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:54.648850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ebc7c-b1c9-4eac-848d-e9102d7a20a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:54.651587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f69ebc7c-b1c9-4eac-848d-e9102d7a20a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:54.755971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ebc7c-b1c9-4eac-848d-e9102d7a20a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:54.757992 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ebc7c-b1c9-4eac-848d-e9102d7a20a8 service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:54.780432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 703/1406] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:56.952215 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb150a8e-6fa4-4837-b0b7-c8d13d08db00 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:56.952731 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb150a8e-6fa4-4837-b0b7-c8d13d08db00 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:56.952731 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb150a8e-6fa4-4837-b0b7-c8d13d08db00 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:56.958651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 704/1407] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:51:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:56.960062 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791e09b-e921-4b41-848b-a4b5b61c11a4 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:56.960506 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791e09b-e921-4b41-848b-a4b5b61c11a4 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:56.960635 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791e09b-e921-4b41-848b-a4b5b61c11a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:56.965468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:57.039887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-e791e09b-e921-4b41-848b-a4b5b61c11a4 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:57.041097 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e791e09b-e921-4b41-848b-a4b5b61c11a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:57.143428 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 704/1408] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:51:57.191441 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb150a8e-6fa4-4837-b0b7-c8d13d08db00 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:57.192973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-eb150a8e-6fa4-4837-b0b7-c8d13d08db00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:57.359137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb150a8e-6fa4-4837-b0b7-c8d13d08db00 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:57.433364 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:57.489088 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a035c-4cee-4d27-8031-6227ea00a40c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:57.489678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a035c-4cee-4d27-8031-6227ea00a40c service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:57.489959 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a035c-4cee-4d27-8031-6227ea00a40c service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:57.490233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a035c-4cee-4d27-8031-6227ea00a40c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:57.491904 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5d7a035c-4cee-4d27-8031-6227ea00a40c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:57.588212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a035c-4cee-4d27-8031-6227ea00a40c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:57.589856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a035c-4cee-4d27-8031-6227ea00a40c service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:57.609339 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 705/1409] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:07.144972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=64 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:07.606837 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=64 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:15.091701 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367e811-b4d3-4f57-907a-734693105246 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:15.092280 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367e811-b4d3-4f57-907a-734693105246 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:15.092280 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367e811-b4d3-4f57-907a-734693105246 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:15.093658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 705/1410] 10.222.0.86 () {54 vars in 918 bytes} [Tue Jul 26 14:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:15.099450 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854753bf-f5af-4820-9ba3-9f6179027d36 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:15.099856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854753bf-f5af-4820-9ba3-9f6179027d36 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:15.100000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854753bf-f5af-4820-9ba3-9f6179027d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:15.175304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-854753bf-f5af-4820-9ba3-9f6179027d36 None None] MFA Rules not processed for user `0fab620bc5d044479746d8ea17615a74`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:15.176529 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-854753bf-f5af-4820-9ba3-9f6179027d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:15.283266 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 706/1411] 10.222.0.86 () {58 vars in 1015 bytes} [Tue Jul 26 14:52:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:15.298125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de5d35-ea54-437c-a58f-d3c2a390ae80 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:15.298435 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de5d35-ea54-437c-a58f-d3c2a390ae80 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:15.298710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de5d35-ea54-437c-a58f-d3c2a390ae80 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:15.300071 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 706/1412] 10.222.0.86 () {54 vars in 918 bytes} [Tue Jul 26 14:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:15.304802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d599a-7b20-4002-b990-b6a1f7e25b59 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:15.305095 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d599a-7b20-4002-b990-b6a1f7e25b59 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:15.305376 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d599a-7b20-4002-b990-b6a1f7e25b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:15.377444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:15.381051 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-ed5d599a-7b20-4002-b990-b6a1f7e25b59 None None] MFA Rules not processed for user `d12fc26e640f4337b4a4da60cc4d9adc`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:15.382217 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ed5d599a-7b20-4002-b990-b6a1f7e25b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:15.495656 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 707/1413] 10.222.0.86 () {58 vars in 1015 bytes} [Tue Jul 26 14:52:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:17.985983 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4216f07-a1b9-4356-8174-a2ebb9653591 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:17.986610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4216f07-a1b9-4356-8174-a2ebb9653591 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:17.986610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4216f07-a1b9-4356-8174-a2ebb9653591 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:17.988340 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:17.993752 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b752a1-9581-42ed-a5f5-750aec018f12 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:17.994164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b752a1-9581-42ed-a5f5-750aec018f12 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:17.994317 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b752a1-9581-42ed-a5f5-750aec018f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:18.060432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-43b752a1-9581-42ed-a5f5-750aec018f12 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:18.061645 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-43b752a1-9581-42ed-a5f5-750aec018f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:18.116477 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:18.158407 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:18.200912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4216f07-a1b9-4356-8174-a2ebb9653591 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:18.202494 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f4216f07-a1b9-4356-8174-a2ebb9653591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:18.345106 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4216f07-a1b9-4356-8174-a2ebb9653591 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:18.416478 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:18.456283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b1991-0a8f-41be-aa78-9582e177ba3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:18.457419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b1991-0a8f-41be-aa78-9582e177ba3b service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:18.457695 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b1991-0a8f-41be-aa78-9582e177ba3b service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:18.457964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b1991-0a8f-41be-aa78-9582e177ba3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:18.459608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-253b1991-0a8f-41be-aa78-9582e177ba3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:18.546344 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b1991-0a8f-41be-aa78-9582e177ba3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:18.547940 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b1991-0a8f-41be-aa78-9582e177ba3b service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:18.573071 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 708/1416] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:19.470155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e48764-4dd0-4b9a-8531-091b138aded8 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:19.470755 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e48764-4dd0-4b9a-8531-091b138aded8 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:19.470755 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e48764-4dd0-4b9a-8531-091b138aded8 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:19.472730 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:19.477742 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988116fe-7358-4800-a0b3-0ba6c0dc2cf1 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:19.478141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988116fe-7358-4800-a0b3-0ba6c0dc2cf1 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:19.478289 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988116fe-7358-4800-a0b3-0ba6c0dc2cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:19.553382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-988116fe-7358-4800-a0b3-0ba6c0dc2cf1 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:19.554622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-988116fe-7358-4800-a0b3-0ba6c0dc2cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:19.582185 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:19.652545 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:19.804987 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e48764-4dd0-4b9a-8531-091b138aded8 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:19.806544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-66e48764-4dd0-4b9a-8531-091b138aded8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:19.954635 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e48764-4dd0-4b9a-8531-091b138aded8 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:19.995648 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:20.068619 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae637c-885b-48e5-a695-7ad95418f06d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:20.069234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae637c-885b-48e5-a695-7ad95418f06d service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:20.069642 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae637c-885b-48e5-a695-7ad95418f06d service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:20.069960 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae637c-885b-48e5-a695-7ad95418f06d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:20.071585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-12ae637c-885b-48e5-a695-7ad95418f06d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:20.159468 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae637c-885b-48e5-a695-7ad95418f06d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:20.161072 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae637c-885b-48e5-a695-7ad95418f06d service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:20.179214 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 710/1419] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:21.059662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6b0b2-aa29-4af9-be13-45da7ee1817a None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:21.060330 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6b0b2-aa29-4af9-be13-45da7ee1817a None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:21.060330 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6b0b2-aa29-4af9-be13-45da7ee1817a None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:21.061701 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:21.066620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7bd19-6292-4b0d-a777-b9819c5ad883 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:21.067047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7bd19-6292-4b0d-a777-b9819c5ad883 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:21.067182 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7bd19-6292-4b0d-a777-b9819c5ad883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:21.121781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:21.143014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-e6c7bd19-6292-4b0d-a777-b9819c5ad883 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:21.144717 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e6c7bd19-6292-4b0d-a777-b9819c5ad883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:21.247007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:21.401134 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6b0b2-aa29-4af9-be13-45da7ee1817a None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:21.402664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-a4f6b0b2-aa29-4af9-be13-45da7ee1817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:21.545771 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6b0b2-aa29-4af9-be13-45da7ee1817a None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:21.557878 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:21.659725 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfc2ad-58e9-4116-8439-fc4afee13426 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:21.660256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfc2ad-58e9-4116-8439-fc4afee13426 service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:21.660537 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfc2ad-58e9-4116-8439-fc4afee13426 service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:21.660809 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfc2ad-58e9-4116-8439-fc4afee13426 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:21.662445 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4fcfc2ad-58e9-4116-8439-fc4afee13426 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:21.752578 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfc2ad-58e9-4116-8439-fc4afee13426 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:21.754229 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfc2ad-58e9-4116-8439-fc4afee13426 service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:21.773133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 711/1422] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:22.632992 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7280-ef03-4cd2-9972-f4250c840916 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:22.633565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7280-ef03-4cd2-9972-f4250c840916 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:22.633565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7280-ef03-4cd2-9972-f4250c840916 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:22.634935 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:22.640371 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7e126-1676-473f-8d6f-33ef89abe050 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:22.640807 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7e126-1676-473f-8d6f-33ef89abe050 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:22.640901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7e126-1676-473f-8d6f-33ef89abe050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:22.660479 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:22.721383 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-96e7e126-1676-473f-8d6f-33ef89abe050 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:22.722776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-96e7e126-1676-473f-8d6f-33ef89abe050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:22.821770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:22.973017 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c7280-ef03-4cd2-9972-f4250c840916 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:22.974522 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e79c7280-ef03-4cd2-9972-f4250c840916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:23.093901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:23.131160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c7280-ef03-4cd2-9972-f4250c840916 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:23.243429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc033725-3863-43e1-af59-2b54cdd2c3be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:23.243968 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc033725-3863-43e1-af59-2b54cdd2c3be service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:23.244251 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc033725-3863-43e1-af59-2b54cdd2c3be service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:23.244529 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc033725-3863-43e1-af59-2b54cdd2c3be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:23.246155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-fc033725-3863-43e1-af59-2b54cdd2c3be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:23.322782 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:23.336541 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc033725-3863-43e1-af59-2b54cdd2c3be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:23.338221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc033725-3863-43e1-af59-2b54cdd2c3be service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:23.356545 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 713/1425] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:24.229965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eceaf1-69a8-47b4-b3ea-87f8571c222e None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:24.230594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eceaf1-69a8-47b4-b3ea-87f8571c222e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:24.230594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eceaf1-69a8-47b4-b3ea-87f8571c222e None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:24.231920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:24.236879 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fbac4-ecc7-4e93-8981-3f37d8df02fa None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:24.237285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fbac4-ecc7-4e93-8981-3f37d8df02fa None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:24.237972 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fbac4-ecc7-4e93-8981-3f37d8df02fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:24.318412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-975fbac4-ecc7-4e93-8981-3f37d8df02fa None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:24.319741 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-975fbac4-ecc7-4e93-8981-3f37d8df02fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:24.415936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:24.564353 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eceaf1-69a8-47b4-b3ea-87f8571c222e None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:24.566534 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b6eceaf1-69a8-47b4-b3ea-87f8571c222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:24.649485 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:24.709683 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eceaf1-69a8-47b4-b3ea-87f8571c222e None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:24.834486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a96d75-d774-4dbb-a170-39b044e0b859 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:24.835063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a96d75-d774-4dbb-a170-39b044e0b859 service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:24.835298 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a96d75-d774-4dbb-a170-39b044e0b859 service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:24.835565 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a96d75-d774-4dbb-a170-39b044e0b859 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:24.837158 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-33a96d75-d774-4dbb-a170-39b044e0b859 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:24.884129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:24.924142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a96d75-d774-4dbb-a170-39b044e0b859 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:24.926255 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a96d75-d774-4dbb-a170-39b044e0b859 service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:24.944746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 714/1428] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:25.808356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d57a72-b130-4deb-8038-77b6c328c512 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:25.808836 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d57a72-b130-4deb-8038-77b6c328c512 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:25.808942 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d57a72-b130-4deb-8038-77b6c328c512 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:25.810287 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:25.815334 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebb172-2560-4ec1-9f13-8d854c9ab7d7 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:25.816282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebb172-2560-4ec1-9f13-8d854c9ab7d7 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:25.816410 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebb172-2560-4ec1-9f13-8d854c9ab7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:25.892785 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-b6ebb172-2560-4ec1-9f13-8d854c9ab7d7 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:25.894789 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b6ebb172-2560-4ec1-9f13-8d854c9ab7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:25.991831 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:26.143146 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d57a72-b130-4deb-8038-77b6c328c512 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:26.145238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-69d57a72-b130-4deb-8038-77b6c328c512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:26.194207 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:26.291580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d57a72-b130-4deb-8038-77b6c328c512 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:26.402695 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec04c7-8cac-44db-8817-74ee8122414d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:26.403316 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec04c7-8cac-44db-8817-74ee8122414d service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:26.403596 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec04c7-8cac-44db-8817-74ee8122414d service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:26.403864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec04c7-8cac-44db-8817-74ee8122414d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:26.405472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-eeec04c7-8cac-44db-8817-74ee8122414d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:26.412413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:26.495221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec04c7-8cac-44db-8817-74ee8122414d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:26.496829 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec04c7-8cac-44db-8817-74ee8122414d service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:26.515625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 716/1431] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:27.372178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038c122-ee80-48b9-ad13-7d1fa3f60f75 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:27.372753 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038c122-ee80-48b9-ad13-7d1fa3f60f75 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:27.372753 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038c122-ee80-48b9-ad13-7d1fa3f60f75 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:27.374103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:27.379087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30522123-143e-4582-907e-67be7266293b None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:27.379571 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30522123-143e-4582-907e-67be7266293b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:27.379666 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30522123-143e-4582-907e-67be7266293b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:27.455504 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-30522123-143e-4582-907e-67be7266293b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:27.456843 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-30522123-143e-4582-907e-67be7266293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:27.524535 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:27.554403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:27.704397 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038c122-ee80-48b9-ad13-7d1fa3f60f75 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:27.705908 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-5038c122-ee80-48b9-ad13-7d1fa3f60f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:27.724822 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:27.852507 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038c122-ee80-48b9-ad13-7d1fa3f60f75 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:27.940064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:27.965983 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575480a6-3f40-42f9-8d4a-d6e0f3b1c676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:27.966655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575480a6-3f40-42f9-8d4a-d6e0f3b1c676 service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:27.966942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575480a6-3f40-42f9-8d4a-d6e0f3b1c676 service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:27.967222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575480a6-3f40-42f9-8d4a-d6e0f3b1c676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:27.968852 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-575480a6-3f40-42f9-8d4a-d6e0f3b1c676 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:28.058777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575480a6-3f40-42f9-8d4a-d6e0f3b1c676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:28.060464 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575480a6-3f40-42f9-8d4a-d6e0f3b1c676 service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:28.079315 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 717/1434] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:28.926851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367dbf5-a1fb-4d98-afd3-d62a7ae6d796 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:28.927402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367dbf5-a1fb-4d98-afd3-d62a7ae6d796 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:28.927402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367dbf5-a1fb-4d98-afd3-d62a7ae6d796 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:28.928687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:28.933628 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8328f9-e412-4eef-81cd-09d859008e8c None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:28.934038 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8328f9-e412-4eef-81cd-09d859008e8c None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:28.934184 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8328f9-e412-4eef-81cd-09d859008e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:29.009837 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-dc8328f9-e412-4eef-81cd-09d859008e8c None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:29.011337 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-dc8328f9-e412-4eef-81cd-09d859008e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:29.055347 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:29.111477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:29.262382 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367dbf5-a1fb-4d98-afd3-d62a7ae6d796 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:29.270614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-7367dbf5-a1fb-4d98-afd3-d62a7ae6d796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:29.413623 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367dbf5-a1fb-4d98-afd3-d62a7ae6d796 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:29.466966 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:29.539724 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543c9c7-278e-490f-b08d-49e507501137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:29.540280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543c9c7-278e-490f-b08d-49e507501137 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:29.540569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543c9c7-278e-490f-b08d-49e507501137 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:29.540847 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543c9c7-278e-490f-b08d-49e507501137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:29.542514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5543c9c7-278e-490f-b08d-49e507501137 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:29.631676 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543c9c7-278e-490f-b08d-49e507501137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:29.633279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543c9c7-278e-490f-b08d-49e507501137 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:29.651311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 719/1437] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:30.522291 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edd2fe-765b-44ea-b16c-1c112f6cbef7 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:30.522923 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edd2fe-765b-44ea-b16c-1c112f6cbef7 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:30.522923 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edd2fe-765b-44ea-b16c-1c112f6cbef7 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:30.524233 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:30.529198 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e29d33-0bca-49da-a784-b93ec15ca13b None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:30.529615 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e29d33-0bca-49da-a784-b93ec15ca13b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:30.529747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e29d33-0bca-49da-a784-b93ec15ca13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:30.605155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-76e29d33-0bca-49da-a784-b93ec15ca13b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:30.606433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-76e29d33-0bca-49da-a784-b93ec15ca13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:30.608555 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:30.705105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:30.858122 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edd2fe-765b-44ea-b16c-1c112f6cbef7 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:30.859621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-78edd2fe-765b-44ea-b16c-1c112f6cbef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:31.004219 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edd2fe-765b-44ea-b16c-1c112f6cbef7 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:31.030463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:31.114733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a954c0-ae43-4132-acdd-ab8d2d82e869 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:31.115267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a954c0-ae43-4132-acdd-ab8d2d82e869 service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:31.115544 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a954c0-ae43-4132-acdd-ab8d2d82e869 service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:31.115812 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a954c0-ae43-4132-acdd-ab8d2d82e869 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:31.117458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-11a954c0-ae43-4132-acdd-ab8d2d82e869 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:31.205165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a954c0-ae43-4132-acdd-ab8d2d82e869 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:31.206810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a954c0-ae43-4132-acdd-ab8d2d82e869 service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:31.224798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 720/1440] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:33.133986 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cf7ad-f859-44e5-9ec2-56c50ec35778 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:33.134547 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cf7ad-f859-44e5-9ec2-56c50ec35778 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:33.134670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cf7ad-f859-44e5-9ec2-56c50ec35778 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:33.136202 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:33.141701 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbe72f-260e-495e-88fd-3e21da582ef8 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:33.142106 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbe72f-260e-495e-88fd-3e21da582ef8 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:33.142246 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbe72f-260e-495e-88fd-3e21da582ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:33.183412 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:33.207828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-83dbe72f-260e-495e-88fd-3e21da582ef8 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:33.209043 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-83dbe72f-260e-495e-88fd-3e21da582ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:33.313345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:33.353365 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cf7ad-f859-44e5-9ec2-56c50ec35778 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:33.354949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-761cf7ad-f859-44e5-9ec2-56c50ec35778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:33.466267 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cf7ad-f859-44e5-9ec2-56c50ec35778 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:33.498879 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:33.545755 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e17ed2-677e-454d-95bf-626ff8095203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:33.546413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e17ed2-677e-454d-95bf-626ff8095203 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:33.546699 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e17ed2-677e-454d-95bf-626ff8095203 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:33.546980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e17ed2-677e-454d-95bf-626ff8095203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:33.548608 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-70e17ed2-677e-454d-95bf-626ff8095203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:33.665107 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e17ed2-677e-454d-95bf-626ff8095203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:33.666589 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e17ed2-677e-454d-95bf-626ff8095203 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:33.685601 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 722/1443] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:35.835458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52e92d-6245-4188-8f7e-f2e9413cc0ce None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:35.836039 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52e92d-6245-4188-8f7e-f2e9413cc0ce None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:35.836039 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52e92d-6245-4188-8f7e-f2e9413cc0ce None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:35.837365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:35.842553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777dbb1-3331-4fbf-abf7-dda321364e63 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:35.842988 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777dbb1-3331-4fbf-abf7-dda321364e63 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:35.843123 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777dbb1-3331-4fbf-abf7-dda321364e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:35.909771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-a777dbb1-3331-4fbf-abf7-dda321364e63 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:35.911006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a777dbb1-3331-4fbf-abf7-dda321364e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:35.923962 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:36.006849 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:36.050492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52e92d-6245-4188-8f7e-f2e9413cc0ce None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:36.052012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-1d52e92d-6245-4188-8f7e-f2e9413cc0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:36.153037 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52e92d-6245-4188-8f7e-f2e9413cc0ce None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:36.164994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:36.224777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166f170-8a64-4ee2-808b-9e33d0654f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:36.225325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166f170-8a64-4ee2-808b-9e33d0654f12 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:36.225608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166f170-8a64-4ee2-808b-9e33d0654f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:36.225882 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166f170-8a64-4ee2-808b-9e33d0654f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:36.227533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-1166f170-8a64-4ee2-808b-9e33d0654f12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:36.333148 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166f170-8a64-4ee2-808b-9e33d0654f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:36.334604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166f170-8a64-4ee2-808b-9e33d0654f12 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:36.352657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 723/1446] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:38.739275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600e34f-3259-481b-8844-d278fb52a062 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:38.739825 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600e34f-3259-481b-8844-d278fb52a062 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:38.739825 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600e34f-3259-481b-8844-d278fb52a062 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:38.741166 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:38.746527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb2068-298b-4734-bf71-64b15146c3b7 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:38.746962 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb2068-298b-4734-bf71-64b15146c3b7 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:38.747083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb2068-298b-4734-bf71-64b15146c3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:38.798072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:38.816041 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-49eb2068-298b-4734-bf71-64b15146c3b7 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:38.817278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-49eb2068-298b-4734-bf71-64b15146c3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:38.913586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:52:38.956389 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600e34f-3259-481b-8844-d278fb52a062 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:38.957939 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e600e34f-3259-481b-8844-d278fb52a062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:39.063000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600e34f-3259-481b-8844-d278fb52a062 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:39.110442 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:39.158669 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e463c54-308f-433f-b3ff-609e4e53508f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:39.159917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e463c54-308f-433f-b3ff-609e4e53508f service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:39.160248 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e463c54-308f-433f-b3ff-609e4e53508f service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:39.160668 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e463c54-308f-433f-b3ff-609e4e53508f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:39.163229 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5e463c54-308f-433f-b3ff-609e4e53508f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:39.273624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e463c54-308f-433f-b3ff-609e4e53508f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:39.275116 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e463c54-308f-433f-b3ff-609e4e53508f service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:39.293299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 725/1449] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:41.415732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73423873-6916-484c-a204-183fb968ee3c None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:41.416303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73423873-6916-484c-a204-183fb968ee3c None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:41.416303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73423873-6916-484c-a204-183fb968ee3c None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:41.417673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:41.423077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5da118-cbd8-45ec-9080-3cbb6920a69e None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:41.423484 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5da118-cbd8-45ec-9080-3cbb6920a69e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:41.423638 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5da118-cbd8-45ec-9080-3cbb6920a69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:41.489736 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-fa5da118-cbd8-45ec-9080-3cbb6920a69e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:41.491061 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-fa5da118-cbd8-45ec-9080-3cbb6920a69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:41.512274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:41.587022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:41.625603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73423873-6916-484c-a204-183fb968ee3c None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:41.627172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-73423873-6916-484c-a204-183fb968ee3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:41.734000 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73423873-6916-484c-a204-183fb968ee3c None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:41.753941 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:41.807798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49f9c6-ab21-4887-a39d-4102dc6f1ffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:41.808418 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49f9c6-ab21-4887-a39d-4102dc6f1ffe service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:41.808696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49f9c6-ab21-4887-a39d-4102dc6f1ffe service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:41.808968 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49f9c6-ab21-4887-a39d-4102dc6f1ffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:41.810608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4e49f9c6-ab21-4887-a39d-4102dc6f1ffe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:41.916904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49f9c6-ab21-4887-a39d-4102dc6f1ffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:41.918429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49f9c6-ab21-4887-a39d-4102dc6f1ffe service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:41.938209 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 726/1452] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:44.160330 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0886a97-545b-4cde-b056-a2652b727d80 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:44.160906 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0886a97-545b-4cde-b056-a2652b727d80 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:44.161318 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0886a97-545b-4cde-b056-a2652b727d80 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:44.163553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:52:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:44.169151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812a02b-43b3-4980-8ac2-b15a72827a8d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:44.169588 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812a02b-43b3-4980-8ac2-b15a72827a8d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:44.169690 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812a02b-43b3-4980-8ac2-b15a72827a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:44.240329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:44.243248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-a812a02b-43b3-4980-8ac2-b15a72827a8d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:44.244466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-a812a02b-43b3-4980-8ac2-b15a72827a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:44.341285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:44.380872 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0886a97-545b-4cde-b056-a2652b727d80 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:44.382418 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-b0886a97-545b-4cde-b056-a2652b727d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:44.483037 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0886a97-545b-4cde-b056-a2652b727d80 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:44.541320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:44.568374 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd2319-cac8-473b-a135-91d852964354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:44.568990 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd2319-cac8-473b-a135-91d852964354 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:44.569273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd2319-cac8-473b-a135-91d852964354 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:44.569548 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd2319-cac8-473b-a135-91d852964354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:44.571209 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-7cbd2319-cac8-473b-a135-91d852964354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:44.681192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd2319-cac8-473b-a135-91d852964354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:44.682687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd2319-cac8-473b-a135-91d852964354 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:44.701136 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 728/1455] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:46.773080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e06d5b-5bfe-4a87-88de-19abe598ca94 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:46.773667 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e06d5b-5bfe-4a87-88de-19abe598ca94 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:46.773667 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e06d5b-5bfe-4a87-88de-19abe598ca94 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:46.775010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:46.780373 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e9dc5-3205-48ce-9716-e18a38b6248e None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:46.780825 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e9dc5-3205-48ce-9716-e18a38b6248e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:46.780936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e9dc5-3205-48ce-9716-e18a38b6248e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:46.848402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-146e9dc5-3205-48ce-9716-e18a38b6248e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:46.849613 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-146e9dc5-3205-48ce-9716-e18a38b6248e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:46.878909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:46.946832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:46.985186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e06d5b-5bfe-4a87-88de-19abe598ca94 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:46.986937 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-00e06d5b-5bfe-4a87-88de-19abe598ca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:47.095207 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e06d5b-5bfe-4a87-88de-19abe598ca94 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:47.122565 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:47.168668 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610ef05-9a63-40e3-a80f-41c8f28a604b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:47.169275 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610ef05-9a63-40e3-a80f-41c8f28a604b service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:47.169551 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610ef05-9a63-40e3-a80f-41c8f28a604b service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:47.169820 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610ef05-9a63-40e3-a80f-41c8f28a604b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:47.171454 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-9610ef05-9a63-40e3-a80f-41c8f28a604b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:47.279002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610ef05-9a63-40e3-a80f-41c8f28a604b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:47.280447 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610ef05-9a63-40e3-a80f-41c8f28a604b service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:47.298902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 729/1458] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:49.352321 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dc8dd-24a3-436b-adb6-9f272b409484 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:49.352862 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dc8dd-24a3-436b-adb6-9f272b409484 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:49.352862 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dc8dd-24a3-436b-adb6-9f272b409484 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:49.354243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:52:49.359554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d94caa-494e-404b-9baf-2c9be308c8ac None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:49.359984 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d94caa-494e-404b-9baf-2c9be308c8ac None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:49.360140 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d94caa-494e-404b-9baf-2c9be308c8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:49.426171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-97d94caa-494e-404b-9baf-2c9be308c8ac None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:49.427408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-97d94caa-494e-404b-9baf-2c9be308c8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:49.435569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:49.525075 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:49.562623 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dc8dd-24a3-436b-adb6-9f272b409484 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:49.564169 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-6c3dc8dd-24a3-436b-adb6-9f272b409484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:49.672072 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dc8dd-24a3-436b-adb6-9f272b409484 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:49.727442 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:49.745588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fc205-b331-42a6-986e-63c03adce6f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:49.746248 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fc205-b331-42a6-986e-63c03adce6f0 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:49.746573 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fc205-b331-42a6-986e-63c03adce6f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:49.746858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fc205-b331-42a6-986e-63c03adce6f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:49.748482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c79fc205-b331-42a6-986e-63c03adce6f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:49.858344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fc205-b331-42a6-986e-63c03adce6f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:49.859805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fc205-b331-42a6-986e-63c03adce6f0 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:49.879552 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 731/1461] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:51.934449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3af0f-ff87-4be4-a0c5-417f57c9cc01 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:51.934986 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3af0f-ff87-4be4-a0c5-417f57c9cc01 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:51.934986 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3af0f-ff87-4be4-a0c5-417f57c9cc01 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:51.936297 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:51.941443 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2c531-3cc1-4791-8bff-874e3d4ce2d1 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:51.941882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2c531-3cc1-4791-8bff-874e3d4ce2d1 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:51.942075 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2c531-3cc1-4791-8bff-874e3d4ce2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:52.007277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-8ac2c531-3cc1-4791-8bff-874e3d4ce2d1 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:52.009489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-8ac2c531-3cc1-4791-8bff-874e3d4ce2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:52.047482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:52.105212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:52.143122 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3af0f-ff87-4be4-a0c5-417f57c9cc01 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:52.145161 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-49e3af0f-ff87-4be4-a0c5-417f57c9cc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:52.247221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3af0f-ff87-4be4-a0c5-417f57c9cc01 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:52.286786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:52.323285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc94d10-f2aa-4da2-b73b-3d0df0e15fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:52.323908 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc94d10-f2aa-4da2-b73b-3d0df0e15fcc service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:52.324193 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc94d10-f2aa-4da2-b73b-3d0df0e15fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:52.324472 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc94d10-f2aa-4da2-b73b-3d0df0e15fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:52.326094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-7fc94d10-f2aa-4da2-b73b-3d0df0e15fcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:52.434893 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc94d10-f2aa-4da2-b73b-3d0df0e15fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:52.436326 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc94d10-f2aa-4da2-b73b-3d0df0e15fcc service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:52.454501 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 732/1464] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:54.524503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c5b1d-287f-408b-bbb8-e188d3ca79cc None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:54.525063 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c5b1d-287f-408b-bbb8-e188d3ca79cc None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:54.525063 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c5b1d-287f-408b-bbb8-e188d3ca79cc None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:54.526452 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:54.531625 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657d3dc-687a-4759-aca6-25ab6f6d963a None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:54.532034 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657d3dc-687a-4759-aca6-25ab6f6d963a None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:54.532175 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657d3dc-687a-4759-aca6-25ab6f6d963a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:54.597282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-6657d3dc-687a-4759-aca6-25ab6f6d963a None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:54.598443 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-6657d3dc-687a-4759-aca6-25ab6f6d963a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:54.615929 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:54.697412 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:54.735165 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c5b1d-287f-408b-bbb8-e188d3ca79cc None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:54.737323 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-cb5c5b1d-287f-408b-bbb8-e188d3ca79cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:54.856910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c5b1d-287f-408b-bbb8-e188d3ca79cc None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:54.924989 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:54.931700 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3c6a8-1898-421f-813c-0633a3deff0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:54.948553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3c6a8-1898-421f-813c-0633a3deff0f service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:54.948553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3c6a8-1898-421f-813c-0633a3deff0f service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:54.948553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3c6a8-1898-421f-813c-0633a3deff0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:54.948553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-65a3c6a8-1898-421f-813c-0633a3deff0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:55.040780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3c6a8-1898-421f-813c-0633a3deff0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:55.042225 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3c6a8-1898-421f-813c-0633a3deff0f service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:55.060685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 734/1467] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:57.099787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ed94c-1ce5-4018-a608-e4d6d73aa9e9 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:57.100491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ed94c-1ce5-4018-a608-e4d6d73aa9e9 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:57.100491 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ed94c-1ce5-4018-a608-e4d6d73aa9e9 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:57.101753 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:57.107214 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fb10d-43b9-4493-a521-343b0e3ca61f None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:57.107636 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fb10d-43b9-4493-a521-343b0e3ca61f None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:57.107753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fb10d-43b9-4493-a521-343b0e3ca61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:57.174062 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-122fb10d-43b9-4493-a521-343b0e3ca61f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:57.176421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-122fb10d-43b9-4493-a521-343b0e3ca61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:57.229286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:57.278178 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:57.316193 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ed94c-1ce5-4018-a608-e4d6d73aa9e9 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:57.317797 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-aa1ed94c-1ce5-4018-a608-e4d6d73aa9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:57.420580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ed94c-1ce5-4018-a608-e4d6d73aa9e9 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:57.467296 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:57.494116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a1c3b-c4d6-419d-8fbf-01525876dcfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:57.494825 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a1c3b-c4d6-419d-8fbf-01525876dcfa service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:57.495107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a1c3b-c4d6-419d-8fbf-01525876dcfa service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:57.495386 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a1c3b-c4d6-419d-8fbf-01525876dcfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:57.497046 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-7c9a1c3b-c4d6-419d-8fbf-01525876dcfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:57.607688 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a1c3b-c4d6-419d-8fbf-01525876dcfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:57.609128 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a1c3b-c4d6-419d-8fbf-01525876dcfa service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:57.627829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 735/1470] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:53:07.276409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=22 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:07.625607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=66 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:17.332961 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d1d62-aa3b-4bf2-b9f0-d3f844d31a60 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:17.333497 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d1d62-aa3b-4bf2-b9f0-d3f844d31a60 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:17.333614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d1d62-aa3b-4bf2-b9f0-d3f844d31a60 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:17.334917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 736/1471] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:17.339973 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6a2eb-0f92-4108-8dc5-116e2c4eb69d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:17.340370 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6a2eb-0f92-4108-8dc5-116e2c4eb69d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:17.340521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6a2eb-0f92-4108-8dc5-116e2c4eb69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:17.405763 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-3fa6a2eb-0f92-4108-8dc5-116e2c4eb69d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:17.406994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-3fa6a2eb-0f92-4108-8dc5-116e2c4eb69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:17.507800 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 736/1472] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:17.594487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f292539-53f1-41b3-a0f3-fb479832d00a None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:17.594782 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f292539-53f1-41b3-a0f3-fb479832d00a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:17.595067 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f292539-53f1-41b3-a0f3-fb479832d00a None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:17.596942 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 737/1473] 10.222.0.86 () {54 vars in 966 bytes} [Tue Jul 26 14:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:17.601958 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232967f0-1c61-43f7-8131-0d9c40a679e1 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:17.602246 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232967f0-1c61-43f7-8131-0d9c40a679e1 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:17.602627 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232967f0-1c61-43f7-8131-0d9c40a679e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:17.679254 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-232967f0-1c61-43f7-8131-0d9c40a679e1 None None] MFA Rules not processed for user `aa31ecab10a6499f92da49bc7abb403a`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:17.680486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-232967f0-1c61-43f7-8131-0d9c40a679e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:17.701235 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:17.756428 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 737/1474] 10.222.0.86 () {58 vars in 1063 bytes} [Tue Jul 26 14:53:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:17.764518 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f292539-53f1-41b3-a0f3-fb479832d00a None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:17.766033 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0f292539-53f1-41b3-a0f3-fb479832d00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:17.869771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f292539-53f1-41b3-a0f3-fb479832d00a None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:17.942759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c73637-f546-4212-b8ea-03664c9a075c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa31ecab10a6499f92da49bc7abb403a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:17.943376 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c73637-f546-4212-b8ea-03664c9a075c service glance] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:17.943654 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c73637-f546-4212-b8ea-03664c9a075c service glance] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:17.943922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c73637-f546-4212-b8ea-03664c9a075c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:17.945523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-10c73637-f546-4212-b8ea-03664c9a075c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:17.998632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:18.054525 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c73637-f546-4212-b8ea-03664c9a075c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:18.055963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c73637-f546-4212-b8ea-03664c9a075c service glance] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:18.074814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 738/1475] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:53:20.161019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3a1c2-39d2-4622-b396-d48abd09f36d None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:20.161592 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3a1c2-39d2-4622-b396-d48abd09f36d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:20.161592 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3a1c2-39d2-4622-b396-d48abd09f36d None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:20.163097 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 738/1476] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:20.168209 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfae0a9-b41b-4cc2-a503-d1e01e06793b None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:20.168605 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfae0a9-b41b-4cc2-a503-d1e01e06793b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:20.168781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfae0a9-b41b-4cc2-a503-d1e01e06793b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:20.233759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-6bfae0a9-b41b-4cc2-a503-d1e01e06793b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:20.234995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-6bfae0a9-b41b-4cc2-a503-d1e01e06793b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:20.453664 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 739/1477] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:20.475637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3a1c2-39d2-4622-b396-d48abd09f36d None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:20.477149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b5e3a1c2-39d2-4622-b396-d48abd09f36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:20.605086 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3a1c2-39d2-4622-b396-d48abd09f36d None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:20.659199 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:20.704326 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cca4c0-9c52-4d88-aeb4-4e0fa3ea0d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:20.704875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cca4c0-9c52-4d88-aeb4-4e0fa3ea0d8d admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:20.705200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cca4c0-9c52-4d88-aeb4-4e0fa3ea0d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:20.705474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cca4c0-9c52-4d88-aeb4-4e0fa3ea0d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:20.706162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cca4c0-9c52-4d88-aeb4-4e0fa3ea0d8d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:20.708004 dv-cinder-850668-2-smb devstack@keystone.service[92030]: WARNING py.warnings [None req-d4cca4c0-9c52-4d88-aeb4-4e0fa3ea0d8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:53:20.708004 dv-cinder-850668-2-smb devstack@keystone.service[92030]: warnings.warn(msg) Jul 26 14:53:20.708004 dv-cinder-850668-2-smb devstack@keystone.service[92030]: Jul 26 14:53:20.709136 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cca4c0-9c52-4d88-aeb4-4e0fa3ea0d8d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:20.728823 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 739/1478] 10.222.0.86 () {56 vars in 1108 bytes} [Tue Jul 26 14:53:20 2022] GET /identity/v3/projects => generated 2553 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:53:22.749524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604df9b3-a813-4eca-9ec6-2b7f4b8362fd None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:22.750063 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604df9b3-a813-4eca-9ec6-2b7f4b8362fd None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:22.750063 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604df9b3-a813-4eca-9ec6-2b7f4b8362fd None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:22.751453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 740/1479] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:22.756721 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbd8ae-7c30-46af-9de1-4d4c4ca86538 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:22.757182 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbd8ae-7c30-46af-9de1-4d4c4ca86538 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:22.757286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbd8ae-7c30-46af-9de1-4d4c4ca86538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:22.823651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-7afbd8ae-7c30-46af-9de1-4d4c4ca86538 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:22.824875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-7afbd8ae-7c30-46af-9de1-4d4c4ca86538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:22.928721 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 740/1480] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:22.973967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604df9b3-a813-4eca-9ec6-2b7f4b8362fd None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:22.975555 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-604df9b3-a813-4eca-9ec6-2b7f4b8362fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:22.985189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:23.117198 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604df9b3-a813-4eca-9ec6-2b7f4b8362fd None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:23.199518 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:23.231590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c14775-04c1-42e0-9291-8772cde5b97d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:23.232207 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c14775-04c1-42e0-9291-8772cde5b97d service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:23.232491 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c14775-04c1-42e0-9291-8772cde5b97d service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:23.232765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c14775-04c1-42e0-9291-8772cde5b97d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:23.234421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-28c14775-04c1-42e0-9291-8772cde5b97d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:23.325536 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c14775-04c1-42e0-9291-8772cde5b97d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:23.327171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c14775-04c1-42e0-9291-8772cde5b97d service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:23.344742 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 741/1481] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:53:25.545081 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cc335-0d85-474a-9d96-0fc58096864d None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:25.545642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cc335-0d85-474a-9d96-0fc58096864d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:25.545642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cc335-0d85-474a-9d96-0fc58096864d None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:25.547061 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 741/1482] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:25.552822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb349c3-c9a6-4c9a-a03b-ccad49f38316 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:25.553296 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb349c3-c9a6-4c9a-a03b-ccad49f38316 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:25.553401 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb349c3-c9a6-4c9a-a03b-ccad49f38316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:25.622416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-5cb349c3-c9a6-4c9a-a03b-ccad49f38316 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:25.623659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5cb349c3-c9a6-4c9a-a03b-ccad49f38316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:25.671689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:25.733067 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 742/1483] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:25.770564 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cc335-0d85-474a-9d96-0fc58096864d None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:25.772207 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-995cc335-0d85-474a-9d96-0fc58096864d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:25.795993 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:25.876306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cc335-0d85-474a-9d96-0fc58096864d None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:25.948968 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908db1e-7451-43b5-a624-70d66d7c0381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:25.949594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908db1e-7451-43b5-a624-70d66d7c0381 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:25.949875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908db1e-7451-43b5-a624-70d66d7c0381 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:25.950149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908db1e-7451-43b5-a624-70d66d7c0381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:25.951790 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f908db1e-7451-43b5-a624-70d66d7c0381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:26.026791 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:26.069116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908db1e-7451-43b5-a624-70d66d7c0381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:26.070496 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908db1e-7451-43b5-a624-70d66d7c0381 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:26.093184 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 742/1484] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:53:28.154081 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e93355-6f36-4c33-80aa-f9b447bd38ef None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:28.154623 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e93355-6f36-4c33-80aa-f9b447bd38ef None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:28.154742 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e93355-6f36-4c33-80aa-f9b447bd38ef None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:28.156011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 743/1485] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:28.161824 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ac0b9-74bd-46b9-ae76-8baae4fd3e6b None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:28.162267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ac0b9-74bd-46b9-ae76-8baae4fd3e6b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:28.162380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ac0b9-74bd-46b9-ae76-8baae4fd3e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:28.228814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-c26ac0b9-74bd-46b9-ae76-8baae4fd3e6b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:28.230036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-c26ac0b9-74bd-46b9-ae76-8baae4fd3e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:28.327127 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 743/1486] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:28.368769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e93355-6f36-4c33-80aa-f9b447bd38ef None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:28.370356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-f8e93355-6f36-4c33-80aa-f9b447bd38ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:28.473420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e93355-6f36-4c33-80aa-f9b447bd38ef None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:28.549917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:28.551733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2c589-35e5-43b7-9b92-1e1fc885059c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:28.552353 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2c589-35e5-43b7-9b92-1e1fc885059c service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:28.552633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2c589-35e5-43b7-9b92-1e1fc885059c service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:28.552913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2c589-35e5-43b7-9b92-1e1fc885059c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:28.554558 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-48d2c589-35e5-43b7-9b92-1e1fc885059c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:28.666933 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2c589-35e5-43b7-9b92-1e1fc885059c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:28.668292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2c589-35e5-43b7-9b92-1e1fc885059c service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:28.687362 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 744/1487] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:53:30.795997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b8f61-0fd5-4569-a11c-4055c7697eae None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:30.796568 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b8f61-0fd5-4569-a11c-4055c7697eae None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:30.796568 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b8f61-0fd5-4569-a11c-4055c7697eae None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:30.797908 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 744/1488] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:30.803403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9a0f3-9720-4c36-ac87-795e41a965f0 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:30.803871 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9a0f3-9720-4c36-ac87-795e41a965f0 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:30.804015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9a0f3-9720-4c36-ac87-795e41a965f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:30.868983 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-edd9a0f3-9720-4c36-ac87-795e41a965f0 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:30.870126 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-edd9a0f3-9720-4c36-ac87-795e41a965f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:30.922001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:30.966267 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 745/1489] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:31.007511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b8f61-0fd5-4569-a11c-4055c7697eae None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:31.009348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b44b8f61-0fd5-4569-a11c-4055c7697eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:31.045457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:31.112221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b8f61-0fd5-4569-a11c-4055c7697eae None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:31.183260 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336e6da-887d-43c8-8309-2e79107ebacc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:31.183786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336e6da-887d-43c8-8309-2e79107ebacc service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:31.184065 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336e6da-887d-43c8-8309-2e79107ebacc service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:31.184337 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336e6da-887d-43c8-8309-2e79107ebacc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:31.185941 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-3336e6da-887d-43c8-8309-2e79107ebacc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:31.266144 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:31.297039 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336e6da-887d-43c8-8309-2e79107ebacc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:31.298486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336e6da-887d-43c8-8309-2e79107ebacc service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:31.316836 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 745/1490] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:53:33.698057 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dd23e-7737-4e05-8c41-89058f02dc4a None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:33.698634 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dd23e-7737-4e05-8c41-89058f02dc4a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:33.699090 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dd23e-7737-4e05-8c41-89058f02dc4a None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:33.702457 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 746/1491] 10.222.0.86 () {54 vars in 926 bytes} [Tue Jul 26 14:53:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:33.708677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5bec1-32d2-47b4-984f-6b4c41ebd5cc None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:33.710041 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5bec1-32d2-47b4-984f-6b4c41ebd5cc None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:33.710870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5bec1-32d2-47b4-984f-6b4c41ebd5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:33.786241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-fdb5bec1-32d2-47b4-984f-6b4c41ebd5cc None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:33.787517 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-fdb5bec1-32d2-47b4-984f-6b4c41ebd5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:33.885607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 746/1492] 10.222.0.86 () {58 vars in 1023 bytes} [Tue Jul 26 14:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:33.926741 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2dd23e-7737-4e05-8c41-89058f02dc4a None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:33.928267 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3b2dd23e-7737-4e05-8c41-89058f02dc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:34.032713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2dd23e-7737-4e05-8c41-89058f02dc4a None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:34.106472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f20cfe-ef56-4a38-9f33-f393ffda9246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:34.107095 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f20cfe-ef56-4a38-9f33-f393ffda9246 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:34.107377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f20cfe-ef56-4a38-9f33-f393ffda9246 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:34.107652 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f20cfe-ef56-4a38-9f33-f393ffda9246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:34.109267 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-96f20cfe-ef56-4a38-9f33-f393ffda9246 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:34.118256 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:34.219679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f20cfe-ef56-4a38-9f33-f393ffda9246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:34.221081 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f20cfe-ef56-4a38-9f33-f393ffda9246 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:34.239715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 747/1493] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:53:43.883890 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=82 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:44.237397 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=50 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:15.392055 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b8d88-181c-48cd-8d56-5ef3cf4825b1 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:15.392679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b8d88-181c-48cd-8d56-5ef3cf4825b1 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:15.392784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b8d88-181c-48cd-8d56-5ef3cf4825b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:15.471606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-226b8d88-181c-48cd-8d56-5ef3cf4825b1 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:15.472779 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-226b8d88-181c-48cd-8d56-5ef3cf4825b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:15.567359 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 747/1494] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:55:15.575629 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42806902-2c79-4d6e-b9ee-2d3b39f97bfa None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:15.576110 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42806902-2c79-4d6e-b9ee-2d3b39f97bfa None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:15.576216 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42806902-2c79-4d6e-b9ee-2d3b39f97bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:15.650682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-42806902-2c79-4d6e-b9ee-2d3b39f97bfa None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:15.651892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-42806902-2c79-4d6e-b9ee-2d3b39f97bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:15.747740 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 748/1495] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:55:15.752859 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b8d88-181c-48cd-8d56-5ef3cf4825b1 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:15.754079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-226b8d88-181c-48cd-8d56-5ef3cf4825b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:15.766408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b8d88-181c-48cd-8d56-5ef3cf4825b1 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:15.826494 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:15.861017 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5a38f-8e9a-4c62-8901-ee04495b5568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:15.861630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5a38f-8e9a-4c62-8901-ee04495b5568 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:15.861912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5a38f-8e9a-4c62-8901-ee04495b5568 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:15.862183 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5a38f-8e9a-4c62-8901-ee04495b5568 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:15.862900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5a38f-8e9a-4c62-8901-ee04495b5568 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:55:15.863203 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5a38f-8e9a-4c62-8901-ee04495b5568 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:15.864374 dv-cinder-850668-2-smb devstack@keystone.service[92030]: WARNING py.warnings [None req-0bc5a38f-8e9a-4c62-8901-ee04495b5568 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:55:15.864374 dv-cinder-850668-2-smb devstack@keystone.service[92030]: warnings.warn(msg) Jul 26 14:55:15.864374 dv-cinder-850668-2-smb devstack@keystone.service[92030]: Jul 26 14:55:15.865243 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5a38f-8e9a-4c62-8901-ee04495b5568 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:15.877464 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 748/1496] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 14:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:55:15.886027 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42806902-2c79-4d6e-b9ee-2d3b39f97bfa None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:15.896210 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42806902-2c79-4d6e-b9ee-2d3b39f97bfa None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:15.956707 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:15.992082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924ad68-6bd4-4333-aa50-eaee49dd786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:15.992980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924ad68-6bd4-4333-aa50-eaee49dd786d admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:15.993264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924ad68-6bd4-4333-aa50-eaee49dd786d admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:15.993543 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924ad68-6bd4-4333-aa50-eaee49dd786d admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:15.994219 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924ad68-6bd4-4333-aa50-eaee49dd786d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:15.995999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: WARNING py.warnings [None req-7924ad68-6bd4-4333-aa50-eaee49dd786d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:55:15.995999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: warnings.warn(msg) Jul 26 14:55:15.995999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: Jul 26 14:55:15.997193 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924ad68-6bd4-4333-aa50-eaee49dd786d admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:16.142413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 749/1497] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:55:15 2022] POST /identity/v3/projects => generated 379 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:55:16.146671 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5a38f-8e9a-4c62-8901-ee04495b5568 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:16.148255 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-0bc5a38f-8e9a-4c62-8901-ee04495b5568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:16.182777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5a38f-8e9a-4c62-8901-ee04495b5568 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:16.285030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae96e7d-c7da-43d7-9d5f-076a2eb94189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:16.285666 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae96e7d-c7da-43d7-9d5f-076a2eb94189 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:16.285939 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae96e7d-c7da-43d7-9d5f-076a2eb94189 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:16.286210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae96e7d-c7da-43d7-9d5f-076a2eb94189 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:16.286903 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae96e7d-c7da-43d7-9d5f-076a2eb94189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:16.288022 dv-cinder-850668-2-smb devstack@keystone.service[92030]: WARNING py.warnings [None req-cae96e7d-c7da-43d7-9d5f-076a2eb94189 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:55:16.288022 dv-cinder-850668-2-smb devstack@keystone.service[92030]: warnings.warn(msg) Jul 26 14:55:16.288022 dv-cinder-850668-2-smb devstack@keystone.service[92030]: Jul 26 14:55:16.289222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae96e7d-c7da-43d7-9d5f-076a2eb94189 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:16.393361 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 749/1498] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:55:16 2022] POST /identity/v3/users => generated 290 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:55:16.397572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924ad68-6bd4-4333-aa50-eaee49dd786d admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:16.399104 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-7924ad68-6bd4-4333-aa50-eaee49dd786d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:16.463275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924ad68-6bd4-4333-aa50-eaee49dd786d admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:16.550402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:16.560619 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945c3a1-c296-4622-a887-bef6044a19ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:16.562672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945c3a1-c296-4622-a887-bef6044a19ec admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:16.562672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945c3a1-c296-4622-a887-bef6044a19ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:16.562672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945c3a1-c296-4622-a887-bef6044a19ec admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:16.562672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945c3a1-c296-4622-a887-bef6044a19ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:16.563625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: WARNING py.warnings [None req-4945c3a1-c296-4622-a887-bef6044a19ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:55:16.563625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: warnings.warn(msg) Jul 26 14:55:16.563625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: Jul 26 14:55:16.564515 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945c3a1-c296-4622-a887-bef6044a19ec admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:16.576826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 750/1499] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:55:16.580902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae96e7d-c7da-43d7-9d5f-076a2eb94189 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:16.582561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-cae96e7d-c7da-43d7-9d5f-076a2eb94189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:16.594289 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae96e7d-c7da-43d7-9d5f-076a2eb94189 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:16.619531 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:16.689299 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f621d-9dac-41d6-9de7-41aa9c334d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:16.690373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f621d-9dac-41d6-9de7-41aa9c334d04 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:16.690373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f621d-9dac-41d6-9de7-41aa9c334d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:16.690668 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f621d-9dac-41d6-9de7-41aa9c334d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:16.692020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f621d-9dac-41d6-9de7-41aa9c334d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:16.692503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: WARNING py.warnings [None req-737f621d-9dac-41d6-9de7-41aa9c334d04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:55:16.692503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: warnings.warn(msg) Jul 26 14:55:16.692503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: Jul 26 14:55:16.693572 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f621d-9dac-41d6-9de7-41aa9c334d04 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:16.707069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 750/1500] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:55:16.711282 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945c3a1-c296-4622-a887-bef6044a19ec admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:16.712844 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4945c3a1-c296-4622-a887-bef6044a19ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:16.746095 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945c3a1-c296-4622-a887-bef6044a19ec admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:16.839213 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c8701-bc26-4ddc-80e3-7949c25c9fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:16.839876 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c8701-bc26-4ddc-80e3-7949c25c9fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:16.840155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c8701-bc26-4ddc-80e3-7949c25c9fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:16.840434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c8701-bc26-4ddc-80e3-7949c25c9fd8 admin admin] PATH_INFO: `/v3/projects/9cda747036b6400cbd11ea5d8c235cb7/users/d67a872665184d239b4a54a66edaf342/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:16.863218 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c8701-bc26-4ddc-80e3-7949c25c9fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cda747036b6400cbd11ea5d8c235cb7, user_id=d67a872665184d239b4a54a66edaf342, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:16.864255 dv-cinder-850668-2-smb devstack@keystone.service[92029]: WARNING py.warnings [None req-c50c8701-bc26-4ddc-80e3-7949c25c9fd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:55:16.864255 dv-cinder-850668-2-smb devstack@keystone.service[92029]: warnings.warn(msg) Jul 26 14:55:16.864255 dv-cinder-850668-2-smb devstack@keystone.service[92029]: Jul 26 14:55:16.866206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c8701-bc26-4ddc-80e3-7949c25c9fd8 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:16.981491 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 751/1501] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:55:16 2022] PUT /identity/v3/projects/9cda747036b6400cbd11ea5d8c235cb7/users/d67a872665184d239b4a54a66edaf342/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:55:16.993873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c50140-1259-4811-a34d-275bdb505c21 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:16.994170 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c50140-1259-4811-a34d-275bdb505c21 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:16.994489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c50140-1259-4811-a34d-275bdb505c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:17.051752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-c8c50140-1259-4811-a34d-275bdb505c21 None None] MFA Rules not processed for user `d67a872665184d239b4a54a66edaf342`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:17.052967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-c8c50140-1259-4811-a34d-275bdb505c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:17.128696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 751/1502] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:55:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:55:17.142148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ace55-b373-47d4-98a3-9376a30dcbaa None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:17.142972 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ace55-b373-47d4-98a3-9376a30dcbaa None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:17.143260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ace55-b373-47d4-98a3-9376a30dcbaa None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:17.144651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 752/1503] 10.222.0.86 () {54 vars in 964 bytes} [Tue Jul 26 14:55:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:17.149544 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d69c4a-f1e8-45e4-98fb-025624ae8f37 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:17.149868 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d69c4a-f1e8-45e4-98fb-025624ae8f37 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:17.150147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d69c4a-f1e8-45e4-98fb-025624ae8f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:17.184665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:17.230270 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-a3d69c4a-f1e8-45e4-98fb-025624ae8f37 None None] MFA Rules not processed for user `6f495077bafd4fd18cc682fe0a6b7f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:17.231570 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-a3d69c4a-f1e8-45e4-98fb-025624ae8f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:17.307060 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 752/1504] 10.222.0.86 () {58 vars in 1061 bytes} [Tue Jul 26 14:55:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:55:17.315269 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ace55-b373-47d4-98a3-9376a30dcbaa None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:17.316785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e73ace55-b373-47d4-98a3-9376a30dcbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:17.367670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:17.421945 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ace55-b373-47d4-98a3-9376a30dcbaa None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:17.498142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23611b71-2a10-4f32-a655-b7efc62c8ded service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:17.498793 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23611b71-2a10-4f32-a655-b7efc62c8ded service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:17.499083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23611b71-2a10-4f32-a655-b7efc62c8ded service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:17.499365 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23611b71-2a10-4f32-a655-b7efc62c8ded service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:17.500993 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-23611b71-2a10-4f32-a655-b7efc62c8ded service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:17.598875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23611b71-2a10-4f32-a655-b7efc62c8ded service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:17.600312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23611b71-2a10-4f32-a655-b7efc62c8ded service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:17.603823 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:17.617752 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 753/1505] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:55:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:55:17.663524 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b5221-8b79-48be-a25b-3d7bf9dcf4e2 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:17.663961 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b5221-8b79-48be-a25b-3d7bf9dcf4e2 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:17.664067 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b5221-8b79-48be-a25b-3d7bf9dcf4e2 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:17.665375 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 753/1506] 10.222.0.86 () {52 vars in 830 bytes} [Tue Jul 26 14:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:17.669001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23611b71-2a10-4f32-a655-b7efc62c8ded service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:17.670266 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-23611b71-2a10-4f32-a655-b7efc62c8ded service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:17.769569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23611b71-2a10-4f32-a655-b7efc62c8ded service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:17.863243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801681c2-2a4c-4bb4-bf08-463af7499ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:17.863884 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801681c2-2a4c-4bb4-bf08-463af7499ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:17.864175 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801681c2-2a4c-4bb4-bf08-463af7499ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:17.864446 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801681c2-2a4c-4bb4-bf08-463af7499ce3 admin admin] PATH_INFO: `/v3/users/d67a872665184d239b4a54a66edaf342` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:17.876547 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801681c2-2a4c-4bb4-bf08-463af7499ce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d67a872665184d239b4a54a66edaf342)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:17.878210 dv-cinder-850668-2-smb devstack@keystone.service[92029]: WARNING py.warnings [None req-801681c2-2a4c-4bb4-bf08-463af7499ce3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:55:17.878210 dv-cinder-850668-2-smb devstack@keystone.service[92029]: warnings.warn(msg) Jul 26 14:55:17.878210 dv-cinder-850668-2-smb devstack@keystone.service[92029]: Jul 26 14:55:17.879909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801681c2-2a4c-4bb4-bf08-463af7499ce3 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:17.890141 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:18.134734 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-801681c2-2a4c-4bb4-bf08-463af7499ce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd67a872665184d239b4a54a66edaf342'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:55:18.135177 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-801681c2-2a4c-4bb4-bf08-463af7499ce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd67a872665184d239b4a54a66edaf342'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:55:18.154882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-801681c2-2a4c-4bb4-bf08-463af7499ce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd67a872665184d239b4a54a66edaf342'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:55:18.243128 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-801681c2-2a4c-4bb4-bf08-463af7499ce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd67a872665184d239b4a54a66edaf342'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:55:18.243586 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-801681c2-2a4c-4bb4-bf08-463af7499ce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd67a872665184d239b4a54a66edaf342'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:55:18.262858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 754/1507] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 14:55:17 2022] DELETE /identity/v3/users/d67a872665184d239b4a54a66edaf342 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:55:18.268870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a5011-7c10-44a2-829b-4ee489fd995b None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:18.268870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a5011-7c10-44a2-829b-4ee489fd995b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:18.268870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a5011-7c10-44a2-829b-4ee489fd995b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:18.329066 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-b43a5011-7c10-44a2-829b-4ee489fd995b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:18.330807 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b43a5011-7c10-44a2-829b-4ee489fd995b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:18.406507 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:18.419928 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 754/1508] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:55:18.429602 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801681c2-2a4c-4bb4-bf08-463af7499ce3 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:18.430859 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-801681c2-2a4c-4bb4-bf08-463af7499ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:18.532439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801681c2-2a4c-4bb4-bf08-463af7499ce3 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:18.587177 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:18.606790 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb781e-4141-4a8e-ae51-bff7ad869a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:18.607399 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb781e-4141-4a8e-ae51-bff7ad869a50 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:18.607688 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb781e-4141-4a8e-ae51-bff7ad869a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:18.607969 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb781e-4141-4a8e-ae51-bff7ad869a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:18.609587 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-32bb781e-4141-4a8e-ae51-bff7ad869a50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:18.720158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb781e-4141-4a8e-ae51-bff7ad869a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:18.722190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb781e-4141-4a8e-ae51-bff7ad869a50 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:18.745123 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 755/1509] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:55:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:55:19.297035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a5011-7c10-44a2-829b-4ee489fd995b None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:19.298414 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b43a5011-7c10-44a2-829b-4ee489fd995b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:19.309919 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a5011-7c10-44a2-829b-4ee489fd995b None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:19.427537 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bc23f-dfca-4eff-89f7-57ff6bc81e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:19.428210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bc23f-dfca-4eff-89f7-57ff6bc81e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:19.428493 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bc23f-dfca-4eff-89f7-57ff6bc81e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:19.428770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bc23f-dfca-4eff-89f7-57ff6bc81e0a admin admin] PATH_INFO: `/v3/projects/9cda747036b6400cbd11ea5d8c235cb7` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:19.438598 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bc23f-dfca-4eff-89f7-57ff6bc81e0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cda747036b6400cbd11ea5d8c235cb7)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:19.439620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: WARNING py.warnings [None req-7e4bc23f-dfca-4eff-89f7-57ff6bc81e0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:55:19.439620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: warnings.warn(msg) Jul 26 14:55:19.439620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: Jul 26 14:55:19.440822 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bc23f-dfca-4eff-89f7-57ff6bc81e0a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:19.550326 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7e4bc23f-dfca-4eff-89f7-57ff6bc81e0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cda747036b6400cbd11ea5d8c235cb7', 'request_id': 'req-7e4bc23f-dfca-4eff-89f7-57ff6bc81e0a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:55:19.563333 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7e4bc23f-dfca-4eff-89f7-57ff6bc81e0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cda747036b6400cbd11ea5d8c235cb7', 'request_id': 'req-7e4bc23f-dfca-4eff-89f7-57ff6bc81e0a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:55:19.637025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7e4bc23f-dfca-4eff-89f7-57ff6bc81e0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cda747036b6400cbd11ea5d8c235cb7', 'request_id': 'req-7e4bc23f-dfca-4eff-89f7-57ff6bc81e0a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:55:19.661368 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7e4bc23f-dfca-4eff-89f7-57ff6bc81e0a admin admin] The token cache is being invalidate because project 9cda747036b6400cbd11ea5d8c235cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 14:55:19.661664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7e4bc23f-dfca-4eff-89f7-57ff6bc81e0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:55:19.662091 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7e4bc23f-dfca-4eff-89f7-57ff6bc81e0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:55:19.663680 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 755/1510] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 14:55:19 2022] DELETE /identity/v3/projects/9cda747036b6400cbd11ea5d8c235cb7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:55:28.738473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=62 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:29.659306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:17.156151 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cc6b5-4231-4df2-8683-09450080b5ff None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:17.156775 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cc6b5-4231-4df2-8683-09450080b5ff None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:17.156775 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cc6b5-4231-4df2-8683-09450080b5ff None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:17.158139 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:57:17.163107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbcc4d-739b-4217-aa65-b0b95305a186 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:17.163551 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbcc4d-739b-4217-aa65-b0b95305a186 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:17.163670 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbcc4d-739b-4217-aa65-b0b95305a186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:17.248222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-c2bbcc4d-739b-4217-aa65-b0b95305a186 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:17.249441 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-c2bbcc4d-739b-4217-aa65-b0b95305a186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:17.355417 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:57:17.509722 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cc6b5-4231-4df2-8683-09450080b5ff None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:17.511853 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-6a9cc6b5-4231-4df2-8683-09450080b5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:17.633281 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cc6b5-4231-4df2-8683-09450080b5ff None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:17.641103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06a24a-4478-4f59-ae7c-ade3e419a739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:17.641730 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06a24a-4478-4f59-ae7c-ade3e419a739 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:17.642016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06a24a-4478-4f59-ae7c-ade3e419a739 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:17.642294 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06a24a-4478-4f59-ae7c-ade3e419a739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:17.652943 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06a24a-4478-4f59-ae7c-ade3e419a739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:17.654572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06a24a-4478-4f59-ae7c-ade3e419a739 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:17.664329 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 757/1513] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:57:18.499359 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce477c-b4e7-4277-b38d-4330688d7792 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:18.500010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce477c-b4e7-4277-b38d-4330688d7792 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:18.500010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce477c-b4e7-4277-b38d-4330688d7792 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:18.501257 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:18.506024 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ceea9-0e4e-4480-8767-cb27110e7e9e None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:18.506500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ceea9-0e4e-4480-8767-cb27110e7e9e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:18.506610 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ceea9-0e4e-4480-8767-cb27110e7e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:18.530121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-ea0ceea9-0e4e-4480-8767-cb27110e7e9e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:18.532260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ea0ceea9-0e4e-4480-8767-cb27110e7e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:18.546002 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:57:18.699076 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce477c-b4e7-4277-b38d-4330688d7792 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:18.714428 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce477c-b4e7-4277-b38d-4330688d7792 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:18.719942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800d464-24b5-4a7e-a0ba-6b6fd81d523d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:18.720752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800d464-24b5-4a7e-a0ba-6b6fd81d523d service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:18.721042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800d464-24b5-4a7e-a0ba-6b6fd81d523d service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:18.721320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800d464-24b5-4a7e-a0ba-6b6fd81d523d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:18.729700 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800d464-24b5-4a7e-a0ba-6b6fd81d523d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:18.731815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800d464-24b5-4a7e-a0ba-6b6fd81d523d service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:18.741237 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 758/1516] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:57:19.473881 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfd566-b72d-4e3a-b3e7-fd67954967fa None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:19.474176 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfd566-b72d-4e3a-b3e7-fd67954967fa None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:19.474490 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfd566-b72d-4e3a-b3e7-fd67954967fa None None] PATH_INFO: `/v3` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:19.475777 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 759/1517] 10.222.0.36 () {54 vars in 925 bytes} [Tue Jul 26 14:57:19 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:19.482383 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a18950-0dea-41bb-8e25-64c9c0bbc201 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:19.482693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a18950-0dea-41bb-8e25-64c9c0bbc201 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:19.482967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a18950-0dea-41bb-8e25-64c9c0bbc201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:19.542662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-a3a18950-0dea-41bb-8e25-64c9c0bbc201 None None] MFA Rules not processed for user `0fab620bc5d044479746d8ea17615a74`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:19.543942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-a3a18950-0dea-41bb-8e25-64c9c0bbc201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:19.567953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:19.629231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 759/1518] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Jul 26 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:57:28.522994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=56 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:29.623943 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4db1e-4870-48eb-8b8b-a9215e965e2a None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:29.624546 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4db1e-4870-48eb-8b8b-a9215e965e2a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:29.624546 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4db1e-4870-48eb-8b8b-a9215e965e2a None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:29.626047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 760/1519] 10.222.0.86 () {54 vars in 961 bytes} [Tue Jul 26 14:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:29.626656 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=23 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:29.631258 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fe2a4-4284-4314-bc6e-d866304ffe5f None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:29.631547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fe2a4-4284-4314-bc6e-d866304ffe5f None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:29.631826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fe2a4-4284-4314-bc6e-d866304ffe5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:29.655440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-654fe2a4-4284-4314-bc6e-d866304ffe5f None None] MFA Rules not processed for user `0fab620bc5d044479746d8ea17615a74`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:29.656678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-654fe2a4-4284-4314-bc6e-d866304ffe5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:29.666053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 760/1520] 10.222.0.86 () {58 vars in 1058 bytes} [Tue Jul 26 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:57:29.674442 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4db1e-4870-48eb-8b8b-a9215e965e2a None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:29.688439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4db1e-4870-48eb-8b8b-a9215e965e2a None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:29.693897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b434ca-5242-4575-a4e0-f5c368115cdc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fab620bc5d044479746d8ea17615a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:29.694566 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b434ca-5242-4575-a4e0-f5c368115cdc service placement] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:29.694857 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b434ca-5242-4575-a4e0-f5c368115cdc service placement] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:29.695142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b434ca-5242-4575-a4e0-f5c368115cdc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:29.704650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b434ca-5242-4575-a4e0-f5c368115cdc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:29.706260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b434ca-5242-4575-a4e0-f5c368115cdc service placement] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:29.716396 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 761/1521] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:57:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:57:29.982977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fb383-becb-4dd5-8807-6bc3f8aa4c2c None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:29.983275 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fb383-becb-4dd5-8807-6bc3f8aa4c2c None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:29.983553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fb383-becb-4dd5-8807-6bc3f8aa4c2c None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:29.984974 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:29.990003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4ddb9-6d46-4257-aa6a-240680a90d08 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:29.990292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4ddb9-6d46-4257-aa6a-240680a90d08 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:29.990608 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4ddb9-6d46-4257-aa6a-240680a90d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:30.010482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-7ca4ddb9-6d46-4257-aa6a-240680a90d08 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:30.011685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-7ca4ddb9-6d46-4257-aa6a-240680a90d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:30.020692 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:57:30.175493 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fb383-becb-4dd5-8807-6bc3f8aa4c2c None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:30.188676 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fb383-becb-4dd5-8807-6bc3f8aa4c2c None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:30.194045 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c902b4f-b121-4066-9542-205ec9f504d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:30.194733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c902b4f-b121-4066-9542-205ec9f504d9 service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:30.195022 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c902b4f-b121-4066-9542-205ec9f504d9 service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:30.195299 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c902b4f-b121-4066-9542-205ec9f504d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:30.204131 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c902b4f-b121-4066-9542-205ec9f504d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:30.205744 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c902b4f-b121-4066-9542-205ec9f504d9 service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:30.215100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 762/1524] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:57:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:57:31.039646 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202288d-67a4-4bb6-9b1b-fec9b4e14ffc None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:31.040222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202288d-67a4-4bb6-9b1b-fec9b4e14ffc None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:31.040222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202288d-67a4-4bb6-9b1b-fec9b4e14ffc None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:31.041607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:31.046402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff9377-5359-406a-91cd-c01975b360ed None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:31.046841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff9377-5359-406a-91cd-c01975b360ed None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:31.046956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff9377-5359-406a-91cd-c01975b360ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:31.066691 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-5bff9377-5359-406a-91cd-c01975b360ed None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:31.067874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-5bff9377-5359-406a-91cd-c01975b360ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:31.075694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:57:31.227988 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202288d-67a4-4bb6-9b1b-fec9b4e14ffc None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:31.242870 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202288d-67a4-4bb6-9b1b-fec9b4e14ffc None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:31.248211 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737522f3-5340-4e2c-a6e3-676ede3956e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:31.249387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737522f3-5340-4e2c-a6e3-676ede3956e9 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:31.249674 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737522f3-5340-4e2c-a6e3-676ede3956e9 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:31.249948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737522f3-5340-4e2c-a6e3-676ede3956e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:31.258171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737522f3-5340-4e2c-a6e3-676ede3956e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:31.259776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737522f3-5340-4e2c-a6e3-676ede3956e9 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:31.269420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 764/1527] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:57:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:57:35.308151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a7fed-339f-4dfe-bed1-e41677160aa5 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:35.308708 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a7fed-339f-4dfe-bed1-e41677160aa5 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:35.308813 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a7fed-339f-4dfe-bed1-e41677160aa5 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:35.310143 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:35.315798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6730a08-3d14-44e0-b04b-895f69b2eb48 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:35.316204 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6730a08-3d14-44e0-b04b-895f69b2eb48 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:35.316346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6730a08-3d14-44e0-b04b-895f69b2eb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:35.336935 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-c6730a08-3d14-44e0-b04b-895f69b2eb48 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:35.338127 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c6730a08-3d14-44e0-b04b-895f69b2eb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:35.346107 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:57:35.422174 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a7fed-339f-4dfe-bed1-e41677160aa5 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:35.424169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-3f6a7fed-339f-4dfe-bed1-e41677160aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:35.500953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a7fed-339f-4dfe-bed1-e41677160aa5 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:35.504689 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea067699-c508-4ef6-aa1f-f431bb8f47c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:35.505315 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea067699-c508-4ef6-aa1f-f431bb8f47c9 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:35.505599 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea067699-c508-4ef6-aa1f-f431bb8f47c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:35.505877 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea067699-c508-4ef6-aa1f-f431bb8f47c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:35.515726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea067699-c508-4ef6-aa1f-f431bb8f47c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:35.517152 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea067699-c508-4ef6-aa1f-f431bb8f47c9 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:35.526756 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 765/1530] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:57:37.541430 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130fbdd-265d-4823-bd9a-ea0db85a8456 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:37.542003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130fbdd-265d-4823-bd9a-ea0db85a8456 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:37.542003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130fbdd-265d-4823-bd9a-ea0db85a8456 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:37.543407 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:37.549295 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183abf8-bcc0-4492-9ba8-9d96619a26b1 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:37.549755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183abf8-bcc0-4492-9ba8-9d96619a26b1 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:37.549919 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183abf8-bcc0-4492-9ba8-9d96619a26b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:37.569939 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-b183abf8-bcc0-4492-9ba8-9d96619a26b1 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:37.571178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b183abf8-bcc0-4492-9ba8-9d96619a26b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:37.579631 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:57:37.615975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130fbdd-265d-4823-bd9a-ea0db85a8456 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:37.626629 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130fbdd-265d-4823-bd9a-ea0db85a8456 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:37.630079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73402ea-09bc-43d8-88d9-2232b5699564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:37.630722 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73402ea-09bc-43d8-88d9-2232b5699564 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:37.631006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73402ea-09bc-43d8-88d9-2232b5699564 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:37.631282 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73402ea-09bc-43d8-88d9-2232b5699564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:37.640010 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73402ea-09bc-43d8-88d9-2232b5699564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:37.641695 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73402ea-09bc-43d8-88d9-2232b5699564 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:37.651340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 767/1533] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:57:41.565800 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363bbb7-b58b-4e2c-8836-d5f03d6f98aa None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:41.566459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363bbb7-b58b-4e2c-8836-d5f03d6f98aa None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:41.566459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363bbb7-b58b-4e2c-8836-d5f03d6f98aa None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:41.567735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:41.573039 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0c6eb-5173-4dc8-9f72-6759b20d21b7 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:41.573488 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0c6eb-5173-4dc8-9f72-6759b20d21b7 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:41.573610 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0c6eb-5173-4dc8-9f72-6759b20d21b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:41.593345 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-c9f0c6eb-5173-4dc8-9f72-6759b20d21b7 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:41.594689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c9f0c6eb-5173-4dc8-9f72-6759b20d21b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:41.602754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:57:41.915323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363bbb7-b58b-4e2c-8836-d5f03d6f98aa None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:41.917139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e363bbb7-b58b-4e2c-8836-d5f03d6f98aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:41.996563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363bbb7-b58b-4e2c-8836-d5f03d6f98aa None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:42.000914 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c279b02-3029-4108-9fc8-ec01a80c11f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:42.001533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c279b02-3029-4108-9fc8-ec01a80c11f7 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:42.001816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c279b02-3029-4108-9fc8-ec01a80c11f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:42.002093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c279b02-3029-4108-9fc8-ec01a80c11f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:42.011786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c279b02-3029-4108-9fc8-ec01a80c11f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:42.013204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c279b02-3029-4108-9fc8-ec01a80c11f7 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:42.023011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 768/1536] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:57:44.056842 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b85b25-24e3-44e0-9fef-88c7629a55a1 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:44.057400 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b85b25-24e3-44e0-9fef-88c7629a55a1 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:44.057400 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b85b25-24e3-44e0-9fef-88c7629a55a1 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:44.058794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:57:44.063826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b41b5-9b37-42cf-acd8-df01688503ef None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:44.064238 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b41b5-9b37-42cf-acd8-df01688503ef None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:44.064379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b41b5-9b37-42cf-acd8-df01688503ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:44.085409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-d61b41b5-9b37-42cf-acd8-df01688503ef None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:44.086652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d61b41b5-9b37-42cf-acd8-df01688503ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:44.094646 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:57:44.399386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b85b25-24e3-44e0-9fef-88c7629a55a1 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:44.401102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-08b85b25-24e3-44e0-9fef-88c7629a55a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:44.414028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b85b25-24e3-44e0-9fef-88c7629a55a1 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:44.417534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d59e2-3479-4dac-bc17-c7a17427143d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:44.418141 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d59e2-3479-4dac-bc17-c7a17427143d service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:44.418458 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d59e2-3479-4dac-bc17-c7a17427143d service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:44.418739 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d59e2-3479-4dac-bc17-c7a17427143d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:44.427560 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d59e2-3479-4dac-bc17-c7a17427143d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:44.428984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d59e2-3479-4dac-bc17-c7a17427143d service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:44.438771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 770/1539] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:57:54.080500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=88 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:54.434101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=33 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:29.172716 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb33a8-ef5a-40da-9ae6-efba20698464 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:29.173356 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb33a8-ef5a-40da-9ae6-efba20698464 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:29.173356 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb33a8-ef5a-40da-9ae6-efba20698464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:29.200084 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ba73-c778-4db2-a22a-5f6cb98b40a1 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:29.201173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ba73-c778-4db2-a22a-5f6cb98b40a1 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:29.201742 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ba73-c778-4db2-a22a-5f6cb98b40a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:29.207537 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-dfeb33a8-ef5a-40da-9ae6-efba20698464 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:29.208956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-dfeb33a8-ef5a-40da-9ae6-efba20698464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:29.224092 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 770/1540] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:29.237610 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-0e11ba73-c778-4db2-a22a-5f6cb98b40a1 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:29.241596 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0e11ba73-c778-4db2-a22a-5f6cb98b40a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:29.252528 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 771/1541] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:59:29.255949 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d0ca7-c97c-42a8-b977-01daad3666a3 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:29.256217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d0ca7-c97c-42a8-b977-01daad3666a3 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:29.256504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d0ca7-c97c-42a8-b977-01daad3666a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:29.269609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de403f0a-b5f5-46aa-acd7-5e3332e7969a None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:29.270283 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de403f0a-b5f5-46aa-acd7-5e3332e7969a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:29.270921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de403f0a-b5f5-46aa-acd7-5e3332e7969a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:29.295589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-011d0ca7-c97c-42a8-b977-01daad3666a3 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:29.297112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-011d0ca7-c97c-42a8-b977-01daad3666a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:29.300522 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-de403f0a-b5f5-46aa-acd7-5e3332e7969a None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:29.302139 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-de403f0a-b5f5-46aa-acd7-5e3332e7969a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:29.317232 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 772/1542] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:59:29.319893 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 771/1543] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:59:29.325443 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de403f0a-b5f5-46aa-acd7-5e3332e7969a None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:29.334912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d0ca7-c97c-42a8-b977-01daad3666a3 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:29.340820 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de403f0a-b5f5-46aa-acd7-5e3332e7969a None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:29.348142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe2bef-035a-4064-88a6-7b0032a3bd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:29.349163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe2bef-035a-4064-88a6-7b0032a3bd4f admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:29.349699 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe2bef-035a-4064-88a6-7b0032a3bd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:29.350176 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe2bef-035a-4064-88a6-7b0032a3bd4f admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:29.351145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe2bef-035a-4064-88a6-7b0032a3bd4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:59:29.352584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe2bef-035a-4064-88a6-7b0032a3bd4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:29.354042 dv-cinder-850668-2-smb devstack@keystone.service[92029]: WARNING py.warnings [None req-57fe2bef-035a-4064-88a6-7b0032a3bd4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:59:29.354042 dv-cinder-850668-2-smb devstack@keystone.service[92029]: warnings.warn(msg) Jul 26 14:59:29.354042 dv-cinder-850668-2-smb devstack@keystone.service[92029]: Jul 26 14:59:29.357462 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d0ca7-c97c-42a8-b977-01daad3666a3 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:29.359238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe2bef-035a-4064-88a6-7b0032a3bd4f admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:29.377691 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6168f91-a8e5-454d-ac05-d93c62302231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:29.378692 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6168f91-a8e5-454d-ac05-d93c62302231 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:29.378980 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6168f91-a8e5-454d-ac05-d93c62302231 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:29.379260 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6168f91-a8e5-454d-ac05-d93c62302231 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:29.379996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6168f91-a8e5-454d-ac05-d93c62302231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:59:29.380310 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6168f91-a8e5-454d-ac05-d93c62302231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:29.381995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6168f91-a8e5-454d-ac05-d93c62302231 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:29.383209 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 773/1544] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 14:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:59:29.393711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe2bef-035a-4064-88a6-7b0032a3bd4f admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:29.406082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 772/1545] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 14:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:59:29.408357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe2bef-035a-4064-88a6-7b0032a3bd4f admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:29.418640 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420f5c1-9da8-4bd3-8d38-c7f134721668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:29.419726 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420f5c1-9da8-4bd3-8d38-c7f134721668 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:29.420335 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420f5c1-9da8-4bd3-8d38-c7f134721668 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:29.420813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420f5c1-9da8-4bd3-8d38-c7f134721668 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:29.421728 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420f5c1-9da8-4bd3-8d38-c7f134721668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:29.423862 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420f5c1-9da8-4bd3-8d38-c7f134721668 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:29.435458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6168f91-a8e5-454d-ac05-d93c62302231 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:29.450357 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6168f91-a8e5-454d-ac05-d93c62302231 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:29.468290 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e031318-9d2f-46ee-af23-a7585634247b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:29.468930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e031318-9d2f-46ee-af23-a7585634247b admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:29.469214 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e031318-9d2f-46ee-af23-a7585634247b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:29.469551 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e031318-9d2f-46ee-af23-a7585634247b admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:29.470527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e031318-9d2f-46ee-af23-a7585634247b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:29.471552 dv-cinder-850668-2-smb devstack@keystone.service[92030]: WARNING py.warnings [None req-9e031318-9d2f-46ee-af23-a7585634247b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:59:29.471552 dv-cinder-850668-2-smb devstack@keystone.service[92030]: warnings.warn(msg) Jul 26 14:59:29.471552 dv-cinder-850668-2-smb devstack@keystone.service[92030]: Jul 26 14:59:29.477316 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e031318-9d2f-46ee-af23-a7585634247b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:29.552322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 774/1546] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:59:29 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:59:29.554134 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab2ed3-7474-4107-92f8-5df7f4fff408 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:29.554663 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab2ed3-7474-4107-92f8-5df7f4fff408 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:29.555503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab2ed3-7474-4107-92f8-5df7f4fff408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:29.585508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-4bab2ed3-7474-4107-92f8-5df7f4fff408 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:29.587851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4bab2ed3-7474-4107-92f8-5df7f4fff408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:29.645071 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 773/1547] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:59:29 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:29.645983 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e031318-9d2f-46ee-af23-a7585634247b admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:29.672309 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 775/1548] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:29.677352 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f922fe-4ff8-4f57-870c-54227653f51b None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:29.677352 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f922fe-4ff8-4f57-870c-54227653f51b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:29.677352 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f922fe-4ff8-4f57-870c-54227653f51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:29.726184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-d6f922fe-4ff8-4f57-870c-54227653f51b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:29.732791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d6f922fe-4ff8-4f57-870c-54227653f51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:29.764563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e031318-9d2f-46ee-af23-a7585634247b admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:29.770374 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c904fa-8412-4dde-bcfd-d0580907a25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:29.771206 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c904fa-8412-4dde-bcfd-d0580907a25e admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:29.771500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c904fa-8412-4dde-bcfd-d0580907a25e admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:29.771783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c904fa-8412-4dde-bcfd-d0580907a25e admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:29.772982 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c904fa-8412-4dde-bcfd-d0580907a25e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:29.776311 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c904fa-8412-4dde-bcfd-d0580907a25e admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:29.811817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 776/1549] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:29.812662 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f922fe-4ff8-4f57-870c-54227653f51b None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:29.822161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f922fe-4ff8-4f57-870c-54227653f51b None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:29.826779 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc25935-d062-4904-be16-1136ab0fde08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:29.827385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc25935-d062-4904-be16-1136ab0fde08 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:29.827672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc25935-d062-4904-be16-1136ab0fde08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:29.827955 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc25935-d062-4904-be16-1136ab0fde08 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:29.828618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc25935-d062-4904-be16-1136ab0fde08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:29.829647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: WARNING py.warnings [None req-8dc25935-d062-4904-be16-1136ab0fde08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:59:29.829647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: warnings.warn(msg) Jul 26 14:59:29.829647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: Jul 26 14:59:29.831105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc25935-d062-4904-be16-1136ab0fde08 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:29.894234 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 774/1550] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:59:29 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:29.895320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725ed13-0143-4563-85d8-5c1644c78a38 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:29.895642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725ed13-0143-4563-85d8-5c1644c78a38 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:29.895921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725ed13-0143-4563-85d8-5c1644c78a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:29.916867 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-4725ed13-0143-4563-85d8-5c1644c78a38 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:29.918081 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4725ed13-0143-4563-85d8-5c1644c78a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:29.923476 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 777/1551] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:59:29 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:29.925275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e4647-ed5b-4fa8-80c4-9f9132f4901c None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:29.925916 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e4647-ed5b-4fa8-80c4-9f9132f4901c None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:29.926831 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e4647-ed5b-4fa8-80c4-9f9132f4901c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:29.932282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 775/1552] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:29.932282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb9ae2-940f-4c78-a102-45656a208cc2 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:29.932282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb9ae2-940f-4c78-a102-45656a208cc2 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:29.932282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb9ae2-940f-4c78-a102-45656a208cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:29.947228 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-c33e4647-ed5b-4fa8-80c4-9f9132f4901c None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:29.948430 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c33e4647-ed5b-4fa8-80c4-9f9132f4901c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:29.951114 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-e1fb9ae2-940f-4c78-a102-45656a208cc2 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:29.952291 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e1fb9ae2-940f-4c78-a102-45656a208cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:29.956408 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 778/1553] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:29.958774 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949636f-9edf-46c6-ac10-c5ae9783bd2c None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:29.958774 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949636f-9edf-46c6-ac10-c5ae9783bd2c None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:29.958774 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949636f-9edf-46c6-ac10-c5ae9783bd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:29.963103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 776/1554] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:29.964500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4bbf9-9c2a-43aa-9fd4-ca2e5a78ff55 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:29.965176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4bbf9-9c2a-43aa-9fd4-ca2e5a78ff55 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:29.965460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4bbf9-9c2a-43aa-9fd4-ca2e5a78ff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:29.986243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-9949636f-9edf-46c6-ac10-c5ae9783bd2c None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:29.987563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-7be4bbf9-9c2a-43aa-9fd4-ca2e5a78ff55 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:29.987679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-9949636f-9edf-46c6-ac10-c5ae9783bd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:29.988433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-7be4bbf9-9c2a-43aa-9fd4-ca2e5a78ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:29.995464 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 779/1555] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:29.997002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 777/1556] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:29.997121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d6053-c003-4e07-b017-257ab23fa87d None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:29.997372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4bbf9-9c2a-43aa-9fd4-ca2e5a78ff55 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:29.997497 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d6053-c003-4e07-b017-257ab23fa87d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:29.997679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d6053-c003-4e07-b017-257ab23fa87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.019770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4bbf9-9c2a-43aa-9fd4-ca2e5a78ff55 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:30.021460 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-2d4d6053-c003-4e07-b017-257ab23fa87d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:30.022811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2d4d6053-c003-4e07-b017-257ab23fa87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:30.025696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fdc64-5a0b-491e-a7f7-686782b36b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:30.026324 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fdc64-5a0b-491e-a7f7-686782b36b7f admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.026648 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fdc64-5a0b-491e-a7f7-686782b36b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.026925 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fdc64-5a0b-491e-a7f7-686782b36b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.027622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fdc64-5a0b-491e-a7f7-686782b36b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:30.029227 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fdc64-5a0b-491e-a7f7-686782b36b7f admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:30.032325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 780/1557] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:30.033205 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d6053-c003-4e07-b017-257ab23fa87d None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:30.042562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 778/1558] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:30.042562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fdc64-5a0b-491e-a7f7-686782b36b7f admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:30.045064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d6053-c003-4e07-b017-257ab23fa87d None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:30.049396 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3952a2-fca0-45f0-a91c-9bed0e193dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:30.050022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3952a2-fca0-45f0-a91c-9bed0e193dcf admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.050422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3952a2-fca0-45f0-a91c-9bed0e193dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.050614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3952a2-fca0-45f0-a91c-9bed0e193dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.051417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3952a2-fca0-45f0-a91c-9bed0e193dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:30.052888 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fdc64-5a0b-491e-a7f7-686782b36b7f admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:30.053018 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3952a2-fca0-45f0-a91c-9bed0e193dcf admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:30.054514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:30.059941 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8f98f-1be3-4ec9-9655-83889982c850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:30.060557 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8f98f-1be3-4ec9-9655-83889982c850 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.060842 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8f98f-1be3-4ec9-9655-83889982c850 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.061168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8f98f-1be3-4ec9-9655-83889982c850 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.061845 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8f98f-1be3-4ec9-9655-83889982c850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:59:30.062148 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8f98f-1be3-4ec9-9655-83889982c850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:30.063825 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8f98f-1be3-4ec9-9655-83889982c850 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:30.064126 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 781/1559] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:30.065502 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3831e-047b-49b1-bca5-19875d28292a None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.065770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3831e-047b-49b1-bca5-19875d28292a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.066054 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3831e-047b-49b1-bca5-19875d28292a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.086997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 779/1560] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 14:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:59:30.086997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a82dd-0015-4755-997d-0d08fe95a0e0 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.086997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a82dd-0015-4755-997d-0d08fe95a0e0 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.086997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a82dd-0015-4755-997d-0d08fe95a0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.087533 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-3ed3831e-047b-49b1-bca5-19875d28292a None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:30.088522 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3ed3831e-047b-49b1-bca5-19875d28292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:30.096985 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 782/1561] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:30.098078 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f4382-9dae-4198-873d-3f94af3aa041 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.098369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f4382-9dae-4198-873d-3f94af3aa041 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.098686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f4382-9dae-4198-873d-3f94af3aa041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.103834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-fb4a82dd-0015-4755-997d-0d08fe95a0e0 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:30.105067 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-fb4a82dd-0015-4755-997d-0d08fe95a0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:30.113071 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 780/1562] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:30.114269 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2992c-909f-4244-b942-086edeeeaf10 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.114668 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2992c-909f-4244-b942-086edeeeaf10 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.114996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2992c-909f-4244-b942-086edeeeaf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.119133 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-b96f4382-9dae-4198-873d-3f94af3aa041 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:30.120331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-b96f4382-9dae-4198-873d-3f94af3aa041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:30.128945 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 783/1563] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:30.130068 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f4382-9dae-4198-873d-3f94af3aa041 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:30.134616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-d2a2992c-909f-4244-b942-086edeeeaf10 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:30.135832 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d2a2992c-909f-4244-b942-086edeeeaf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:30.140326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f4382-9dae-4198-873d-3f94af3aa041 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:30.147812 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 781/1564] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:30.147812 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2992c-909f-4244-b942-086edeeeaf10 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:30.148073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212ab48-be29-42d9-b51d-d87ba87483c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:30.148073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212ab48-be29-42d9-b51d-d87ba87483c8 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.148073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212ab48-be29-42d9-b51d-d87ba87483c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.148073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212ab48-be29-42d9-b51d-d87ba87483c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.148524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212ab48-be29-42d9-b51d-d87ba87483c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:59:30.148524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212ab48-be29-42d9-b51d-d87ba87483c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:30.149606 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212ab48-be29-42d9-b51d-d87ba87483c8 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:30.155088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2992c-909f-4244-b942-086edeeeaf10 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:30.159716 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c61c8-5732-483a-a176-66a561c2f7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:30.160323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c61c8-5732-483a-a176-66a561c2f7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.160606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c61c8-5732-483a-a176-66a561c2f7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.160884 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c61c8-5732-483a-a176-66a561c2f7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.168116 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 784/1565] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 14:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:59:30.168282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c61c8-5732-483a-a176-66a561c2f7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:30.168378 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212ab48-be29-42d9-b51d-d87ba87483c8 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:30.168467 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c61c8-5732-483a-a176-66a561c2f7f0 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:30.172403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212ab48-be29-42d9-b51d-d87ba87483c8 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:30.176990 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58338cc7-51c5-4a84-8203-fa15462c3109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:30.177607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58338cc7-51c5-4a84-8203-fa15462c3109 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.177894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58338cc7-51c5-4a84-8203-fa15462c3109 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.178175 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58338cc7-51c5-4a84-8203-fa15462c3109 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.178920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58338cc7-51c5-4a84-8203-fa15462c3109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:30.179132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 782/1566] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:30.179977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c61c8-5732-483a-a176-66a561c2f7f0 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:30.181660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58338cc7-51c5-4a84-8203-fa15462c3109 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:30.189744 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c61c8-5732-483a-a176-66a561c2f7f0 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:30.193193 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 785/1567] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:30.194095 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58338cc7-51c5-4a84-8203-fa15462c3109 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:30.194621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcf9d4-2df6-41ee-9121-8c8776a54d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:30.195241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcf9d4-2df6-41ee-9121-8c8776a54d35 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.196070 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcf9d4-2df6-41ee-9121-8c8776a54d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.196350 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcf9d4-2df6-41ee-9121-8c8776a54d35 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.197295 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcf9d4-2df6-41ee-9121-8c8776a54d35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:30.199232 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcf9d4-2df6-41ee-9121-8c8776a54d35 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:30.204499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58338cc7-51c5-4a84-8203-fa15462c3109 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:30.208989 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b9b51-8d84-47f5-9bd5-e20996c165ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:30.209596 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b9b51-8d84-47f5-9bd5-e20996c165ba admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.209879 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b9b51-8d84-47f5-9bd5-e20996c165ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.210160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b9b51-8d84-47f5-9bd5-e20996c165ba admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.210883 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b9b51-8d84-47f5-9bd5-e20996c165ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:59:30.211753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b9b51-8d84-47f5-9bd5-e20996c165ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:30.213345 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b9b51-8d84-47f5-9bd5-e20996c165ba admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:30.224958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 786/1568] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 14:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:59:30.225827 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b9b51-8d84-47f5-9bd5-e20996c165ba admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:30.235183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b9b51-8d84-47f5-9bd5-e20996c165ba admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:30.239857 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc5690-926a-4cca-8e23-812b6dadc358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:30.240443 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc5690-926a-4cca-8e23-812b6dadc358 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.240738 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc5690-926a-4cca-8e23-812b6dadc358 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.241021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc5690-926a-4cca-8e23-812b6dadc358 admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.241694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc5690-926a-4cca-8e23-812b6dadc358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:59:30.242001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc5690-926a-4cca-8e23-812b6dadc358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:30.244327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc5690-926a-4cca-8e23-812b6dadc358 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:30.256105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 787/1569] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 14:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:59:30.257017 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc5690-926a-4cca-8e23-812b6dadc358 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:30.266977 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc5690-926a-4cca-8e23-812b6dadc358 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:30.271780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674551a9-2795-45fa-ade5-53486f171387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:30.272357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674551a9-2795-45fa-ade5-53486f171387 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.272647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674551a9-2795-45fa-ade5-53486f171387 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.272924 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674551a9-2795-45fa-ade5-53486f171387 admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.273619 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674551a9-2795-45fa-ade5-53486f171387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:59:30.273927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674551a9-2795-45fa-ade5-53486f171387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:30.275514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674551a9-2795-45fa-ade5-53486f171387 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:30.286778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 788/1570] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 14:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:59:30.287611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674551a9-2795-45fa-ade5-53486f171387 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:30.297593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674551a9-2795-45fa-ade5-53486f171387 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:30.302334 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6009014-5915-4ce9-aab8-572e00a8d974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:30.302989 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6009014-5915-4ce9-aab8-572e00a8d974 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.303275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6009014-5915-4ce9-aab8-572e00a8d974 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.303581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6009014-5915-4ce9-aab8-572e00a8d974 admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.304259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6009014-5915-4ce9-aab8-572e00a8d974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:59:30.304565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6009014-5915-4ce9-aab8-572e00a8d974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:30.306706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6009014-5915-4ce9-aab8-572e00a8d974 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:30.318564 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 789/1571] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 14:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:59:30.319452 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6009014-5915-4ce9-aab8-572e00a8d974 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:30.330589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 783/1572] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:59:30 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:30.330995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6009014-5915-4ce9-aab8-572e00a8d974 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:30.331799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcf9d4-2df6-41ee-9121-8c8776a54d35 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:30.344251 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:30.389986 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff1740-2f6a-423c-962d-953e2b03c27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:30.390777 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff1740-2f6a-423c-962d-953e2b03c27d admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.391065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff1740-2f6a-423c-962d-953e2b03c27d admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.391367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff1740-2f6a-423c-962d-953e2b03c27d admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.392306 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff1740-2f6a-423c-962d-953e2b03c27d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:30.394251 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcf9d4-2df6-41ee-9121-8c8776a54d35 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:30.394379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff1740-2f6a-423c-962d-953e2b03c27d admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:30.408792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bb634-f458-4bc1-bde1-1e6844dc92a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:30.408792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bb634-f458-4bc1-bde1-1e6844dc92a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.408792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bb634-f458-4bc1-bde1-1e6844dc92a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.408792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bb634-f458-4bc1-bde1-1e6844dc92a0 admin admin] PATH_INFO: `/v3/projects/67bdd4504dfe4ea4aa648e41db3e43f4/users/5c70efef6195448aad1657adda83b85a/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.415006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bb634-f458-4bc1-bde1-1e6844dc92a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67bdd4504dfe4ea4aa648e41db3e43f4, user_id=5c70efef6195448aad1657adda83b85a, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:30.416052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: WARNING py.warnings [None req-419bb634-f458-4bc1-bde1-1e6844dc92a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:59:30.416052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: warnings.warn(msg) Jul 26 14:59:30.416052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: Jul 26 14:59:30.418047 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bb634-f458-4bc1-bde1-1e6844dc92a0 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:30.512573 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 790/1573] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:59:30 2022] POST /identity/v3/projects => generated 393 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:30.513592 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff1740-2f6a-423c-962d-953e2b03c27d admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:30.523115 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 784/1574] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:30 2022] PUT /identity/v3/projects/67bdd4504dfe4ea4aa648e41db3e43f4/users/5c70efef6195448aad1657adda83b85a/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:30.523960 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bb634-f458-4bc1-bde1-1e6844dc92a0 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:30.579111 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:30.587837 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bb634-f458-4bc1-bde1-1e6844dc92a0 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:30.592339 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff1740-2f6a-423c-962d-953e2b03c27d admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:30.592705 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82fe51-457a-477b-8de2-890546e1ea06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:30.593421 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82fe51-457a-477b-8de2-890546e1ea06 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.593791 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82fe51-457a-477b-8de2-890546e1ea06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.594079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82fe51-457a-477b-8de2-890546e1ea06 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.594847 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82fe51-457a-477b-8de2-890546e1ea06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:30.596765 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82fe51-457a-477b-8de2-890546e1ea06 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:30.597036 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9c10a-5558-4b2b-a365-c52a768b254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:30.597742 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9c10a-5558-4b2b-a365-c52a768b254c admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.598057 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9c10a-5558-4b2b-a365-c52a768b254c admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.598337 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9c10a-5558-4b2b-a365-c52a768b254c admin admin] PATH_INFO: `/v3/projects/4fad395737274c84b69d4040fbc9310f/users/23f8fb537ff1459b8061b78f689b56fb/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.614163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9c10a-5558-4b2b-a365-c52a768b254c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fad395737274c84b69d4040fbc9310f, user_id=23f8fb537ff1459b8061b78f689b56fb, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:30.616880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9c10a-5558-4b2b-a365-c52a768b254c admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:30.699771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 791/1575] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:30 2022] PUT /identity/v3/projects/4fad395737274c84b69d4040fbc9310f/users/23f8fb537ff1459b8061b78f689b56fb/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:30.702205 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9c10a-5558-4b2b-a365-c52a768b254c admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:30.704368 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 785/1576] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:59:30 2022] POST /identity/v3/projects => generated 363 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:30.705271 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82fe51-457a-477b-8de2-890546e1ea06 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:30.764212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9c10a-5558-4b2b-a365-c52a768b254c admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:30.767877 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82fe51-457a-477b-8de2-890546e1ea06 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:30.769279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcd1f0-3f45-4153-a2ad-64aa9ccb3a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:30.769903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcd1f0-3f45-4153-a2ad-64aa9ccb3a07 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.770189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcd1f0-3f45-4153-a2ad-64aa9ccb3a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.770503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcd1f0-3f45-4153-a2ad-64aa9ccb3a07 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.771171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcd1f0-3f45-4153-a2ad-64aa9ccb3a07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:30.772672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f177927-111f-4aba-abb6-bccbd772408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:30.773096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcd1f0-3f45-4153-a2ad-64aa9ccb3a07 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:30.774577 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f177927-111f-4aba-abb6-bccbd772408a admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:30.774862 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f177927-111f-4aba-abb6-bccbd772408a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:30.775139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f177927-111f-4aba-abb6-bccbd772408a admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:30.775858 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f177927-111f-4aba-abb6-bccbd772408a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:30.777730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f177927-111f-4aba-abb6-bccbd772408a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:30.895398 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 792/1577] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:59:30 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:30.896387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcd1f0-3f45-4153-a2ad-64aa9ccb3a07 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:30.930521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 786/1578] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:59:30 2022] POST /identity/v3/projects => generated 387 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:30.931401 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f177927-111f-4aba-abb6-bccbd772408a admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:30.937171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:30.964314 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcd1f0-3f45-4153-a2ad-64aa9ccb3a07 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:30.996310 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f177927-111f-4aba-abb6-bccbd772408a admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.001138 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b253115-e90c-4418-93b2-18655a2e393e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.005742 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b253115-e90c-4418-93b2-18655a2e393e admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.005742 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b253115-e90c-4418-93b2-18655a2e393e admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.005742 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b253115-e90c-4418-93b2-18655a2e393e admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.005742 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b253115-e90c-4418-93b2-18655a2e393e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.005742 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b253115-e90c-4418-93b2-18655a2e393e admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.021935 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d801c-0bcf-4162-a1d6-2dc91c277a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.022615 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d801c-0bcf-4162-a1d6-2dc91c277a69 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.022892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d801c-0bcf-4162-a1d6-2dc91c277a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.023168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d801c-0bcf-4162-a1d6-2dc91c277a69 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.023839 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d801c-0bcf-4162-a1d6-2dc91c277a69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.025834 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d801c-0bcf-4162-a1d6-2dc91c277a69 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.037004 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:31.140275 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 787/1579] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:59:30 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:31.141314 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b253115-e90c-4418-93b2-18655a2e393e admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:31.151234 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b253115-e90c-4418-93b2-18655a2e393e admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.155979 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898a579-3ccd-4c24-b0e0-4e7ee52bb88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.156575 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898a579-3ccd-4c24-b0e0-4e7ee52bb88d admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.156861 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898a579-3ccd-4c24-b0e0-4e7ee52bb88d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.157135 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898a579-3ccd-4c24-b0e0-4e7ee52bb88d admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.157785 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898a579-3ccd-4c24-b0e0-4e7ee52bb88d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.161756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 793/1580] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:59:30 2022] POST /identity/v3/projects => generated 403 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:31.161894 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898a579-3ccd-4c24-b0e0-4e7ee52bb88d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.162009 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c0c33-b003-4929-af5b-c48372442fd7 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.162009 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c0c33-b003-4929-af5b-c48372442fd7 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.162009 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c0c33-b003-4929-af5b-c48372442fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.192317 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-cc8c0c33-b003-4929-af5b-c48372442fd7 None None] MFA Rules not processed for user `5c70efef6195448aad1657adda83b85a`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:31.193453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-cc8c0c33-b003-4929-af5b-c48372442fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:31.255357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 794/1581] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:31.256602 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c7e02-ba2d-41a0-b8fa-3615ea3339cd None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.256891 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c7e02-ba2d-41a0-b8fa-3615ea3339cd None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.257169 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c7e02-ba2d-41a0-b8fa-3615ea3339cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.278120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-632c7e02-ba2d-41a0-b8fa-3615ea3339cd None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:31.279362 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-632c7e02-ba2d-41a0-b8fa-3615ea3339cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:31.339596 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 795/1582] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:31.340685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c7e02-ba2d-41a0-b8fa-3615ea3339cd None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:31.347741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 788/1583] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:59:31 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:31.348625 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898a579-3ccd-4c24-b0e0-4e7ee52bb88d admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:31.352139 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c7e02-ba2d-41a0-b8fa-3615ea3339cd None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.357956 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380161d-4965-4852-b321-6ef377803625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.358623 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380161d-4965-4852-b321-6ef377803625 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.358915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380161d-4965-4852-b321-6ef377803625 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.359195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380161d-4965-4852-b321-6ef377803625 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.359867 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380161d-4965-4852-b321-6ef377803625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.360804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898a579-3ccd-4c24-b0e0-4e7ee52bb88d admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.361793 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380161d-4965-4852-b321-6ef377803625 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.365426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5de1d-d628-4d6a-aca4-0c9d14ec0562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.366108 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5de1d-d628-4d6a-aca4-0c9d14ec0562 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.366407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5de1d-d628-4d6a-aca4-0c9d14ec0562 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.366696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5de1d-d628-4d6a-aca4-0c9d14ec0562 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.367982 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5de1d-d628-4d6a-aca4-0c9d14ec0562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.370162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5de1d-d628-4d6a-aca4-0c9d14ec0562 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.500311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 796/1584] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:59:31 2022] POST /identity/v3/users => generated 282 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:31.501331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380161d-4965-4852-b321-6ef377803625 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:31.511193 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380161d-4965-4852-b321-6ef377803625 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.515719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfba8a5-d1a5-4efa-a258-afae7d448449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.516313 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfba8a5-d1a5-4efa-a258-afae7d448449 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.516598 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfba8a5-d1a5-4efa-a258-afae7d448449 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.516872 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfba8a5-d1a5-4efa-a258-afae7d448449 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.517789 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfba8a5-d1a5-4efa-a258-afae7d448449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.519750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfba8a5-d1a5-4efa-a258-afae7d448449 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.531806 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 789/1585] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:59:31 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:31.531806 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5de1d-d628-4d6a-aca4-0c9d14ec0562 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:31.539930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5de1d-d628-4d6a-aca4-0c9d14ec0562 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.544570 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272ac5a-d100-4956-be78-d48177df5636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.545154 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272ac5a-d100-4956-be78-d48177df5636 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.545433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272ac5a-d100-4956-be78-d48177df5636 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.545704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272ac5a-d100-4956-be78-d48177df5636 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.546380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272ac5a-d100-4956-be78-d48177df5636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.547979 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272ac5a-d100-4956-be78-d48177df5636 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.558707 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 790/1586] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:31.559460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272ac5a-d100-4956-be78-d48177df5636 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:31.568835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272ac5a-d100-4956-be78-d48177df5636 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.573784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16999f1-722b-425c-a6f7-d120c75562d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.574351 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16999f1-722b-425c-a6f7-d120c75562d1 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.574671 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16999f1-722b-425c-a6f7-d120c75562d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.574943 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16999f1-722b-425c-a6f7-d120c75562d1 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.575582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16999f1-722b-425c-a6f7-d120c75562d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.577674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16999f1-722b-425c-a6f7-d120c75562d1 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.676958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 797/1587] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:59:31 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:31.678643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fe303-2344-4627-aa5b-786277d52d07 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.678935 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fe303-2344-4627-aa5b-786277d52d07 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.679310 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fe303-2344-4627-aa5b-786277d52d07 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.680959 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 798/1588] 10.222.0.86 () {54 vars in 962 bytes} [Tue Jul 26 14:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:59:31.681693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fe303-2344-4627-aa5b-786277d52d07 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:31.718469 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 791/1589] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:59:31 2022] POST /identity/v3/users => generated 302 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:31.718469 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16999f1-722b-425c-a6f7-d120c75562d1 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:31.727813 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16999f1-722b-425c-a6f7-d120c75562d1 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.732638 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19554326-abc7-4a75-bfed-59a81b68c764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.733235 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19554326-abc7-4a75-bfed-59a81b68c764 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.733516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19554326-abc7-4a75-bfed-59a81b68c764 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.733792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19554326-abc7-4a75-bfed-59a81b68c764 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.734513 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19554326-abc7-4a75-bfed-59a81b68c764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.734689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:31.736149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19554326-abc7-4a75-bfed-59a81b68c764 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.740358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fe303-2344-4627-aa5b-786277d52d07 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.745296 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddfe3a-4c0b-47e4-9a7b-32e02774b4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.746614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddfe3a-4c0b-47e4-9a7b-32e02774b4dc service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.746614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddfe3a-4c0b-47e4-9a7b-32e02774b4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.746614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddfe3a-4c0b-47e4-9a7b-32e02774b4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.750085 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 792/1590] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:31.751277 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19554326-abc7-4a75-bfed-59a81b68c764 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:31.756089 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddfe3a-4c0b-47e4-9a7b-32e02774b4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.757672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddfe3a-4c0b-47e4-9a7b-32e02774b4dc service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.761741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19554326-abc7-4a75-bfed-59a81b68c764 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.766246 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54068b-02a9-4e0e-8e88-b413b4011f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.766920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54068b-02a9-4e0e-8e88-b413b4011f92 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.767447 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54068b-02a9-4e0e-8e88-b413b4011f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.767722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54068b-02a9-4e0e-8e88-b413b4011f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.768409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54068b-02a9-4e0e-8e88-b413b4011f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.768967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 799/1591] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:31.769871 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddfe3a-4c0b-47e4-9a7b-32e02774b4dc service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:31.769985 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54068b-02a9-4e0e-8e88-b413b4011f92 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.779358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddfe3a-4c0b-47e4-9a7b-32e02774b4dc service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.781356 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 793/1592] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:31.782285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54068b-02a9-4e0e-8e88-b413b4011f92 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:31.787474 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7973c-0d88-4c9d-942d-1f445d8b8976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.788384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7973c-0d88-4c9d-942d-1f445d8b8976 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.788384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7973c-0d88-4c9d-942d-1f445d8b8976 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.788652 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7973c-0d88-4c9d-942d-1f445d8b8976 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.789724 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7973c-0d88-4c9d-942d-1f445d8b8976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.791553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7973c-0d88-4c9d-942d-1f445d8b8976 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.794247 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54068b-02a9-4e0e-8e88-b413b4011f92 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.799066 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d58b4-3b78-4119-a602-94dbcc22f77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.799687 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d58b4-3b78-4119-a602-94dbcc22f77a admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.799982 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d58b4-3b78-4119-a602-94dbcc22f77a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.800295 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d58b4-3b78-4119-a602-94dbcc22f77a admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.800991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d58b4-3b78-4119-a602-94dbcc22f77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.802611 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d58b4-3b78-4119-a602-94dbcc22f77a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.802871 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 800/1593] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:31.803708 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7973c-0d88-4c9d-942d-1f445d8b8976 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:31.815077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 794/1594] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:31.815248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0929e47-a6d5-4c43-895d-9d24eea2e5ab None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.819004 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7973c-0d88-4c9d-942d-1f445d8b8976 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.819118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0929e47-a6d5-4c43-895d-9d24eea2e5ab None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.819118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0929e47-a6d5-4c43-895d-9d24eea2e5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.823422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba90f40-92c6-4d72-a0b6-feadbb656987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.824083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba90f40-92c6-4d72-a0b6-feadbb656987 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.824384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba90f40-92c6-4d72-a0b6-feadbb656987 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.824645 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba90f40-92c6-4d72-a0b6-feadbb656987 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.825342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba90f40-92c6-4d72-a0b6-feadbb656987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.826993 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba90f40-92c6-4d72-a0b6-feadbb656987 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.837775 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 801/1595] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:31.838738 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba90f40-92c6-4d72-a0b6-feadbb656987 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:31.848985 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba90f40-92c6-4d72-a0b6-feadbb656987 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.854144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a475953-4431-4e59-9415-ec82d43acd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.854810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a475953-4431-4e59-9415-ec82d43acd68 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.855091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a475953-4431-4e59-9415-ec82d43acd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.855367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a475953-4431-4e59-9415-ec82d43acd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.856062 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a475953-4431-4e59-9415-ec82d43acd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.856465 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-b0929e47-a6d5-4c43-895d-9d24eea2e5ab None None] MFA Rules not processed for user `d12fc26e640f4337b4a4da60cc4d9adc`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:31.857672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a475953-4431-4e59-9415-ec82d43acd68 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.857929 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b0929e47-a6d5-4c43-895d-9d24eea2e5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:31.868496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 802/1596] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:31.869311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a475953-4431-4e59-9415-ec82d43acd68 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:31.878836 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a475953-4431-4e59-9415-ec82d43acd68 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.884737 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52de44-928d-43ff-a8ab-a775939655c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.885358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52de44-928d-43ff-a8ab-a775939655c6 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.885648 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52de44-928d-43ff-a8ab-a775939655c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.885971 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52de44-928d-43ff-a8ab-a775939655c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.887121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52de44-928d-43ff-a8ab-a775939655c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.889240 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52de44-928d-43ff-a8ab-a775939655c6 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.900118 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 803/1597] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:31.900933 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52de44-928d-43ff-a8ab-a775939655c6 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:31.908407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:31.912454 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52de44-928d-43ff-a8ab-a775939655c6 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.917683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d066a8-724d-4e21-b707-c431ed992bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.918307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d066a8-724d-4e21-b707-c431ed992bfe admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.918632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d066a8-724d-4e21-b707-c431ed992bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.919012 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d066a8-724d-4e21-b707-c431ed992bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.919594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d066a8-724d-4e21-b707-c431ed992bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.921213 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d066a8-724d-4e21-b707-c431ed992bfe admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.933783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 804/1598] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:31.934907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d066a8-724d-4e21-b707-c431ed992bfe admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:31.935452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 795/1599] 10.222.0.86 () {58 vars in 1059 bytes} [Tue Jul 26 14:59:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:31.936266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0929e47-a6d5-4c43-895d-9d24eea2e5ab None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:31.947151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0929e47-a6d5-4c43-895d-9d24eea2e5ab None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.948872 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d066a8-724d-4e21-b707-c431ed992bfe admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.954472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456443c1-c655-43bf-acf8-a3321d097249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.955185 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456443c1-c655-43bf-acf8-a3321d097249 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.955320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2b8b7-1031-498a-a92d-b34780bae8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.955612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456443c1-c655-43bf-acf8-a3321d097249 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.955968 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456443c1-c655-43bf-acf8-a3321d097249 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.956134 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2b8b7-1031-498a-a92d-b34780bae8ff admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.956489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2b8b7-1031-498a-a92d-b34780bae8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.956838 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2b8b7-1031-498a-a92d-b34780bae8ff admin admin] PATH_INFO: `/v3/projects/c571a75696014d6594eb2ef814a99a17/users/6eae8055a6044f64b477cddafcf8600c/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.957629 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456443c1-c655-43bf-acf8-a3321d097249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.958968 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456443c1-c655-43bf-acf8-a3321d097249 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.977097 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 805/1600] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:31.977097 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456443c1-c655-43bf-acf8-a3321d097249 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:31.977338 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2b8b7-1031-498a-a92d-b34780bae8ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c571a75696014d6594eb2ef814a99a17, user_id=6eae8055a6044f64b477cddafcf8600c, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:31.979511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2b8b7-1031-498a-a92d-b34780bae8ff admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:31.988453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456443c1-c655-43bf-acf8-a3321d097249 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:31.993781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55311567-5994-4672-a64b-43c576a22d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:31.994422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55311567-5994-4672-a64b-43c576a22d35 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:31.994756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55311567-5994-4672-a64b-43c576a22d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:31.995440 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55311567-5994-4672-a64b-43c576a22d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:31.996047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55311567-5994-4672-a64b-43c576a22d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:32.000294 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55311567-5994-4672-a64b-43c576a22d35 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:32.011652 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 806/1601] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:32.012539 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55311567-5994-4672-a64b-43c576a22d35 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:32.025254 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55311567-5994-4672-a64b-43c576a22d35 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:32.030305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f046705-561b-41fc-b0fb-1b45fd2d5ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:32.030949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f046705-561b-41fc-b0fb-1b45fd2d5ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:32.034508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f046705-561b-41fc-b0fb-1b45fd2d5ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:32.034508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f046705-561b-41fc-b0fb-1b45fd2d5ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:32.034508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f046705-561b-41fc-b0fb-1b45fd2d5ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:32.034508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f046705-561b-41fc-b0fb-1b45fd2d5ae0 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:32.044204 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 807/1602] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:32.045037 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f046705-561b-41fc-b0fb-1b45fd2d5ae0 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:32.054101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f046705-561b-41fc-b0fb-1b45fd2d5ae0 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:32.060162 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b3f50-9e28-4da1-9bbb-7e1c134c03a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:32.060793 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b3f50-9e28-4da1-9bbb-7e1c134c03a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:32.061073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b3f50-9e28-4da1-9bbb-7e1c134c03a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:32.061349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b3f50-9e28-4da1-9bbb-7e1c134c03a6 admin admin] PATH_INFO: `/v3/projects/9074a12481df4e6eb5a600be17bd4984/users/bda23788bfe8424aa5b24a6f4983d189/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:32.070200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 796/1603] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:31 2022] PUT /identity/v3/projects/c571a75696014d6594eb2ef814a99a17/users/6eae8055a6044f64b477cddafcf8600c/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:32.071748 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2b8b7-1031-498a-a92d-b34780bae8ff admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:32.078077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b3f50-9e28-4da1-9bbb-7e1c134c03a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9074a12481df4e6eb5a600be17bd4984, user_id=bda23788bfe8424aa5b24a6f4983d189, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:32.081158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b3f50-9e28-4da1-9bbb-7e1c134c03a6 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:32.133615 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2b8b7-1031-498a-a92d-b34780bae8ff admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:32.138268 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0d3ee-544f-4f17-a81b-e1819dbb81fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:32.138973 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0d3ee-544f-4f17-a81b-e1819dbb81fe admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:32.139264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0d3ee-544f-4f17-a81b-e1819dbb81fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:32.139546 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0d3ee-544f-4f17-a81b-e1819dbb81fe admin admin] PATH_INFO: `/v3/projects/5ed62334730c42d8a891ce1cab9de7dd/users/518a0492e65544339ddf1fe2d2c51715/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:32.153759 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0d3ee-544f-4f17-a81b-e1819dbb81fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed62334730c42d8a891ce1cab9de7dd, user_id=518a0492e65544339ddf1fe2d2c51715, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:32.156444 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0d3ee-544f-4f17-a81b-e1819dbb81fe admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:32.208778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 808/1604] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:32 2022] PUT /identity/v3/projects/9074a12481df4e6eb5a600be17bd4984/users/bda23788bfe8424aa5b24a6f4983d189/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:32.214218 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b3f50-9e28-4da1-9bbb-7e1c134c03a6 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:32.283829 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b3f50-9e28-4da1-9bbb-7e1c134c03a6 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:32.290685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118afb6-60bf-4f1c-8408-c75b62b02d69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:32.291370 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118afb6-60bf-4f1c-8408-c75b62b02d69 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:32.291695 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118afb6-60bf-4f1c-8408-c75b62b02d69 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:32.292088 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118afb6-60bf-4f1c-8408-c75b62b02d69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:32.306865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 797/1605] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:32 2022] PUT /identity/v3/projects/5ed62334730c42d8a891ce1cab9de7dd/users/518a0492e65544339ddf1fe2d2c51715/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:32.307934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0d3ee-544f-4f17-a81b-e1819dbb81fe admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:32.329410 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:32.353738 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118afb6-60bf-4f1c-8408-c75b62b02d69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:32.355402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118afb6-60bf-4f1c-8408-c75b62b02d69 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:32.365337 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 809/1606] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:32.366183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118afb6-60bf-4f1c-8408-c75b62b02d69 service nova] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:32.382299 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0d3ee-544f-4f17-a81b-e1819dbb81fe admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:32.388500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304638c9-8617-444c-9b9f-852658dedede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:32.389886 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304638c9-8617-444c-9b9f-852658dedede admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:32.389886 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304638c9-8617-444c-9b9f-852658dedede admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:32.389886 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304638c9-8617-444c-9b9f-852658dedede admin admin] PATH_INFO: `/v3/projects/6529b843e40548e4aefe4f4971269158/users/82ef5a99250c458f8a2b26cfb261410f/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:32.405829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304638c9-8617-444c-9b9f-852658dedede admin admin] RBAC: Authorizing `identity:create_grant(project_id=6529b843e40548e4aefe4f4971269158, user_id=82ef5a99250c458f8a2b26cfb261410f, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:32.408720 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304638c9-8617-444c-9b9f-852658dedede admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:32.431068 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118afb6-60bf-4f1c-8408-c75b62b02d69 service nova] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:32.437030 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93640b-4b31-47f1-9ade-8bbad5607fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:32.437756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93640b-4b31-47f1-9ade-8bbad5607fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:32.438044 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93640b-4b31-47f1-9ade-8bbad5607fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:32.438317 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93640b-4b31-47f1-9ade-8bbad5607fe4 admin admin] PATH_INFO: `/v3/projects/209a08d43c1a439989a34711d35492a8/users/5cd44ebc6bf442bca1e68c8b0fa94f00/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:32.454857 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93640b-4b31-47f1-9ade-8bbad5607fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=209a08d43c1a439989a34711d35492a8, user_id=5cd44ebc6bf442bca1e68c8b0fa94f00, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:32.458038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93640b-4b31-47f1-9ade-8bbad5607fe4 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:32.496301 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 798/1607] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:32 2022] PUT /identity/v3/projects/6529b843e40548e4aefe4f4971269158/users/82ef5a99250c458f8a2b26cfb261410f/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:32.497575 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304638c9-8617-444c-9b9f-852658dedede admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:32.520095 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:32.572229 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 810/1608] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:32 2022] PUT /identity/v3/projects/209a08d43c1a439989a34711d35492a8/users/5cd44ebc6bf442bca1e68c8b0fa94f00/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:32.572640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304638c9-8617-444c-9b9f-852658dedede admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:32.573747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e9571-7e0d-4d61-9830-27bc6d19b635 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:32.574034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e9571-7e0d-4d61-9830-27bc6d19b635 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:32.574313 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e9571-7e0d-4d61-9830-27bc6d19b635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:32.613764 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-cb2e9571-7e0d-4d61-9830-27bc6d19b635 None None] MFA Rules not processed for user `6eae8055a6044f64b477cddafcf8600c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:32.615481 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-cb2e9571-7e0d-4d61-9830-27bc6d19b635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:32.643358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ffc31-70f0-461d-b314-48ecc36088e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:32.644053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ffc31-70f0-461d-b314-48ecc36088e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:32.644339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ffc31-70f0-461d-b314-48ecc36088e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:32.644622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ffc31-70f0-461d-b314-48ecc36088e4 admin admin] PATH_INFO: `/v3/projects/7b62c99ae23e4a8fa91a54beb0db5e01/users/f42573f06b784229816d93b804ed644e/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:32.660925 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ffc31-70f0-461d-b314-48ecc36088e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b62c99ae23e4a8fa91a54beb0db5e01, user_id=f42573f06b784229816d93b804ed644e, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:32.664811 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ffc31-70f0-461d-b314-48ecc36088e4 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:32.685245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 811/1609] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:32.686558 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181c5b4-3e8e-4746-a7fa-233ee3d99123 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:32.686855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181c5b4-3e8e-4746-a7fa-233ee3d99123 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:32.687134 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181c5b4-3e8e-4746-a7fa-233ee3d99123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:32.705656 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-a181c5b4-3e8e-4746-a7fa-233ee3d99123 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:32.708965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a181c5b4-3e8e-4746-a7fa-233ee3d99123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:32.715181 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 812/1610] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:32.716384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e273c5-5427-472b-bfce-60c4d3a4ce61 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:32.716674 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e273c5-5427-472b-bfce-60c4d3a4ce61 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:32.716956 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e273c5-5427-472b-bfce-60c4d3a4ce61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:32.746072 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-c1e273c5-5427-472b-bfce-60c4d3a4ce61 None None] MFA Rules not processed for user `518a0492e65544339ddf1fe2d2c51715`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:32.754854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c1e273c5-5427-472b-bfce-60c4d3a4ce61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:32.777184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:32.813074 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 813/1611] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:32.814243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ee66b-e25d-42af-a661-43d0f13c6b89 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:32.814565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ee66b-e25d-42af-a661-43d0f13c6b89 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:32.814851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ee66b-e25d-42af-a661-43d0f13c6b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:32.832954 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-499ee66b-e25d-42af-a661-43d0f13c6b89 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:32.834168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-499ee66b-e25d-42af-a661-43d0f13c6b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:32.842555 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 814/1612] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:32.843832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661822bc-9733-4574-9039-bcab4b6c743b None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:32.844174 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661822bc-9733-4574-9039-bcab4b6c743b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:32.844412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661822bc-9733-4574-9039-bcab4b6c743b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:32.847375 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 799/1613] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:32 2022] PUT /identity/v3/projects/7b62c99ae23e4a8fa91a54beb0db5e01/users/f42573f06b784229816d93b804ed644e/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:32.858345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fadc1f-0b59-46a7-82f3-a3050dff4595 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:32.858345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fadc1f-0b59-46a7-82f3-a3050dff4595 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:32.858345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fadc1f-0b59-46a7-82f3-a3050dff4595 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:32.858345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 800/1614] 10.222.0.86 () {54 vars in 912 bytes} [Tue Jul 26 14:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:59:32.858345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fadc1f-0b59-46a7-82f3-a3050dff4595 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:32.868823 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-661822bc-9733-4574-9039-bcab4b6c743b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:32.870026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-661822bc-9733-4574-9039-bcab4b6c743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:32.929088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fadc1f-0b59-46a7-82f3-a3050dff4595 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:32.932519 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 815/1615] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:32.933544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661822bc-9733-4574-9039-bcab4b6c743b None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:32.936564 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1c0d4-14ee-4f07-9589-cd97dbbdf297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:32.937206 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1c0d4-14ee-4f07-9589-cd97dbbdf297 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:32.937494 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1c0d4-14ee-4f07-9589-cd97dbbdf297 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:32.937823 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1c0d4-14ee-4f07-9589-cd97dbbdf297 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:32.938530 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1c0d4-14ee-4f07-9589-cd97dbbdf297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:32.940556 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1c0d4-14ee-4f07-9589-cd97dbbdf297 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:33.001930 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661822bc-9733-4574-9039-bcab4b6c743b None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:33.008579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c05f37-9635-4192-b7da-d32286aa0df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:33.009659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c05f37-9635-4192-b7da-d32286aa0df4 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:33.010178 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c05f37-9635-4192-b7da-d32286aa0df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:33.010728 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c05f37-9635-4192-b7da-d32286aa0df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:33.027932 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c05f37-9635-4192-b7da-d32286aa0df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:33.030801 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c05f37-9635-4192-b7da-d32286aa0df4 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:33.048882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 816/1616] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:33.050499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c05f37-9635-4192-b7da-d32286aa0df4 service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:33.066769 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 801/1617] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:59:32 2022] POST /identity/v3/projects => generated 371 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:33.067877 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1c0d4-14ee-4f07-9589-cd97dbbdf297 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:33.072675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c05f37-9635-4192-b7da-d32286aa0df4 service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:33.113596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:33.141014 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1c0d4-14ee-4f07-9589-cd97dbbdf297 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:33.145146 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09aa00f-85e9-4cd0-bd33-e62915992fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:33.145766 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aa00f-85e9-4cd0-bd33-e62915992fef service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:33.146072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aa00f-85e9-4cd0-bd33-e62915992fef service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:33.146349 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aa00f-85e9-4cd0-bd33-e62915992fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:33.167022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ead97f-42e2-4e42-9fce-b6d17d7dbaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:33.167658 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ead97f-42e2-4e42-9fce-b6d17d7dbaf3 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:33.167951 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ead97f-42e2-4e42-9fce-b6d17d7dbaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:33.168234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ead97f-42e2-4e42-9fce-b6d17d7dbaf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:33.168963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ead97f-42e2-4e42-9fce-b6d17d7dbaf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:33.171173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ead97f-42e2-4e42-9fce-b6d17d7dbaf3 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:33.182780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:33.222798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09aa00f-85e9-4cd0-bd33-e62915992fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:33.224265 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09aa00f-85e9-4cd0-bd33-e62915992fef service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:33.234755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 802/1618] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:33.236017 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e476a0-3b75-409e-abd6-9587ec02d819 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:33.236326 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e476a0-3b75-409e-abd6-9587ec02d819 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:33.236594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e476a0-3b75-409e-abd6-9587ec02d819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:33.256866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-b5e476a0-3b75-409e-abd6-9587ec02d819 None None] MFA Rules not processed for user `d12fc26e640f4337b4a4da60cc4d9adc`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:33.258872 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b5e476a0-3b75-409e-abd6-9587ec02d819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:33.295507 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 817/1619] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:59:33 2022] POST /identity/v3/projects => generated 365 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:33.296779 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d2ce5-46c8-430a-a133-fdda613d143d None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:33.297069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d2ce5-46c8-430a-a133-fdda613d143d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:33.297370 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d2ce5-46c8-430a-a133-fdda613d143d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:33.326841 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-c04d2ce5-46c8-430a-a133-fdda613d143d None None] MFA Rules not processed for user `f42573f06b784229816d93b804ed644e`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:33.327042 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c04d2ce5-46c8-430a-a133-fdda613d143d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:33.329046 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 803/1620] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jul 26 14:59:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:33.330025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e476a0-3b75-409e-abd6-9587ec02d819 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:33.339562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e476a0-3b75-409e-abd6-9587ec02d819 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:33.396486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d720e-e2d2-413c-ac69-b472698db926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:33.397317 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d720e-e2d2-413c-ac69-b472698db926 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:33.397632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d720e-e2d2-413c-ac69-b472698db926 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:33.397987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d720e-e2d2-413c-ac69-b472698db926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:33.413110 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 818/1621] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:33.413110 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d2ce5-46c8-430a-a133-fdda613d143d None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:33.447422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:33.491729 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d720e-e2d2-413c-ac69-b472698db926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:33.494582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d720e-e2d2-413c-ac69-b472698db926 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:33.499099 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d2ce5-46c8-430a-a133-fdda613d143d None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:33.505405 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103af89b-6c2e-46ec-89f1-63b724357451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:33.506103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103af89b-6c2e-46ec-89f1-63b724357451 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:33.506423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103af89b-6c2e-46ec-89f1-63b724357451 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:33.506811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103af89b-6c2e-46ec-89f1-63b724357451 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:33.507484 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103af89b-6c2e-46ec-89f1-63b724357451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:33.516929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103af89b-6c2e-46ec-89f1-63b724357451 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:33.517045 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 804/1622] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:33.517045 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d720e-e2d2-413c-ac69-b472698db926 service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:33.527850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d720e-e2d2-413c-ac69-b472698db926 service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:33.539141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8681a6-5760-4cfe-9670-17ac8c5a91a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:33.540136 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8681a6-5760-4cfe-9670-17ac8c5a91a0 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:33.540787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8681a6-5760-4cfe-9670-17ac8c5a91a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:33.541070 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8681a6-5760-4cfe-9670-17ac8c5a91a0 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:33.541945 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8681a6-5760-4cfe-9670-17ac8c5a91a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:33.544149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8681a6-5760-4cfe-9670-17ac8c5a91a0 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:33.639361 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 805/1623] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:59:33 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:33.640573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8681a6-5760-4cfe-9670-17ac8c5a91a0 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:33.647812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 819/1624] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:59:33 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:33.649345 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103af89b-6c2e-46ec-89f1-63b724357451 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:33.663905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103af89b-6c2e-46ec-89f1-63b724357451 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:33.671270 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe5fea-99c4-40a9-a780-aea73a6cdbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:33.671919 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe5fea-99c4-40a9-a780-aea73a6cdbc9 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:33.672316 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe5fea-99c4-40a9-a780-aea73a6cdbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:33.672608 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe5fea-99c4-40a9-a780-aea73a6cdbc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:33.673568 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe5fea-99c4-40a9-a780-aea73a6cdbc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:33.675964 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe5fea-99c4-40a9-a780-aea73a6cdbc9 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:33.741445 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8681a6-5760-4cfe-9670-17ac8c5a91a0 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:33.746005 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d309b-9edc-44e8-ae9e-827661a3b38e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:33.747104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d309b-9edc-44e8-ae9e-827661a3b38e service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:33.747104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d309b-9edc-44e8-ae9e-827661a3b38e service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:33.747351 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d309b-9edc-44e8-ae9e-827661a3b38e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:33.820384 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d309b-9edc-44e8-ae9e-827661a3b38e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:33.821942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d309b-9edc-44e8-ae9e-827661a3b38e service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:33.835445 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 806/1625] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:33.836550 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d309b-9edc-44e8-ae9e-827661a3b38e service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:33.848172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d309b-9edc-44e8-ae9e-827661a3b38e service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:33.853673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecbaa9-3199-4578-9693-6265b09a3bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:33.854408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecbaa9-3199-4578-9693-6265b09a3bea admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:33.854777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecbaa9-3199-4578-9693-6265b09a3bea admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:33.855122 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecbaa9-3199-4578-9693-6265b09a3bea admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:33.855891 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecbaa9-3199-4578-9693-6265b09a3bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:33.857504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecbaa9-3199-4578-9693-6265b09a3bea admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:33.869151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 807/1626] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:33.870627 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecbaa9-3199-4578-9693-6265b09a3bea admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:33.901348 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 820/1627] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:59:33 2022] POST /identity/v3/projects => generated 405 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:33.902455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe5fea-99c4-40a9-a780-aea73a6cdbc9 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:33.914532 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecbaa9-3199-4578-9693-6265b09a3bea admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:34.002954 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:34.043359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:34.059697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2300aa-0242-4aad-8f0e-c0608fbc547f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:34.063055 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2300aa-0242-4aad-8f0e-c0608fbc547f admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:34.063055 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2300aa-0242-4aad-8f0e-c0608fbc547f admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:34.063055 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2300aa-0242-4aad-8f0e-c0608fbc547f admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:34.063055 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2300aa-0242-4aad-8f0e-c0608fbc547f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:34.063408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2300aa-0242-4aad-8f0e-c0608fbc547f admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:34.073435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe5fea-99c4-40a9-a780-aea73a6cdbc9 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:34.087143 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f1a57-e043-4c2c-9a49-09ae731fbe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:34.088109 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 808/1628] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:34.089068 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2300aa-0242-4aad-8f0e-c0608fbc547f admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:34.093506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f1a57-e043-4c2c-9a49-09ae731fbe98 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:34.093879 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f1a57-e043-4c2c-9a49-09ae731fbe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:34.094198 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f1a57-e043-4c2c-9a49-09ae731fbe98 admin admin] PATH_INFO: `/v3/projects/38ad60e5378c42209718990ee15cf500/users/90f1d747ae684d69be07c3780550e9e0/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:34.105523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2300aa-0242-4aad-8f0e-c0608fbc547f admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:34.112244 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af539c1f-89d1-4b07-90f9-931ffefbdaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:34.112947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af539c1f-89d1-4b07-90f9-931ffefbdaa1 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:34.113235 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af539c1f-89d1-4b07-90f9-931ffefbdaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:34.113529 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af539c1f-89d1-4b07-90f9-931ffefbdaa1 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:34.114293 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af539c1f-89d1-4b07-90f9-931ffefbdaa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:34.116472 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af539c1f-89d1-4b07-90f9-931ffefbdaa1 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:34.145570 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f1a57-e043-4c2c-9a49-09ae731fbe98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ad60e5378c42209718990ee15cf500, user_id=90f1d747ae684d69be07c3780550e9e0, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:34.148917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f1a57-e043-4c2c-9a49-09ae731fbe98 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:34.263130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 809/1629] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:59:34 2022] POST /identity/v3/users => generated 309 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:34.263962 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af539c1f-89d1-4b07-90f9-931ffefbdaa1 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:34.272297 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 821/1630] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:33 2022] PUT /identity/v3/projects/38ad60e5378c42209718990ee15cf500/users/90f1d747ae684d69be07c3780550e9e0/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:34.273239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f1a57-e043-4c2c-9a49-09ae731fbe98 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:34.288541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af539c1f-89d1-4b07-90f9-931ffefbdaa1 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:34.366996 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f1a57-e043-4c2c-9a49-09ae731fbe98 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:34.374028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d413a3-0d1d-4d23-b53a-28901e4c5b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:34.375262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d413a3-0d1d-4d23-b53a-28901e4c5b74 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:34.375572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d413a3-0d1d-4d23-b53a-28901e4c5b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:34.375881 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d413a3-0d1d-4d23-b53a-28901e4c5b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:34.376540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d413a3-0d1d-4d23-b53a-28901e4c5b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:34.379438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d413a3-0d1d-4d23-b53a-28901e4c5b74 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:34.389641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5d967-9e87-4fd9-9e47-f6cf7c78a1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:34.390738 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5d967-9e87-4fd9-9e47-f6cf7c78a1ba admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:34.391162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5d967-9e87-4fd9-9e47-f6cf7c78a1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:34.391946 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5d967-9e87-4fd9-9e47-f6cf7c78a1ba admin admin] PATH_INFO: `/v3/projects/b2ed095a71ec4d9cb40c6392777a9d89/users/c058ae2168e24114bc858e4b1566c33d/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:34.402634 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 822/1631] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:34.403832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d413a3-0d1d-4d23-b53a-28901e4c5b74 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:34.412686 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5d967-9e87-4fd9-9e47-f6cf7c78a1ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ed095a71ec4d9cb40c6392777a9d89, user_id=c058ae2168e24114bc858e4b1566c33d, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:34.417561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5d967-9e87-4fd9-9e47-f6cf7c78a1ba admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:34.430620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d413a3-0d1d-4d23-b53a-28901e4c5b74 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:34.441894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d3c0c-a97a-4f54-a98c-87468b110cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:34.442653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d3c0c-a97a-4f54-a98c-87468b110cae admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:34.443020 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d3c0c-a97a-4f54-a98c-87468b110cae admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:34.443378 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d3c0c-a97a-4f54-a98c-87468b110cae admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:34.444295 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d3c0c-a97a-4f54-a98c-87468b110cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:34.449649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d3c0c-a97a-4f54-a98c-87468b110cae admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:34.467180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 823/1632] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:34.467180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d3c0c-a97a-4f54-a98c-87468b110cae admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:34.492517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d3c0c-a97a-4f54-a98c-87468b110cae admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:34.505685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef51c9a-c7df-4e4a-92c8-2b86505c2099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:34.506417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef51c9a-c7df-4e4a-92c8-2b86505c2099 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:34.506706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef51c9a-c7df-4e4a-92c8-2b86505c2099 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:34.506986 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef51c9a-c7df-4e4a-92c8-2b86505c2099 admin admin] PATH_INFO: `/v3/projects/b079c4a8ee474d38a7c26b064f43da9b/users/20b24cc2beeb4e76a0d546bc7f7d86c2/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:34.532180 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 810/1633] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:34 2022] PUT /identity/v3/projects/b2ed095a71ec4d9cb40c6392777a9d89/users/c058ae2168e24114bc858e4b1566c33d/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:34.533540 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5d967-9e87-4fd9-9e47-f6cf7c78a1ba admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:34.539300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef51c9a-c7df-4e4a-92c8-2b86505c2099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b079c4a8ee474d38a7c26b064f43da9b, user_id=20b24cc2beeb4e76a0d546bc7f7d86c2, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:34.549537 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef51c9a-c7df-4e4a-92c8-2b86505c2099 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:34.648303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5d967-9e87-4fd9-9e47-f6cf7c78a1ba admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:34.657320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8746a3d-1a18-475c-b421-d1836bdc2659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:34.658092 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8746a3d-1a18-475c-b421-d1836bdc2659 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:34.658698 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8746a3d-1a18-475c-b421-d1836bdc2659 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:34.658698 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8746a3d-1a18-475c-b421-d1836bdc2659 admin admin] PATH_INFO: `/v3/projects/38ad60e5378c42209718990ee15cf500/users/90f1d747ae684d69be07c3780550e9e0/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:34.660953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8746a3d-1a18-475c-b421-d1836bdc2659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ad60e5378c42209718990ee15cf500, user_id=90f1d747ae684d69be07c3780550e9e0, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:34.664443 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8746a3d-1a18-475c-b421-d1836bdc2659 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:34.680713 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 811/1634] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:34 2022] PUT /identity/v3/projects/38ad60e5378c42209718990ee15cf500/users/90f1d747ae684d69be07c3780550e9e0/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:34.681653 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8746a3d-1a18-475c-b421-d1836bdc2659 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:34.736023 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:34.782306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8746a3d-1a18-475c-b421-d1836bdc2659 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:34.787565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 824/1635] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:34 2022] PUT /identity/v3/projects/b079c4a8ee474d38a7c26b064f43da9b/users/20b24cc2beeb4e76a0d546bc7f7d86c2/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:34.787565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ca4f6-17ce-4280-b19b-cdd7eba6c7c3 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:34.787762 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ca4f6-17ce-4280-b19b-cdd7eba6c7c3 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:34.788408 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ca4f6-17ce-4280-b19b-cdd7eba6c7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:34.938661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-7f1ca4f6-17ce-4280-b19b-cdd7eba6c7c3 None None] MFA Rules not processed for user `90f1d747ae684d69be07c3780550e9e0`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:34.938661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-7f1ca4f6-17ce-4280-b19b-cdd7eba6c7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:34.955382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370fc08-6b3e-4e90-912c-0e7ac38c5516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:34.956121 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370fc08-6b3e-4e90-912c-0e7ac38c5516 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:34.956490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370fc08-6b3e-4e90-912c-0e7ac38c5516 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:34.956888 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370fc08-6b3e-4e90-912c-0e7ac38c5516 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:34.957659 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370fc08-6b3e-4e90-912c-0e7ac38c5516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:34.959381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370fc08-6b3e-4e90-912c-0e7ac38c5516 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:34.970657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 812/1636] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:34.971637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370fc08-6b3e-4e90-912c-0e7ac38c5516 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:34.986026 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370fc08-6b3e-4e90-912c-0e7ac38c5516 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:34.992994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b6ea7-9175-42db-b734-0aecdf0e519b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:34.994217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b6ea7-9175-42db-b734-0aecdf0e519b admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:34.994791 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b6ea7-9175-42db-b734-0aecdf0e519b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:34.995286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b6ea7-9175-42db-b734-0aecdf0e519b admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:34.996243 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b6ea7-9175-42db-b734-0aecdf0e519b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:34.997942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b6ea7-9175-42db-b734-0aecdf0e519b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:35.000096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 825/1637] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:35.004496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ca4f6-17ce-4280-b19b-cdd7eba6c7c3 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:35.016241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 813/1638] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:35.017512 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b6ea7-9175-42db-b734-0aecdf0e519b admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:35.043906 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ca4f6-17ce-4280-b19b-cdd7eba6c7c3 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:35.049149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dad031-ac89-4f79-8ec1-5c08933573d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:35.049924 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad031-ac89-4f79-8ec1-5c08933573d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:35.050283 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad031-ac89-4f79-8ec1-5c08933573d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:35.050711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad031-ac89-4f79-8ec1-5c08933573d8 admin admin] PATH_INFO: `/v3/projects/b2ed095a71ec4d9cb40c6392777a9d89/users/c058ae2168e24114bc858e4b1566c33d/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:35.053607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dad031-ac89-4f79-8ec1-5c08933573d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ed095a71ec4d9cb40c6392777a9d89, user_id=c058ae2168e24114bc858e4b1566c33d, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:35.057833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dad031-ac89-4f79-8ec1-5c08933573d8 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:35.087507 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 826/1639] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:35 2022] PUT /identity/v3/projects/b2ed095a71ec4d9cb40c6392777a9d89/users/c058ae2168e24114bc858e4b1566c33d/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:35.088685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dad031-ac89-4f79-8ec1-5c08933573d8 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:35.096782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b6ea7-9175-42db-b734-0aecdf0e519b admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:35.103776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:35.205455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dad031-ac89-4f79-8ec1-5c08933573d8 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:35.215869 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40714e9b-7a18-4a8f-a2e7-cbad39ccb318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:35.217749 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40714e9b-7a18-4a8f-a2e7-cbad39ccb318 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:35.218035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40714e9b-7a18-4a8f-a2e7-cbad39ccb318 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:35.218955 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40714e9b-7a18-4a8f-a2e7-cbad39ccb318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:35.236064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831edc4-b3ec-426a-a399-1a03b8be49b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:35.236873 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831edc4-b3ec-426a-a399-1a03b8be49b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:35.237219 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831edc4-b3ec-426a-a399-1a03b8be49b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:35.237353 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831edc4-b3ec-426a-a399-1a03b8be49b3 admin admin] PATH_INFO: `/v3/projects/b079c4a8ee474d38a7c26b064f43da9b/users/20b24cc2beeb4e76a0d546bc7f7d86c2/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:35.242222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831edc4-b3ec-426a-a399-1a03b8be49b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b079c4a8ee474d38a7c26b064f43da9b, user_id=20b24cc2beeb4e76a0d546bc7f7d86c2, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:35.246341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831edc4-b3ec-426a-a399-1a03b8be49b3 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:35.287218 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 827/1640] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:35 2022] PUT /identity/v3/projects/b079c4a8ee474d38a7c26b064f43da9b/users/20b24cc2beeb4e76a0d546bc7f7d86c2/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:35.316458 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbeece-a553-4be8-904c-bea5c22ca6d0 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:35.316458 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbeece-a553-4be8-904c-bea5c22ca6d0 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:35.316458 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbeece-a553-4be8-904c-bea5c22ca6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:35.316900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40714e9b-7a18-4a8f-a2e7-cbad39ccb318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:35.316900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40714e9b-7a18-4a8f-a2e7-cbad39ccb318 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:35.327709 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 814/1641] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:35.334846 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-1fcbeece-a553-4be8-904c-bea5c22ca6d0 None None] MFA Rules not processed for user `c058ae2168e24114bc858e4b1566c33d`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:35.336793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bbdff-4130-4859-b40e-82ffbf898996 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:35.337093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bbdff-4130-4859-b40e-82ffbf898996 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:35.337432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bbdff-4130-4859-b40e-82ffbf898996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:35.338077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-1fcbeece-a553-4be8-904c-bea5c22ca6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:35.383779 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-456bbdff-4130-4859-b40e-82ffbf898996 None None] MFA Rules not processed for user `20b24cc2beeb4e76a0d546bc7f7d86c2`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:35.388260 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-456bbdff-4130-4859-b40e-82ffbf898996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:35.558791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 828/1642] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:35.939132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbeece-a553-4be8-904c-bea5c22ca6d0 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:35.939796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 815/1643] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:35 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:35.940812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbeece-a553-4be8-904c-bea5c22ca6d0 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:35.940812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d15e8-1bce-4c68-b8ef-46ca9b038333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:35.940812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d15e8-1bce-4c68-b8ef-46ca9b038333 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:35.940812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d15e8-1bce-4c68-b8ef-46ca9b038333 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:35.941633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d15e8-1bce-4c68-b8ef-46ca9b038333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:35.941633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d15e8-1bce-4c68-b8ef-46ca9b038333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:35.941633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d15e8-1bce-4c68-b8ef-46ca9b038333 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:35.941633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 829/1644] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:35.941936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bbdff-4130-4859-b40e-82ffbf898996 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:35.941936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bbdff-4130-4859-b40e-82ffbf898996 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:35.941936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f4d3f-804a-4a17-9fd2-64c752348f80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:35.941936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f4d3f-804a-4a17-9fd2-64c752348f80 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:35.942185 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f4d3f-804a-4a17-9fd2-64c752348f80 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:35.942185 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f4d3f-804a-4a17-9fd2-64c752348f80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:35.942185 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f4d3f-804a-4a17-9fd2-64c752348f80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:35.942185 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f4d3f-804a-4a17-9fd2-64c752348f80 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:35.942448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78552570-43f5-4dae-b77b-8806ac038b03 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:35.942448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78552570-43f5-4dae-b77b-8806ac038b03 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:35.942448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78552570-43f5-4dae-b77b-8806ac038b03 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:35.942448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 830/1645] 10.222.0.86 () {54 vars in 962 bytes} [Tue Jul 26 14:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:59:35.942691 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 816/1646] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:35 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:35.942755 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ef6f4-5c4d-4f44-a73d-5263f0b8d41d None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:35.942755 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ef6f4-5c4d-4f44-a73d-5263f0b8d41d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:35.942755 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ef6f4-5c4d-4f44-a73d-5263f0b8d41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:35.964255 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-672ef6f4-5c4d-4f44-a73d-5263f0b8d41d None None] MFA Rules not processed for user `d12fc26e640f4337b4a4da60cc4d9adc`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:35.965486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-672ef6f4-5c4d-4f44-a73d-5263f0b8d41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:36.048082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f4d3f-804a-4a17-9fd2-64c752348f80 service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:36.081010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f4d3f-804a-4a17-9fd2-64c752348f80 service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:36.092625 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1241266-19e1-414e-a099-db339142ee84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:36.093426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1241266-19e1-414e-a099-db339142ee84 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:36.093756 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1241266-19e1-414e-a099-db339142ee84 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:36.094103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1241266-19e1-414e-a099-db339142ee84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:36.101765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 831/1647] 10.222.0.86 () {58 vars in 1059 bytes} [Tue Jul 26 14:59:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:36.108521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae242145-14b7-4625-9d7d-7e54adb59034 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:36.108845 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae242145-14b7-4625-9d7d-7e54adb59034 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:36.109207 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae242145-14b7-4625-9d7d-7e54adb59034 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:36.111016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 832/1648] 10.222.0.86 () {54 vars in 912 bytes} [Tue Jul 26 14:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:59:36.115807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73455f97-d01f-41f3-9434-4ccfce87897b None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:36.116183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73455f97-d01f-41f3-9434-4ccfce87897b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:36.116534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73455f97-d01f-41f3-9434-4ccfce87897b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:36.142737 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-73455f97-d01f-41f3-9434-4ccfce87897b None None] MFA Rules not processed for user `d12fc26e640f4337b4a4da60cc4d9adc`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:36.144598 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-73455f97-d01f-41f3-9434-4ccfce87897b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:36.165680 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 833/1649] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jul 26 14:59:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:36.170547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1241266-19e1-414e-a099-db339142ee84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:36.173090 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1241266-19e1-414e-a099-db339142ee84 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:36.184977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 817/1650] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:36 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:36.444472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73455f97-d01f-41f3-9434-4ccfce87897b None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:36.459014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73455f97-d01f-41f3-9434-4ccfce87897b None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:36.466805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d576e4b-cd77-43bc-9103-1a66f429a7f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:36.467456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d576e4b-cd77-43bc-9103-1a66f429a7f3 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:36.467739 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d576e4b-cd77-43bc-9103-1a66f429a7f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:36.468014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d576e4b-cd77-43bc-9103-1a66f429a7f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:36.488238 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:36.502308 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d576e4b-cd77-43bc-9103-1a66f429a7f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:36.504123 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d576e4b-cd77-43bc-9103-1a66f429a7f3 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:36.534487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 834/1651] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:36.577554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1241266-19e1-414e-a099-db339142ee84 service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:36.587305 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1241266-19e1-414e-a099-db339142ee84 service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:36.591587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a78de7-848b-47be-8c7f-568973ecd94a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:36.592387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a78de7-848b-47be-8c7f-568973ecd94a service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:36.592670 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a78de7-848b-47be-8c7f-568973ecd94a service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:36.592950 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a78de7-848b-47be-8c7f-568973ecd94a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:36.670127 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a78de7-848b-47be-8c7f-568973ecd94a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:36.671668 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a78de7-848b-47be-8c7f-568973ecd94a service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:36.704687 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 818/1652] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:37.024448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d576e4b-cd77-43bc-9103-1a66f429a7f3 service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:37.181566 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d576e4b-cd77-43bc-9103-1a66f429a7f3 service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:37.187117 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72bda1-23d3-433d-901f-9baf49496ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:37.187929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72bda1-23d3-433d-901f-9baf49496ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:37.188348 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72bda1-23d3-433d-901f-9baf49496ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:37.188872 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72bda1-23d3-433d-901f-9baf49496ee4 admin admin] PATH_INFO: `/v3/users/f42573f06b784229816d93b804ed644e` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:37.191043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72bda1-23d3-433d-901f-9baf49496ee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f42573f06b784229816d93b804ed644e)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:37.193145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72bda1-23d3-433d-901f-9baf49496ee4 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:37.544597 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7c72bda1-23d3-433d-901f-9baf49496ee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f42573f06b784229816d93b804ed644e'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:37.545648 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7c72bda1-23d3-433d-901f-9baf49496ee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f42573f06b784229816d93b804ed644e'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:37.575458 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7c72bda1-23d3-433d-901f-9baf49496ee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f42573f06b784229816d93b804ed644e'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:37.769264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7c72bda1-23d3-433d-901f-9baf49496ee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f42573f06b784229816d93b804ed644e'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:37.770049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7c72bda1-23d3-433d-901f-9baf49496ee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f42573f06b784229816d93b804ed644e'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:37.797230 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 835/1653] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 14:59:37 2022] DELETE /identity/v3/users/f42573f06b784229816d93b804ed644e => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:37.801736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd8f5-24d2-436d-bfbd-1a32a936b216 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:37.802173 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd8f5-24d2-436d-bfbd-1a32a936b216 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:37.802291 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd8f5-24d2-436d-bfbd-1a32a936b216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:37.841285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-d0ddd8f5-24d2-436d-bfbd-1a32a936b216 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:37.852609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d0ddd8f5-24d2-436d-bfbd-1a32a936b216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:38.016265 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:38.027911 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 819/1654] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:38.043655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72bda1-23d3-433d-901f-9baf49496ee4 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:38.044385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-7c72bda1-23d3-433d-901f-9baf49496ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:38.179188 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72bda1-23d3-433d-901f-9baf49496ee4 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:38.190670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0946673-a57f-49a6-a516-93e152d910e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:38.191177 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0946673-a57f-49a6-a516-93e152d910e9 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:38.191464 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0946673-a57f-49a6-a516-93e152d910e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:38.191799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0946673-a57f-49a6-a516-93e152d910e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:38.232081 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0946673-a57f-49a6-a516-93e152d910e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:38.233788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0946673-a57f-49a6-a516-93e152d910e9 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:38.247082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 836/1655] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:38.454716 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:39.863358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddd8f5-24d2-436d-bfbd-1a32a936b216 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:39.866120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d0ddd8f5-24d2-436d-bfbd-1a32a936b216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:39.901427 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddd8f5-24d2-436d-bfbd-1a32a936b216 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:39.910076 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf6dec-210c-4718-a91a-6380f0659968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:39.910803 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf6dec-210c-4718-a91a-6380f0659968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:39.911262 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf6dec-210c-4718-a91a-6380f0659968 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:39.911730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf6dec-210c-4718-a91a-6380f0659968 admin admin] PATH_INFO: `/v3/projects/7b62c99ae23e4a8fa91a54beb0db5e01` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:39.913326 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf6dec-210c-4718-a91a-6380f0659968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b62c99ae23e4a8fa91a54beb0db5e01)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:39.916526 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf6dec-210c-4718-a91a-6380f0659968 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:39.995994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0946673-a57f-49a6-a516-93e152d910e9 service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:39.995994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-b0946673-a57f-49a6-a516-93e152d910e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:40.025148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0946673-a57f-49a6-a516-93e152d910e9 service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:40.043080 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584eb8a9-fe10-43fa-a7e0-4e8197844421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:40.049566 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584eb8a9-fe10-43fa-a7e0-4e8197844421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:40.049869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584eb8a9-fe10-43fa-a7e0-4e8197844421 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:40.053534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584eb8a9-fe10-43fa-a7e0-4e8197844421 admin admin] PATH_INFO: `/v3/users/5c70efef6195448aad1657adda83b85a` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:40.059068 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584eb8a9-fe10-43fa-a7e0-4e8197844421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c70efef6195448aad1657adda83b85a)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:40.064444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584eb8a9-fe10-43fa-a7e0-4e8197844421 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:40.083020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-cfdf6dec-210c-4718-a91a-6380f0659968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b62c99ae23e4a8fa91a54beb0db5e01', 'request_id': 'req-cfdf6dec-210c-4718-a91a-6380f0659968'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:40.101414 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-cfdf6dec-210c-4718-a91a-6380f0659968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b62c99ae23e4a8fa91a54beb0db5e01', 'request_id': 'req-cfdf6dec-210c-4718-a91a-6380f0659968'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:40.262536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-cfdf6dec-210c-4718-a91a-6380f0659968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b62c99ae23e4a8fa91a54beb0db5e01', 'request_id': 'req-cfdf6dec-210c-4718-a91a-6380f0659968'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:40.287514 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-cfdf6dec-210c-4718-a91a-6380f0659968 admin admin] The token cache is being invalidate because project 7b62c99ae23e4a8fa91a54beb0db5e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 14:59:40.294133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-cfdf6dec-210c-4718-a91a-6380f0659968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:40.303909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-cfdf6dec-210c-4718-a91a-6380f0659968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:40.311161 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 820/1656] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 14:59:39 2022] DELETE /identity/v3/projects/7b62c99ae23e4a8fa91a54beb0db5e01 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:40.317588 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf6dec-210c-4718-a91a-6380f0659968 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:40.325772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-cfdf6dec-210c-4718-a91a-6380f0659968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:40.362990 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:40.372602 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-584eb8a9-fe10-43fa-a7e0-4e8197844421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c70efef6195448aad1657adda83b85a'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:40.375055 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-584eb8a9-fe10-43fa-a7e0-4e8197844421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c70efef6195448aad1657adda83b85a'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:40.406690 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-584eb8a9-fe10-43fa-a7e0-4e8197844421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c70efef6195448aad1657adda83b85a'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:40.486247 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf6dec-210c-4718-a91a-6380f0659968 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:40.494957 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d9f2a-ca41-42d5-b285-4984c23409b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:40.495633 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d9f2a-ca41-42d5-b285-4984c23409b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:40.495959 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d9f2a-ca41-42d5-b285-4984c23409b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:40.496239 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d9f2a-ca41-42d5-b285-4984c23409b0 admin admin] PATH_INFO: `/v3/users/20b24cc2beeb4e76a0d546bc7f7d86c2` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:40.498613 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d9f2a-ca41-42d5-b285-4984c23409b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b24cc2beeb4e76a0d546bc7f7d86c2)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:40.499697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: WARNING py.warnings [None req-002d9f2a-ca41-42d5-b285-4984c23409b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:59:40.499697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: warnings.warn(msg) Jul 26 14:59:40.499697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: Jul 26 14:59:40.502465 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d9f2a-ca41-42d5-b285-4984c23409b0 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:40.508770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:40.545419 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-584eb8a9-fe10-43fa-a7e0-4e8197844421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c70efef6195448aad1657adda83b85a'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:40.546149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-584eb8a9-fe10-43fa-a7e0-4e8197844421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c70efef6195448aad1657adda83b85a'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:40.577633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 837/1657] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 14:59:39 2022] DELETE /identity/v3/users/5c70efef6195448aad1657adda83b85a => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:40.583526 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a6365-64a1-4592-991d-d69d03980601 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:40.583815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a6365-64a1-4592-991d-d69d03980601 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:40.584107 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a6365-64a1-4592-991d-d69d03980601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:40.637833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-da7a6365-64a1-4592-991d-d69d03980601 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:40.642719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-da7a6365-64a1-4592-991d-d69d03980601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:40.764975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 838/1658] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:40.775549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a6365-64a1-4592-991d-d69d03980601 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:40.777218 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-da7a6365-64a1-4592-991d-d69d03980601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:40.797394 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-002d9f2a-ca41-42d5-b285-4984c23409b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b24cc2beeb4e76a0d546bc7f7d86c2'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:40.810987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-002d9f2a-ca41-42d5-b285-4984c23409b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b24cc2beeb4e76a0d546bc7f7d86c2'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:40.850986 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-002d9f2a-ca41-42d5-b285-4984c23409b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b24cc2beeb4e76a0d546bc7f7d86c2'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:40.852158 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-002d9f2a-ca41-42d5-b285-4984c23409b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b24cc2beeb4e76a0d546bc7f7d86c2'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:40.864515 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-002d9f2a-ca41-42d5-b285-4984c23409b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b24cc2beeb4e76a0d546bc7f7d86c2'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:40.894179 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a6365-64a1-4592-991d-d69d03980601 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:40.901718 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1c7a9-d6da-4f4c-a8ff-b37c2e5af731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:40.902378 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1c7a9-d6da-4f4c-a8ff-b37c2e5af731 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:40.902817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1c7a9-d6da-4f4c-a8ff-b37c2e5af731 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:40.903110 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1c7a9-d6da-4f4c-a8ff-b37c2e5af731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:40.905318 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-f1a1c7a9-d6da-4f4c-a8ff-b37c2e5af731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:40.927585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1c7a9-d6da-4f4c-a8ff-b37c2e5af731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:40.931854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1c7a9-d6da-4f4c-a8ff-b37c2e5af731 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:40.976600 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 839/1659] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:59:41.025268 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 821/1660] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 14:59:40 2022] DELETE /identity/v3/users/20b24cc2beeb4e76a0d546bc7f7d86c2 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:42.265900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554eccd2-0e6c-4a7a-ba99-42c85172a797 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:42.270936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554eccd2-0e6c-4a7a-ba99-42c85172a797 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:42.270936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554eccd2-0e6c-4a7a-ba99-42c85172a797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:42.352925 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-554eccd2-0e6c-4a7a-ba99-42c85172a797 None None] MFA Rules not processed for user `23f8fb537ff1459b8061b78f689b56fb`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:42.354346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-554eccd2-0e6c-4a7a-ba99-42c85172a797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:42.380921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d9f2a-ca41-42d5-b285-4984c23409b0 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:42.382573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-002d9f2a-ca41-42d5-b285-4984c23409b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:42.499420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 840/1661] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:42.540137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554eccd2-0e6c-4a7a-ba99-42c85172a797 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:42.542308 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-554eccd2-0e6c-4a7a-ba99-42c85172a797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:42.556329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d9f2a-ca41-42d5-b285-4984c23409b0 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:42.585097 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d9ce9-0958-4438-b341-9ae744ed2bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:42.586284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d9ce9-0958-4438-b341-9ae744ed2bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:42.586743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d9ce9-0958-4438-b341-9ae744ed2bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:42.587191 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d9ce9-0958-4438-b341-9ae744ed2bc8 admin admin] PATH_INFO: `/v3/projects/67bdd4504dfe4ea4aa648e41db3e43f4` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:42.588742 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d9ce9-0958-4438-b341-9ae744ed2bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67bdd4504dfe4ea4aa648e41db3e43f4)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:42.590948 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d9ce9-0958-4438-b341-9ae744ed2bc8 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:42.603153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:42.811509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-8a4d9ce9-0958-4438-b341-9ae744ed2bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67bdd4504dfe4ea4aa648e41db3e43f4', 'request_id': 'req-8a4d9ce9-0958-4438-b341-9ae744ed2bc8'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:42.830119 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-8a4d9ce9-0958-4438-b341-9ae744ed2bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67bdd4504dfe4ea4aa648e41db3e43f4', 'request_id': 'req-8a4d9ce9-0958-4438-b341-9ae744ed2bc8'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:42.844307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554eccd2-0e6c-4a7a-ba99-42c85172a797 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:42.894514 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-8a4d9ce9-0958-4438-b341-9ae744ed2bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67bdd4504dfe4ea4aa648e41db3e43f4', 'request_id': 'req-8a4d9ce9-0958-4438-b341-9ae744ed2bc8'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:42.919580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-8a4d9ce9-0958-4438-b341-9ae744ed2bc8 admin admin] The token cache is being invalidate because project 67bdd4504dfe4ea4aa648e41db3e43f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 14:59:42.920430 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-8a4d9ce9-0958-4438-b341-9ae744ed2bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:42.926807 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-8a4d9ce9-0958-4438-b341-9ae744ed2bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:42.928467 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 822/1662] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 14:59:42 2022] DELETE /identity/v3/projects/67bdd4504dfe4ea4aa648e41db3e43f4 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 14:59:42.934216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49898170-dfed-45c0-a136-8119e0e0e833 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:42.934731 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49898170-dfed-45c0-a136-8119e0e0e833 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:42.935324 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49898170-dfed-45c0-a136-8119e0e0e833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:42.987185 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-49898170-dfed-45c0-a136-8119e0e0e833 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:42.989702 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa0b28-ee1d-48cd-a9af-87c4e9adfec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:42.990491 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa0b28-ee1d-48cd-a9af-87c4e9adfec8 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:42.990879 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-49898170-dfed-45c0-a136-8119e0e0e833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:42.993361 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa0b28-ee1d-48cd-a9af-87c4e9adfec8 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:42.993758 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa0b28-ee1d-48cd-a9af-87c4e9adfec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:42.996580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-47fa0b28-ee1d-48cd-a9af-87c4e9adfec8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:43.015576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:43.128274 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 823/1663] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:43.138753 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9581f6-ccf6-4a63-9f42-a89d034296c7 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:43.139323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9581f6-ccf6-4a63-9f42-a89d034296c7 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:43.140109 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9581f6-ccf6-4a63-9f42-a89d034296c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:43.151469 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa0b28-ee1d-48cd-a9af-87c4e9adfec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:43.154786 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa0b28-ee1d-48cd-a9af-87c4e9adfec8 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:43.173010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-bf9581f6-ccf6-4a63-9f42-a89d034296c7 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:43.175096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-bf9581f6-ccf6-4a63-9f42-a89d034296c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:43.186612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 824/1664] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:43.191419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9581f6-ccf6-4a63-9f42-a89d034296c7 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:43.205339 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 841/1665] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:59:43.212109 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9581f6-ccf6-4a63-9f42-a89d034296c7 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:43.213168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5c664-b47a-490a-80f5-17422add8855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:43.214003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5c664-b47a-490a-80f5-17422add8855 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:43.214473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5c664-b47a-490a-80f5-17422add8855 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:43.215093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5c664-b47a-490a-80f5-17422add8855 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:43.215978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5c664-b47a-490a-80f5-17422add8855 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:59:43.220308 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5c664-b47a-490a-80f5-17422add8855 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:43.222033 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5c664-b47a-490a-80f5-17422add8855 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:43.242235 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 825/1666] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 14:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:59:43.243813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa0b28-ee1d-48cd-a9af-87c4e9adfec8 service nova] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:43.258166 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa0b28-ee1d-48cd-a9af-87c4e9adfec8 service nova] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:43.271751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fbc31-f609-452b-81a1-ae7e7924d6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:43.272426 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fbc31-f609-452b-81a1-ae7e7924d6de admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:43.273928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fbc31-f609-452b-81a1-ae7e7924d6de admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:43.274268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fbc31-f609-452b-81a1-ae7e7924d6de admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:43.276373 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41fbc31-f609-452b-81a1-ae7e7924d6de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:43.288805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41fbc31-f609-452b-81a1-ae7e7924d6de admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:43.470502 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 842/1667] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:59:43 2022] POST /identity/v3/projects => generated 371 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:43.475625 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5c664-b47a-490a-80f5-17422add8855 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:43.501307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5c664-b47a-490a-80f5-17422add8855 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:43.628270 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e579ec-b121-4c9a-919d-d0b9f7ef882d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:43.629179 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e579ec-b121-4c9a-919d-d0b9f7ef882d admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:43.629607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e579ec-b121-4c9a-919d-d0b9f7ef882d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:43.630037 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e579ec-b121-4c9a-919d-d0b9f7ef882d admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:43.630957 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e579ec-b121-4c9a-919d-d0b9f7ef882d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:43.633695 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e579ec-b121-4c9a-919d-d0b9f7ef882d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:43.770973 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 826/1668] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:59:43 2022] POST /identity/v3/users => generated 286 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:43.775684 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fbc31-f609-452b-81a1-ae7e7924d6de admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:43.794895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fbc31-f609-452b-81a1-ae7e7924d6de admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:43.802882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc95683-db74-4ba4-81c8-b023f0e8c29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:43.805068 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc95683-db74-4ba4-81c8-b023f0e8c29c admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:43.806276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc95683-db74-4ba4-81c8-b023f0e8c29c admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:43.806689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc95683-db74-4ba4-81c8-b023f0e8c29c admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:43.807411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc95683-db74-4ba4-81c8-b023f0e8c29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:43.809565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc95683-db74-4ba4-81c8-b023f0e8c29c admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:43.822845 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 843/1669] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:43.827280 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e579ec-b121-4c9a-919d-d0b9f7ef882d admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:43.839002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e579ec-b121-4c9a-919d-d0b9f7ef882d admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:43.843990 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e313b-5a6c-4f83-bc73-c70fdc279e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:43.844858 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e313b-5a6c-4f83-bc73-c70fdc279e0c admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:43.845306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e313b-5a6c-4f83-bc73-c70fdc279e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:43.845588 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e313b-5a6c-4f83-bc73-c70fdc279e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:43.846299 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e313b-5a6c-4f83-bc73-c70fdc279e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:43.848075 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e313b-5a6c-4f83-bc73-c70fdc279e0c admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:43.859896 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 827/1670] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:43.865593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc95683-db74-4ba4-81c8-b023f0e8c29c admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:43.879762 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc95683-db74-4ba4-81c8-b023f0e8c29c admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:43.894924 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e313b-5a6c-4f83-bc73-c70fdc279e0c admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:43.895295 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115138a-629b-4a4c-9cc6-a035f25c0419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:43.896158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115138a-629b-4a4c-9cc6-a035f25c0419 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:43.896437 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115138a-629b-4a4c-9cc6-a035f25c0419 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:43.896676 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-5a2e313b-5a6c-4f83-bc73-c70fdc279e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:43.896784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115138a-629b-4a4c-9cc6-a035f25c0419 admin admin] PATH_INFO: `/v3/projects/8b70eb455e634cf690af67769874c3d1/users/0fa95a6f51be4d88ab13b0db85b90950/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:43.927847 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e313b-5a6c-4f83-bc73-c70fdc279e0c admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:43.931667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115138a-629b-4a4c-9cc6-a035f25c0419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b70eb455e634cf690af67769874c3d1, user_id=0fa95a6f51be4d88ab13b0db85b90950, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:43.937300 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220612c-b4a4-41bc-8e2a-31e1da60ca41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:43.938064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220612c-b4a4-41bc-8e2a-31e1da60ca41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:43.938547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220612c-b4a4-41bc-8e2a-31e1da60ca41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:43.938966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220612c-b4a4-41bc-8e2a-31e1da60ca41 admin admin] PATH_INFO: `/v3/projects/b079c4a8ee474d38a7c26b064f43da9b` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:43.939155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115138a-629b-4a4c-9cc6-a035f25c0419 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:43.941134 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220612c-b4a4-41bc-8e2a-31e1da60ca41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b079c4a8ee474d38a7c26b064f43da9b)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:43.943217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220612c-b4a4-41bc-8e2a-31e1da60ca41 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:44.078352 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 844/1671] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:43 2022] PUT /identity/v3/projects/8b70eb455e634cf690af67769874c3d1/users/0fa95a6f51be4d88ab13b0db85b90950/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:44.082358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56517709-58f3-4aa1-ac44-7b2991dbd3aa None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:44.083206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56517709-58f3-4aa1-ac44-7b2991dbd3aa None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:44.086776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56517709-58f3-4aa1-ac44-7b2991dbd3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:44.131071 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-56517709-58f3-4aa1-ac44-7b2991dbd3aa None None] MFA Rules not processed for user `0fa95a6f51be4d88ab13b0db85b90950`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:44.133536 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-56517709-58f3-4aa1-ac44-7b2991dbd3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:44.163520 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7220612c-b4a4-41bc-8e2a-31e1da60ca41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b079c4a8ee474d38a7c26b064f43da9b', 'request_id': 'req-7220612c-b4a4-41bc-8e2a-31e1da60ca41'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:44.183616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7220612c-b4a4-41bc-8e2a-31e1da60ca41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b079c4a8ee474d38a7c26b064f43da9b', 'request_id': 'req-7220612c-b4a4-41bc-8e2a-31e1da60ca41'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:44.278539 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7220612c-b4a4-41bc-8e2a-31e1da60ca41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b079c4a8ee474d38a7c26b064f43da9b', 'request_id': 'req-7220612c-b4a4-41bc-8e2a-31e1da60ca41'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:44.287877 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 845/1672] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:44.289022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56517709-58f3-4aa1-ac44-7b2991dbd3aa None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:44.316407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7220612c-b4a4-41bc-8e2a-31e1da60ca41 admin admin] The token cache is being invalidate because project b079c4a8ee474d38a7c26b064f43da9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 14:59:44.316890 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7220612c-b4a4-41bc-8e2a-31e1da60ca41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:44.318136 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7220612c-b4a4-41bc-8e2a-31e1da60ca41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:44.327997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 828/1673] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 14:59:43 2022] DELETE /identity/v3/projects/b079c4a8ee474d38a7c26b064f43da9b => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 14:59:44.340140 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f752522-b39b-49ea-a0b5-577aec71c39f None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:44.340140 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f752522-b39b-49ea-a0b5-577aec71c39f None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:44.340140 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f752522-b39b-49ea-a0b5-577aec71c39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:44.383423 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-3f752522-b39b-49ea-a0b5-577aec71c39f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:44.386129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-3f752522-b39b-49ea-a0b5-577aec71c39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:44.432822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56517709-58f3-4aa1-ac44-7b2991dbd3aa None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:44.440854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 829/1674] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:44.442407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30a9c1-3ab7-443b-be0c-b5d59b7fc011 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:44.442705 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30a9c1-3ab7-443b-be0c-b5d59b7fc011 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:44.442987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30a9c1-3ab7-443b-be0c-b5d59b7fc011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:44.455120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ca2a3-b6ab-4c21-9c0c-3dc2e3225669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:44.455774 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ca2a3-b6ab-4c21-9c0c-3dc2e3225669 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:44.456070 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ca2a3-b6ab-4c21-9c0c-3dc2e3225669 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:44.461069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ca2a3-b6ab-4c21-9c0c-3dc2e3225669 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:44.461069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ca2a3-b6ab-4c21-9c0c-3dc2e3225669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:44.461069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ca2a3-b6ab-4c21-9c0c-3dc2e3225669 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:44.485263 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-bf30a9c1-3ab7-443b-be0c-b5d59b7fc011 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:44.493079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-bf30a9c1-3ab7-443b-be0c-b5d59b7fc011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:44.526429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 830/1675] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:44.527416 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30a9c1-3ab7-443b-be0c-b5d59b7fc011 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:44.551606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30a9c1-3ab7-443b-be0c-b5d59b7fc011 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:44.556919 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54550179-2b61-4290-af00-5c9d911110b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:44.557830 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54550179-2b61-4290-af00-5c9d911110b5 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:44.558272 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54550179-2b61-4290-af00-5c9d911110b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:44.558729 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54550179-2b61-4290-af00-5c9d911110b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:44.559582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54550179-2b61-4290-af00-5c9d911110b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:59:44.560021 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54550179-2b61-4290-af00-5c9d911110b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:44.561774 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54550179-2b61-4290-af00-5c9d911110b5 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:44.580411 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 831/1676] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 14:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:59:44.581579 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54550179-2b61-4290-af00-5c9d911110b5 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:44.595975 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54550179-2b61-4290-af00-5c9d911110b5 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:44.611744 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa8370-3475-4864-acc8-9355559730cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:44.612275 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa8370-3475-4864-acc8-9355559730cd admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:44.612559 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa8370-3475-4864-acc8-9355559730cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:44.612840 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa8370-3475-4864-acc8-9355559730cd admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:44.613726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa8370-3475-4864-acc8-9355559730cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:44.617994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa8370-3475-4864-acc8-9355559730cd admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:44.636634 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 846/1677] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:59:44 2022] POST /identity/v3/projects => generated 371 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:44.637969 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ca2a3-b6ab-4c21-9c0c-3dc2e3225669 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:44.640584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-062ca2a3-b6ab-4c21-9c0c-3dc2e3225669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:44.731420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 832/1678] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:59:44 2022] POST /identity/v3/projects => generated 405 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:44.732561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa8370-3475-4864-acc8-9355559730cd admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:44.804372 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ca2a3-b6ab-4c21-9c0c-3dc2e3225669 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:44.946722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa8370-3475-4864-acc8-9355559730cd admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:44.946722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd9cc4-d87c-4eb1-b529-1c06132ca850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:44.946722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd9cc4-d87c-4eb1-b529-1c06132ca850 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:44.946722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd9cc4-d87c-4eb1-b529-1c06132ca850 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:44.947480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd9cc4-d87c-4eb1-b529-1c06132ca850 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:44.947480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd9cc4-d87c-4eb1-b529-1c06132ca850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:44.947480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd9cc4-d87c-4eb1-b529-1c06132ca850 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:44.954640 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0bee7-4e8e-4d42-8089-087686be7f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:44.955286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0bee7-4e8e-4d42-8089-087686be7f8b admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:44.955582 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0bee7-4e8e-4d42-8089-087686be7f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:44.955894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0bee7-4e8e-4d42-8089-087686be7f8b admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:44.956740 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0bee7-4e8e-4d42-8089-087686be7f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:44.963438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0bee7-4e8e-4d42-8089-087686be7f8b admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:45.066793 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:45.101074 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 833/1680] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:59:44 2022] POST /identity/v3/users => generated 303 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:45.101243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 847/1680] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:59:44 2022] POST /identity/v3/users => generated 292 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:45.105316 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0bee7-4e8e-4d42-8089-087686be7f8b admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:45.106525 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd9cc4-d87c-4eb1-b529-1c06132ca850 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:45.125343 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0bee7-4e8e-4d42-8089-087686be7f8b admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:45.129895 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd9cc4-d87c-4eb1-b529-1c06132ca850 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:45.139216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1e996-f2f5-4a68-b0ec-d95150cabe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:45.139216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1e996-f2f5-4a68-b0ec-d95150cabe5a admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:45.139216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1e996-f2f5-4a68-b0ec-d95150cabe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:45.139216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1e996-f2f5-4a68-b0ec-d95150cabe5a admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:45.139648 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1e996-f2f5-4a68-b0ec-d95150cabe5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:45.141577 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1e996-f2f5-4a68-b0ec-d95150cabe5a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:45.160076 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 834/1681] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:45.161360 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1e996-f2f5-4a68-b0ec-d95150cabe5a admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:45.167213 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d3626-3aa2-42b8-8b14-e7ae83d4fbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:45.167871 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d3626-3aa2-42b8-8b14-e7ae83d4fbec admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:45.168160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d3626-3aa2-42b8-8b14-e7ae83d4fbec admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:45.168441 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d3626-3aa2-42b8-8b14-e7ae83d4fbec admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:45.169160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d3626-3aa2-42b8-8b14-e7ae83d4fbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:45.173139 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d3626-3aa2-42b8-8b14-e7ae83d4fbec admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:45.179087 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1e996-f2f5-4a68-b0ec-d95150cabe5a admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:45.180388 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132be4d6-64e8-4e57-9ebb-da11af576224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:45.181403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132be4d6-64e8-4e57-9ebb-da11af576224 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:45.181895 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132be4d6-64e8-4e57-9ebb-da11af576224 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:45.182457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132be4d6-64e8-4e57-9ebb-da11af576224 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:45.183386 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132be4d6-64e8-4e57-9ebb-da11af576224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:45.185360 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132be4d6-64e8-4e57-9ebb-da11af576224 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:45.201713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 848/1682] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:45.203730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 835/1683] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:45.205145 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132be4d6-64e8-4e57-9ebb-da11af576224 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:45.210195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d3626-3aa2-42b8-8b14-e7ae83d4fbec admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:45.224396 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132be4d6-64e8-4e57-9ebb-da11af576224 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:45.238619 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d764a17-17bb-4fb4-a46b-46284c56de49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:45.239789 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d3626-3aa2-42b8-8b14-e7ae83d4fbec admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:45.243268 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d764a17-17bb-4fb4-a46b-46284c56de49 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:45.244008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d764a17-17bb-4fb4-a46b-46284c56de49 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:45.244644 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d764a17-17bb-4fb4-a46b-46284c56de49 admin admin] PATH_INFO: `/v3/projects/5603de08d5cc429fa9eaaf2a926f398f/users/13085a50f32f4a3798731fd8aa56f240/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:45.255823 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ab1f4-5109-4169-b150-68d6b5b2371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:45.257099 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ab1f4-5109-4169-b150-68d6b5b2371c admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:45.257679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ab1f4-5109-4169-b150-68d6b5b2371c admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:45.258877 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ab1f4-5109-4169-b150-68d6b5b2371c admin admin] PATH_INFO: `/v3/projects/e2011a6f20c64bfd9e180fa0b2caa607/users/19af0f2865b042d686182f3a49f8ddc2/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:45.291883 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d764a17-17bb-4fb4-a46b-46284c56de49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5603de08d5cc429fa9eaaf2a926f398f, user_id=13085a50f32f4a3798731fd8aa56f240, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:45.299091 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d764a17-17bb-4fb4-a46b-46284c56de49 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:45.300416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ab1f4-5109-4169-b150-68d6b5b2371c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2011a6f20c64bfd9e180fa0b2caa607, user_id=19af0f2865b042d686182f3a49f8ddc2, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:45.303798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ab1f4-5109-4169-b150-68d6b5b2371c admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:45.442992 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 849/1684] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:45 2022] PUT /identity/v3/projects/e2011a6f20c64bfd9e180fa0b2caa607/users/19af0f2865b042d686182f3a49f8ddc2/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:45.453064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb9004-5406-40f0-8cfc-53858a9912af None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:45.453064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb9004-5406-40f0-8cfc-53858a9912af None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:45.453064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb9004-5406-40f0-8cfc-53858a9912af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:45.453871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 836/1685] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:45 2022] PUT /identity/v3/projects/5603de08d5cc429fa9eaaf2a926f398f/users/13085a50f32f4a3798731fd8aa56f240/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:45.455144 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d764a17-17bb-4fb4-a46b-46284c56de49 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:45.491280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-1fcb9004-5406-40f0-8cfc-53858a9912af None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:45.492692 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-1fcb9004-5406-40f0-8cfc-53858a9912af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:45.535274 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d764a17-17bb-4fb4-a46b-46284c56de49 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:45.545920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc881874-946b-449e-96c0-c22b8b13f193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:45.546949 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc881874-946b-449e-96c0-c22b8b13f193 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:45.547361 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc881874-946b-449e-96c0-c22b8b13f193 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:45.547735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc881874-946b-449e-96c0-c22b8b13f193 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:45.548701 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc881874-946b-449e-96c0-c22b8b13f193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:45.552042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc881874-946b-449e-96c0-c22b8b13f193 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:45.564864 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 837/1686] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:45.572184 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc881874-946b-449e-96c0-c22b8b13f193 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:45.592406 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc881874-946b-449e-96c0-c22b8b13f193 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:45.602704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c9b28-fc61-4997-b89f-0a158f0fd6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:45.604316 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c9b28-fc61-4997-b89f-0a158f0fd6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:45.604552 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c9b28-fc61-4997-b89f-0a158f0fd6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:45.605343 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c9b28-fc61-4997-b89f-0a158f0fd6bc admin admin] PATH_INFO: `/v3/projects/5603de08d5cc429fa9eaaf2a926f398f/users/13085a50f32f4a3798731fd8aa56f240/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:45.608013 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c9b28-fc61-4997-b89f-0a158f0fd6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5603de08d5cc429fa9eaaf2a926f398f, user_id=13085a50f32f4a3798731fd8aa56f240, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:45.611703 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c9b28-fc61-4997-b89f-0a158f0fd6bc admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:45.637301 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 838/1687] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:45 2022] PUT /identity/v3/projects/5603de08d5cc429fa9eaaf2a926f398f/users/13085a50f32f4a3798731fd8aa56f240/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:45.639012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e1f99-7dc3-4cee-8d30-5edae3244e94 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:45.639374 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e1f99-7dc3-4cee-8d30-5edae3244e94 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:45.639894 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e1f99-7dc3-4cee-8d30-5edae3244e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:45.664426 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 850/1688] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:59:45.671959 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:45.686629 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb9004-5406-40f0-8cfc-53858a9912af None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:45.694354 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-1fcb9004-5406-40f0-8cfc-53858a9912af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:45.697180 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-4c6e1f99-7dc3-4cee-8d30-5edae3244e94 None None] MFA Rules not processed for user `13085a50f32f4a3798731fd8aa56f240`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:45.699676 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4c6e1f99-7dc3-4cee-8d30-5edae3244e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:45.884782 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb9004-5406-40f0-8cfc-53858a9912af None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:45.895897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 839/1689] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:45 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:45.934035 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:45.993952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e1f99-7dc3-4cee-8d30-5edae3244e94 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:45.996012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4c6e1f99-7dc3-4cee-8d30-5edae3244e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:46.001828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45eda03-19cd-42e1-99a5-d5001cab3114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:46.005087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45eda03-19cd-42e1-99a5-d5001cab3114 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:46.005087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45eda03-19cd-42e1-99a5-d5001cab3114 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:46.005087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45eda03-19cd-42e1-99a5-d5001cab3114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:46.134818 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45eda03-19cd-42e1-99a5-d5001cab3114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:46.139411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45eda03-19cd-42e1-99a5-d5001cab3114 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:46.145816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e1f99-7dc3-4cee-8d30-5edae3244e94 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:46.158718 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 851/1690] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:46.168821 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2feb1-33f4-4395-a82e-3fc6676cf5d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:46.172649 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2feb1-33f4-4395-a82e-3fc6676cf5d7 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:46.173058 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2feb1-33f4-4395-a82e-3fc6676cf5d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:46.174103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2feb1-33f4-4395-a82e-3fc6676cf5d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:46.198978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2feb1-33f4-4395-a82e-3fc6676cf5d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:46.201317 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2feb1-33f4-4395-a82e-3fc6676cf5d7 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:46.219656 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 840/1691] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:59:46.532659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87c8e6-7bd3-4d68-a38f-6fff43f89794 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:46.533123 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87c8e6-7bd3-4d68-a38f-6fff43f89794 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:46.533196 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87c8e6-7bd3-4d68-a38f-6fff43f89794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:46.589982 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-2a87c8e6-7bd3-4d68-a38f-6fff43f89794 None None] MFA Rules not processed for user `bda23788bfe8424aa5b24a6f4983d189`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:46.591270 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2a87c8e6-7bd3-4d68-a38f-6fff43f89794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:46.739609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 852/1692] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:46.740032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95639b7c-31d0-4662-bed9-de0ed6f1db5e None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:46.740475 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95639b7c-31d0-4662-bed9-de0ed6f1db5e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:46.740640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95639b7c-31d0-4662-bed9-de0ed6f1db5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:46.782880 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-95639b7c-31d0-4662-bed9-de0ed6f1db5e None None] MFA Rules not processed for user `bda23788bfe8424aa5b24a6f4983d189`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:46.784545 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-95639b7c-31d0-4662-bed9-de0ed6f1db5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:46.815579 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 841/1693] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:59:46.828087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87c8e6-7bd3-4d68-a38f-6fff43f89794 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:46.830439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2a87c8e6-7bd3-4d68-a38f-6fff43f89794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:47.005312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87c8e6-7bd3-4d68-a38f-6fff43f89794 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:47.026429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef7977-1729-478b-8244-5b81aada5548 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:47.027102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef7977-1729-478b-8244-5b81aada5548 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:47.027393 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef7977-1729-478b-8244-5b81aada5548 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:47.027671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef7977-1729-478b-8244-5b81aada5548 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:47.063230 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef7977-1729-478b-8244-5b81aada5548 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:47.073221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef7977-1729-478b-8244-5b81aada5548 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:47.106229 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 853/1694] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:47.930842 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:48.333721 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95639b7c-31d0-4662-bed9-de0ed6f1db5e None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:48.350096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95639b7c-31d0-4662-bed9-de0ed6f1db5e None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:48.370273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d43ec-c17a-43ad-8169-1acd61541c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:48.377612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d43ec-c17a-43ad-8169-1acd61541c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:48.377612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d43ec-c17a-43ad-8169-1acd61541c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:48.377612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d43ec-c17a-43ad-8169-1acd61541c3e admin admin] PATH_INFO: `/v3/users/0fa95a6f51be4d88ab13b0db85b90950` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:48.377612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d43ec-c17a-43ad-8169-1acd61541c3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fa95a6f51be4d88ab13b0db85b90950)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:48.378270 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d43ec-c17a-43ad-8169-1acd61541c3e admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:48.708345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-b48d43ec-c17a-43ad-8169-1acd61541c3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fa95a6f51be4d88ab13b0db85b90950'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:48.738484 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-b48d43ec-c17a-43ad-8169-1acd61541c3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fa95a6f51be4d88ab13b0db85b90950'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:48.799042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-b48d43ec-c17a-43ad-8169-1acd61541c3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fa95a6f51be4d88ab13b0db85b90950'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:48.801515 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-b48d43ec-c17a-43ad-8169-1acd61541c3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fa95a6f51be4d88ab13b0db85b90950'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:48.803832 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-b48d43ec-c17a-43ad-8169-1acd61541c3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fa95a6f51be4d88ab13b0db85b90950'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:48.940493 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 842/1695] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 14:59:48 2022] DELETE /identity/v3/users/0fa95a6f51be4d88ab13b0db85b90950 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:48.941685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371030-388f-4c69-97e0-219d512c1cf7 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:48.942547 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371030-388f-4c69-97e0-219d512c1cf7 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:48.943019 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371030-388f-4c69-97e0-219d512c1cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:48.964272 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:48.995969 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-70371030-388f-4c69-97e0-219d512c1cf7 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:49.002982 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-70371030-388f-4c69-97e0-219d512c1cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:49.022422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c8cbc-4578-41f8-aaca-c2468557f757 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:49.026790 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c8cbc-4578-41f8-aaca-c2468557f757 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:49.027151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c8cbc-4578-41f8-aaca-c2468557f757 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:49.030413 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 843/1696] 10.222.0.86 () {54 vars in 912 bytes} [Tue Jul 26 14:59:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:59:49.043647 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ebb15-2e94-468c-b3f0-ec1d505dbc9a None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:49.044112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ebb15-2e94-468c-b3f0-ec1d505dbc9a None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:49.044544 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ebb15-2e94-468c-b3f0-ec1d505dbc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:49.163206 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-e36ebb15-2e94-468c-b3f0-ec1d505dbc9a None None] MFA Rules not processed for user `e71086ec00454e26b24337e0876bfe89`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:49.165565 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e36ebb15-2e94-468c-b3f0-ec1d505dbc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:49.236361 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 854/1697] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:59:49.265272 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70371030-388f-4c69-97e0-219d512c1cf7 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:49.268006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-70371030-388f-4c69-97e0-219d512c1cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:49.369884 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 844/1698] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jul 26 14:59:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 26 14:59:49.473109 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70371030-388f-4c69-97e0-219d512c1cf7 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:49.479911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6ba87-004c-4f17-a976-6799ae7a9bb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:49.480577 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6ba87-004c-4f17-a976-6799ae7a9bb1 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:49.481034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6ba87-004c-4f17-a976-6799ae7a9bb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:49.481379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6ba87-004c-4f17-a976-6799ae7a9bb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:49.514730 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6ba87-004c-4f17-a976-6799ae7a9bb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:49.514730 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6ba87-004c-4f17-a976-6799ae7a9bb1 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:49.515133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ebb15-2e94-468c-b3f0-ec1d505dbc9a None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:49.515133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e36ebb15-2e94-468c-b3f0-ec1d505dbc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:49.525274 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ebb15-2e94-468c-b3f0-ec1d505dbc9a None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:49.527629 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 855/1699] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:49.538349 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c773eb-4706-4c6b-816c-aba57b576a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:49.539197 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c773eb-4706-4c6b-816c-aba57b576a98 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:49.539422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c773eb-4706-4c6b-816c-aba57b576a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:49.543863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c773eb-4706-4c6b-816c-aba57b576a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:49.593654 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c773eb-4706-4c6b-816c-aba57b576a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:49.593654 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c773eb-4706-4c6b-816c-aba57b576a98 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:49.612689 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 845/1700] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:50.158528 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22618193-6424-498f-8c41-29416bda8925 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:50.159328 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22618193-6424-498f-8c41-29416bda8925 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:50.159759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22618193-6424-498f-8c41-29416bda8925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:50.233487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-22618193-6424-498f-8c41-29416bda8925 None None] MFA Rules not processed for user `5cd44ebc6bf442bca1e68c8b0fa94f00`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:50.235045 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-22618193-6424-498f-8c41-29416bda8925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:50.244278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:50.372353 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 856/1701] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:50.379006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c773eb-4706-4c6b-816c-aba57b576a98 service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:50.380541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-31c773eb-4706-4c6b-816c-aba57b576a98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:50.515044 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c773eb-4706-4c6b-816c-aba57b576a98 service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:50.522171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369aa76-66ce-4227-af9a-b090646d8164 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:50.522865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369aa76-66ce-4227-af9a-b090646d8164 service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:50.523230 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369aa76-66ce-4227-af9a-b090646d8164 service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:50.523552 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369aa76-66ce-4227-af9a-b090646d8164 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:50.534708 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369aa76-66ce-4227-af9a-b090646d8164 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:50.537232 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369aa76-66ce-4227-af9a-b090646d8164 service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:50.550074 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 846/1702] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:51.058626 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:51.163006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22618193-6424-498f-8c41-29416bda8925 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:51.165105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-22618193-6424-498f-8c41-29416bda8925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:51.209997 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22618193-6424-498f-8c41-29416bda8925 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:51.218097 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc41d4d-ee6a-46f1-9418-35b475b21a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:51.218978 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc41d4d-ee6a-46f1-9418-35b475b21a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:51.219548 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc41d4d-ee6a-46f1-9418-35b475b21a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:51.220043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc41d4d-ee6a-46f1-9418-35b475b21a2a admin admin] PATH_INFO: `/v3/projects/8b70eb455e634cf690af67769874c3d1` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:51.234005 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc41d4d-ee6a-46f1-9418-35b475b21a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b70eb455e634cf690af67769874c3d1)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:51.241175 dv-cinder-850668-2-smb devstack@keystone.service[92029]: WARNING py.warnings [None req-1fc41d4d-ee6a-46f1-9418-35b475b21a2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:59:51.241175 dv-cinder-850668-2-smb devstack@keystone.service[92029]: warnings.warn(msg) Jul 26 14:59:51.241175 dv-cinder-850668-2-smb devstack@keystone.service[92029]: Jul 26 14:59:51.244183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc41d4d-ee6a-46f1-9418-35b475b21a2a admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:51.265557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:51.449323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e7d23-5bfb-4c60-9ce0-83ff0fdac317 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:51.450068 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e7d23-5bfb-4c60-9ce0-83ff0fdac317 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:51.450612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e7d23-5bfb-4c60-9ce0-83ff0fdac317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:51.482231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-1fc41d4d-ee6a-46f1-9418-35b475b21a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b70eb455e634cf690af67769874c3d1', 'request_id': 'req-1fc41d4d-ee6a-46f1-9418-35b475b21a2a'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:51.498454 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-f81e7d23-5bfb-4c60-9ce0-83ff0fdac317 None None] MFA Rules not processed for user `19af0f2865b042d686182f3a49f8ddc2`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:51.500209 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f81e7d23-5bfb-4c60-9ce0-83ff0fdac317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:51.512517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-1fc41d4d-ee6a-46f1-9418-35b475b21a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b70eb455e634cf690af67769874c3d1', 'request_id': 'req-1fc41d4d-ee6a-46f1-9418-35b475b21a2a'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:51.547233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-1fc41d4d-ee6a-46f1-9418-35b475b21a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b70eb455e634cf690af67769874c3d1', 'request_id': 'req-1fc41d4d-ee6a-46f1-9418-35b475b21a2a'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:51.624312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-1fc41d4d-ee6a-46f1-9418-35b475b21a2a admin admin] The token cache is being invalidate because project 8b70eb455e634cf690af67769874c3d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 14:59:51.624719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-1fc41d4d-ee6a-46f1-9418-35b475b21a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:51.628682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-1fc41d4d-ee6a-46f1-9418-35b475b21a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:51.634264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 857/1703] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 14:59:51 2022] DELETE /identity/v3/projects/8b70eb455e634cf690af67769874c3d1 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:51.634264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e6319-5769-43b6-b891-218ad8c8ee9b None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:51.634264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e6319-5769-43b6-b891-218ad8c8ee9b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:51.634264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e6319-5769-43b6-b891-218ad8c8ee9b None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:51.636912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 858/1704] 10.222.0.86 () {54 vars in 961 bytes} [Tue Jul 26 14:59:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:59:51.643001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b692a-1268-4569-a531-d425dc2fb6d3 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:51.645839 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b692a-1268-4569-a531-d425dc2fb6d3 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:51.655872 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b692a-1268-4569-a531-d425dc2fb6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:51.675207 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 847/1705] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:51.675207 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d388ea-6dc8-4acb-8cc7-0833c9f03261 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:51.675207 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d388ea-6dc8-4acb-8cc7-0833c9f03261 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:51.675207 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d388ea-6dc8-4acb-8cc7-0833c9f03261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:51.708773 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-ba6b692a-1268-4569-a531-d425dc2fb6d3 None None] MFA Rules not processed for user `bda23788bfe8424aa5b24a6f4983d189`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:51.711414 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ba6b692a-1268-4569-a531-d425dc2fb6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:51.731355 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-e2d388ea-6dc8-4acb-8cc7-0833c9f03261 None None] MFA Rules not processed for user `23f8fb537ff1459b8061b78f689b56fb`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:51.732747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e2d388ea-6dc8-4acb-8cc7-0833c9f03261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:51.843174 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 859/1706] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:51.845063 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b692a-1268-4569-a531-d425dc2fb6d3 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:51.849009 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ba6b692a-1268-4569-a531-d425dc2fb6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:51.941303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 848/1707] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:51.955207 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99940b1-a7c7-4212-bfe6-313d45938c6d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:51.955558 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99940b1-a7c7-4212-bfe6-313d45938c6d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:51.955847 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99940b1-a7c7-4212-bfe6-313d45938c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:51.997025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-b99940b1-a7c7-4212-bfe6-313d45938c6d None None] MFA Rules not processed for user `0fab620bc5d044479746d8ea17615a74`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:51.999074 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b99940b1-a7c7-4212-bfe6-313d45938c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:52.023621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b692a-1268-4569-a531-d425dc2fb6d3 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:52.034146 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656aacd8-9346-4a3b-a0d3-b8f851981e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:52.034848 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656aacd8-9346-4a3b-a0d3-b8f851981e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:52.035131 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656aacd8-9346-4a3b-a0d3-b8f851981e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:52.035411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656aacd8-9346-4a3b-a0d3-b8f851981e66 admin admin] PATH_INFO: `/v3/users/13085a50f32f4a3798731fd8aa56f240` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:52.039288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656aacd8-9346-4a3b-a0d3-b8f851981e66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13085a50f32f4a3798731fd8aa56f240)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:52.041434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656aacd8-9346-4a3b-a0d3-b8f851981e66 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:52.113765 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 849/1708] 10.222.0.86 () {58 vars in 1058 bytes} [Tue Jul 26 14:59:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:52.114744 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99940b1-a7c7-4212-bfe6-313d45938c6d None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:52.116475 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b99940b1-a7c7-4212-bfe6-313d45938c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:52.135561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99940b1-a7c7-4212-bfe6-313d45938c6d None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:52.140602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757d932-de61-487a-a9c0-8117346db0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:52.141255 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757d932-de61-487a-a9c0-8117346db0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:52.141977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757d932-de61-487a-a9c0-8117346db0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:52.142873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757d932-de61-487a-a9c0-8117346db0f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:52.157405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757d932-de61-487a-a9c0-8117346db0f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:52.159415 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757d932-de61-487a-a9c0-8117346db0f0 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:52.297374 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 850/1709] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:59:52 2022] POST /identity/v3/projects => generated 403 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:52.298894 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757d932-de61-487a-a9c0-8117346db0f0 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:52.327678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:52.352221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-656aacd8-9346-4a3b-a0d3-b8f851981e66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13085a50f32f4a3798731fd8aa56f240'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:52.354466 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-656aacd8-9346-4a3b-a0d3-b8f851981e66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13085a50f32f4a3798731fd8aa56f240'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:52.384182 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-656aacd8-9346-4a3b-a0d3-b8f851981e66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13085a50f32f4a3798731fd8aa56f240'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:52.440503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757d932-de61-487a-a9c0-8117346db0f0 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:52.449867 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f5250-0bcc-427b-b226-0e30d0770121 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fab620bc5d044479746d8ea17615a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:52.450696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f5250-0bcc-427b-b226-0e30d0770121 service placement] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:52.450939 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f5250-0bcc-427b-b226-0e30d0770121 service placement] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:52.451984 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f5250-0bcc-427b-b226-0e30d0770121 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:52.453530 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-1d0f5250-0bcc-427b-b226-0e30d0770121 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:52.470352 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-656aacd8-9346-4a3b-a0d3-b8f851981e66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13085a50f32f4a3798731fd8aa56f240'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:52.471342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-656aacd8-9346-4a3b-a0d3-b8f851981e66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13085a50f32f4a3798731fd8aa56f240'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:52.489199 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f5250-0bcc-427b-b226-0e30d0770121 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:52.490858 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f5250-0bcc-427b-b226-0e30d0770121 service placement] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:52.510610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 851/1710] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:52.534954 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 860/1711] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 14:59:51 2022] DELETE /identity/v3/users/13085a50f32f4a3798731fd8aa56f240 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:52.534954 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656aacd8-9346-4a3b-a0d3-b8f851981e66 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:52.535283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f5250-0bcc-427b-b226-0e30d0770121 service placement] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:52.535523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-656aacd8-9346-4a3b-a0d3-b8f851981e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:52.535681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-1d0f5250-0bcc-427b-b226-0e30d0770121 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:52.739356 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f5250-0bcc-427b-b226-0e30d0770121 service placement] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:52.753493 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656aacd8-9346-4a3b-a0d3-b8f851981e66 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:52.763961 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372a01a-89c6-4645-82aa-87af6bbb4d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:52.764656 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372a01a-89c6-4645-82aa-87af6bbb4d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:52.767093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372a01a-89c6-4645-82aa-87af6bbb4d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:52.768760 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372a01a-89c6-4645-82aa-87af6bbb4d0d admin admin] PATH_INFO: `/v3/users/518a0492e65544339ddf1fe2d2c51715` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:52.771290 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372a01a-89c6-4645-82aa-87af6bbb4d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=518a0492e65544339ddf1fe2d2c51715)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:52.776250 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372a01a-89c6-4645-82aa-87af6bbb4d0d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:52.785483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81542c3-8089-4b8e-b32e-689369121f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:52.786296 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81542c3-8089-4b8e-b32e-689369121f75 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:52.786829 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81542c3-8089-4b8e-b32e-689369121f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:52.787214 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81542c3-8089-4b8e-b32e-689369121f75 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:52.788012 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81542c3-8089-4b8e-b32e-689369121f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:52.793473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81542c3-8089-4b8e-b32e-689369121f75 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:52.917572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 861/1712] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:59:52 2022] POST /identity/v3/users => generated 308 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:52.923919 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81542c3-8089-4b8e-b32e-689369121f75 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:52.953669 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81542c3-8089-4b8e-b32e-689369121f75 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:52.976670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224596ed-caed-4cdb-ab45-c59c135df459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:52.977642 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224596ed-caed-4cdb-ab45-c59c135df459 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:52.978486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224596ed-caed-4cdb-ab45-c59c135df459 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:52.980918 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224596ed-caed-4cdb-ab45-c59c135df459 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:52.981690 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224596ed-caed-4cdb-ab45-c59c135df459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:52.983364 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224596ed-caed-4cdb-ab45-c59c135df459 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:53.030532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 862/1713] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:53.030532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750deee-76bc-4d5e-9d43-07a47edc5352 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:53.030532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750deee-76bc-4d5e-9d43-07a47edc5352 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:53.030532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750deee-76bc-4d5e-9d43-07a47edc5352 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:53.030532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 863/1714] 10.222.0.86 () {54 vars in 912 bytes} [Tue Jul 26 14:59:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:59:53.033396 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a0ab-caf9-4eb9-9922-ca4741083871 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:53.033691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a0ab-caf9-4eb9-9922-ca4741083871 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:53.033977 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a0ab-caf9-4eb9-9922-ca4741083871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:53.056231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-00a4a0ab-caf9-4eb9-9922-ca4741083871 None None] MFA Rules not processed for user `e71086ec00454e26b24337e0876bfe89`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:53.057873 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-00a4a0ab-caf9-4eb9-9922-ca4741083871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:53.105062 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2372a01a-89c6-4645-82aa-87af6bbb4d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '518a0492e65544339ddf1fe2d2c51715'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:53.119948 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2372a01a-89c6-4645-82aa-87af6bbb4d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '518a0492e65544339ddf1fe2d2c51715'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:53.153610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2372a01a-89c6-4645-82aa-87af6bbb4d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '518a0492e65544339ddf1fe2d2c51715'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:53.155644 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2372a01a-89c6-4645-82aa-87af6bbb4d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '518a0492e65544339ddf1fe2d2c51715'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:53.158141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2372a01a-89c6-4645-82aa-87af6bbb4d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '518a0492e65544339ddf1fe2d2c51715'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:53.173914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 864/1715] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jul 26 14:59:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:53.174856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4a0ab-caf9-4eb9-9922-ca4741083871 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:53.177496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-00a4a0ab-caf9-4eb9-9922-ca4741083871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:53.197041 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4a0ab-caf9-4eb9-9922-ca4741083871 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:53.203011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5962a-1738-4349-a4c9-347d04eedc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:53.204600 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5962a-1738-4349-a4c9-347d04eedc70 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:53.204600 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5962a-1738-4349-a4c9-347d04eedc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:53.204600 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5962a-1738-4349-a4c9-347d04eedc70 admin admin] PATH_INFO: `/v3/projects/71ae70a3bd5d40af946a04b3a2fdf558/users/20b6346bf37a4190b5ce55766fd5f065/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:53.225594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5962a-1738-4349-a4c9-347d04eedc70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ae70a3bd5d40af946a04b3a2fdf558, user_id=20b6346bf37a4190b5ce55766fd5f065, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:53.229140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5962a-1738-4349-a4c9-347d04eedc70 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:53.290558 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 852/1716] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 14:59:52 2022] DELETE /identity/v3/users/518a0492e65544339ddf1fe2d2c51715 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:53.291776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372a01a-89c6-4645-82aa-87af6bbb4d0d admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:53.293878 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2372a01a-89c6-4645-82aa-87af6bbb4d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:53.333838 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 865/1717] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:53 2022] PUT /identity/v3/projects/71ae70a3bd5d40af946a04b3a2fdf558/users/20b6346bf37a4190b5ce55766fd5f065/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:53.334511 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fa547-151b-45ca-9833-dd20d18d2bc6 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:53.334728 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fa547-151b-45ca-9833-dd20d18d2bc6 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:53.335004 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fa547-151b-45ca-9833-dd20d18d2bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:53.405094 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-d04fa547-151b-45ca-9833-dd20d18d2bc6 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:53.409096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d04fa547-151b-45ca-9833-dd20d18d2bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:53.497551 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372a01a-89c6-4645-82aa-87af6bbb4d0d admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:53.573231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 866/1718] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:53.573231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fa547-151b-45ca-9833-dd20d18d2bc6 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:53.584643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fa547-151b-45ca-9833-dd20d18d2bc6 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:53.596267 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f762856-d7b1-4ac8-8ebe-22c68c181f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:53.596555 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f762856-d7b1-4ac8-8ebe-22c68c181f69 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:53.596955 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f762856-d7b1-4ac8-8ebe-22c68c181f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:53.597081 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f762856-d7b1-4ac8-8ebe-22c68c181f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:53.597880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f762856-d7b1-4ac8-8ebe-22c68c181f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:53.600480 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f762856-d7b1-4ac8-8ebe-22c68c181f69 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:53.620796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 867/1719] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:53.621891 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f762856-d7b1-4ac8-8ebe-22c68c181f69 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:53.628755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d696314-7ea2-46f1-91fc-767d15d2cfd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:53.629430 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d696314-7ea2-46f1-91fc-767d15d2cfd9 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:53.629705 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d696314-7ea2-46f1-91fc-767d15d2cfd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:53.629983 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d696314-7ea2-46f1-91fc-767d15d2cfd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:53.643737 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d696314-7ea2-46f1-91fc-767d15d2cfd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:53.645201 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d696314-7ea2-46f1-91fc-767d15d2cfd9 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:53.659145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f762856-d7b1-4ac8-8ebe-22c68c181f69 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:53.664160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 853/1720] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:53.683216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d696314-7ea2-46f1-91fc-767d15d2cfd9 service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:53.693745 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d1f3c-0344-4ba6-8061-337ec643a9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:53.703618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d1f3c-0344-4ba6-8061-337ec643a9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:53.708008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d1f3c-0344-4ba6-8061-337ec643a9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:53.708008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d1f3c-0344-4ba6-8061-337ec643a9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:53.720505 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d696314-7ea2-46f1-91fc-767d15d2cfd9 service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:53.731731 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472723b1-47e3-411b-b9a1-d77948ee5558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:53.736741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472723b1-47e3-411b-b9a1-d77948ee5558 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:53.736741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472723b1-47e3-411b-b9a1-d77948ee5558 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:53.736741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472723b1-47e3-411b-b9a1-d77948ee5558 admin admin] PATH_INFO: `/v3/projects/71ae70a3bd5d40af946a04b3a2fdf558/users/20b6346bf37a4190b5ce55766fd5f065/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:53.736741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472723b1-47e3-411b-b9a1-d77948ee5558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ae70a3bd5d40af946a04b3a2fdf558, user_id=20b6346bf37a4190b5ce55766fd5f065, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:53.738928 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472723b1-47e3-411b-b9a1-d77948ee5558 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:53.762047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d1f3c-0344-4ba6-8061-337ec643a9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:53.763342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d1f3c-0344-4ba6-8061-337ec643a9a0 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:53.777240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 854/1721] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:53 2022] PUT /identity/v3/projects/71ae70a3bd5d40af946a04b3a2fdf558/users/20b6346bf37a4190b5ce55766fd5f065/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:53.787228 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 868/1722] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:53.985264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:54.586651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472723b1-47e3-411b-b9a1-d77948ee5558 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:54.589127 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-472723b1-47e3-411b-b9a1-d77948ee5558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:54.763951 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472723b1-47e3-411b-b9a1-d77948ee5558 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:54.794740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193d808-e5fa-43ce-986a-c0aecf119a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:54.801774 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193d808-e5fa-43ce-986a-c0aecf119a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:54.802706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193d808-e5fa-43ce-986a-c0aecf119a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:54.803007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193d808-e5fa-43ce-986a-c0aecf119a12 admin admin] PATH_INFO: `/v3/projects/5603de08d5cc429fa9eaaf2a926f398f` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:54.811442 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193d808-e5fa-43ce-986a-c0aecf119a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5603de08d5cc429fa9eaaf2a926f398f)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:54.818029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193d808-e5fa-43ce-986a-c0aecf119a12 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:54.998587 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:55.057317 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f193d808-e5fa-43ce-986a-c0aecf119a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5603de08d5cc429fa9eaaf2a926f398f', 'request_id': 'req-f193d808-e5fa-43ce-986a-c0aecf119a12'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:55.068718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f193d808-e5fa-43ce-986a-c0aecf119a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5603de08d5cc429fa9eaaf2a926f398f', 'request_id': 'req-f193d808-e5fa-43ce-986a-c0aecf119a12'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:55.120332 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d1f3c-0344-4ba6-8061-337ec643a9a0 service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:55.123561 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-cb4d1f3c-0344-4ba6-8061-337ec643a9a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:55.149829 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d1f3c-0344-4ba6-8061-337ec643a9a0 service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:55.217090 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f193d808-e5fa-43ce-986a-c0aecf119a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5603de08d5cc429fa9eaaf2a926f398f', 'request_id': 'req-f193d808-e5fa-43ce-986a-c0aecf119a12'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:55.280497 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f193d808-e5fa-43ce-986a-c0aecf119a12 admin admin] The token cache is being invalidate because project 5603de08d5cc429fa9eaaf2a926f398f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 14:59:55.281247 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4606a-204d-4216-ad3b-75e201e1ffb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:55.281940 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4606a-204d-4216-ad3b-75e201e1ffb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:55.282234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4606a-204d-4216-ad3b-75e201e1ffb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:55.282551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4606a-204d-4216-ad3b-75e201e1ffb6 admin admin] PATH_INFO: `/v3/projects/5ed62334730c42d8a891ce1cab9de7dd` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:55.291568 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4606a-204d-4216-ad3b-75e201e1ffb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed62334730c42d8a891ce1cab9de7dd)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:55.291824 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f193d808-e5fa-43ce-986a-c0aecf119a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:55.291913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4606a-204d-4216-ad3b-75e201e1ffb6 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:55.292083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f193d808-e5fa-43ce-986a-c0aecf119a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:55.299091 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 855/1723] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 14:59:54 2022] DELETE /identity/v3/projects/5603de08d5cc429fa9eaaf2a926f398f => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:55.301537 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5ff6d-7141-470d-a265-a9c0af6e962c None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:55.301832 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5ff6d-7141-470d-a265-a9c0af6e962c None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:55.302131 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5ff6d-7141-470d-a265-a9c0af6e962c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:55.390320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-d1e5ff6d-7141-470d-a265-a9c0af6e962c None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:55.392006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d1e5ff6d-7141-470d-a265-a9c0af6e962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:55.418138 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 856/1724] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:55.418138 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bf553-4bb5-4667-a1bb-64457e274996 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:55.418138 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bf553-4bb5-4667-a1bb-64457e274996 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:55.418138 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bf553-4bb5-4667-a1bb-64457e274996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:55.464656 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-c18bf553-4bb5-4667-a1bb-64457e274996 None None] MFA Rules not processed for user `82ef5a99250c458f8a2b26cfb261410f`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:55.467665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-c18bf553-4bb5-4667-a1bb-64457e274996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:55.555679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-0dd4606a-204d-4216-ad3b-75e201e1ffb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed62334730c42d8a891ce1cab9de7dd', 'request_id': 'req-0dd4606a-204d-4216-ad3b-75e201e1ffb6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:55.572988 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-0dd4606a-204d-4216-ad3b-75e201e1ffb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed62334730c42d8a891ce1cab9de7dd', 'request_id': 'req-0dd4606a-204d-4216-ad3b-75e201e1ffb6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:55.582880 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 857/1725] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:55.588053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-0dd4606a-204d-4216-ad3b-75e201e1ffb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed62334730c42d8a891ce1cab9de7dd', 'request_id': 'req-0dd4606a-204d-4216-ad3b-75e201e1ffb6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:55.590091 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff372f2-5ea2-4574-8572-ac331ff44e30 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:55.590933 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff372f2-5ea2-4574-8572-ac331ff44e30 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:55.591338 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff372f2-5ea2-4574-8572-ac331ff44e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:55.617757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-eff372f2-5ea2-4574-8572-ac331ff44e30 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:55.619323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-eff372f2-5ea2-4574-8572-ac331ff44e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:55.692205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 858/1726] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:55.694013 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c951fbd-83ae-482e-9497-9254f91e2b1f None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:55.694672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c951fbd-83ae-482e-9497-9254f91e2b1f None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:55.695762 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c951fbd-83ae-482e-9497-9254f91e2b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:55.719880 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-0c951fbd-83ae-482e-9497-9254f91e2b1f None None] MFA Rules not processed for user `82ef5a99250c458f8a2b26cfb261410f`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:55.721919 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-0c951fbd-83ae-482e-9497-9254f91e2b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:55.760393 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-0dd4606a-204d-4216-ad3b-75e201e1ffb6 admin admin] The token cache is being invalidate because project 5ed62334730c42d8a891ce1cab9de7dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 14:59:55.760393 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-0dd4606a-204d-4216-ad3b-75e201e1ffb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:55.760393 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-0dd4606a-204d-4216-ad3b-75e201e1ffb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:55.761577 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 869/1727] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 14:59:55 2022] DELETE /identity/v3/projects/5ed62334730c42d8a891ce1cab9de7dd => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:55.762710 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4606a-204d-4216-ad3b-75e201e1ffb6 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:55.766824 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0dd4606a-204d-4216-ad3b-75e201e1ffb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:55.799798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4606a-204d-4216-ad3b-75e201e1ffb6 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:55.811892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab754646-9f83-448b-aab0-1ee8009b226c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:55.812846 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab754646-9f83-448b-aab0-1ee8009b226c admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:55.813323 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab754646-9f83-448b-aab0-1ee8009b226c admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:55.813809 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab754646-9f83-448b-aab0-1ee8009b226c admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:55.817083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab754646-9f83-448b-aab0-1ee8009b226c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:59:55.817755 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab754646-9f83-448b-aab0-1ee8009b226c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:55.821999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab754646-9f83-448b-aab0-1ee8009b226c admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:55.838028 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 859/1728] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:55.839204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c951fbd-83ae-482e-9497-9254f91e2b1f None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:55.840881 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 870/1729] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 14:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:59:55.848598 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-0c951fbd-83ae-482e-9497-9254f91e2b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:55.857429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab754646-9f83-448b-aab0-1ee8009b226c admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:55.862957 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c951fbd-83ae-482e-9497-9254f91e2b1f None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:55.868430 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ab754646-9f83-448b-aab0-1ee8009b226c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:55.869804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cc09e-e4fc-4cd5-a8cf-c8e8454b429a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:55.871838 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cc09e-e4fc-4cd5-a8cf-c8e8454b429a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:55.872273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cc09e-e4fc-4cd5-a8cf-c8e8454b429a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:55.872843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cc09e-e4fc-4cd5-a8cf-c8e8454b429a admin admin] PATH_INFO: `/v3/users/90f1d747ae684d69be07c3780550e9e0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:55.874375 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cc09e-e4fc-4cd5-a8cf-c8e8454b429a admin admin] RBAC: Authorizing `identity:delete_user(user_id=90f1d747ae684d69be07c3780550e9e0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:55.877487 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cc09e-e4fc-4cd5-a8cf-c8e8454b429a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:55.982290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab754646-9f83-448b-aab0-1ee8009b226c admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:55.988889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f9f26-c559-488e-a41d-6048cb75ef69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:55.989854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f9f26-c559-488e-a41d-6048cb75ef69 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:55.990118 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f9f26-c559-488e-a41d-6048cb75ef69 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:55.990529 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f9f26-c559-488e-a41d-6048cb75ef69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:55.993046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-f57f9f26-c559-488e-a41d-6048cb75ef69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:56.019162 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f9f26-c559-488e-a41d-6048cb75ef69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:56.024984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f9f26-c559-488e-a41d-6048cb75ef69 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:56.045109 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 871/1730] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:59:56.046777 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f9f26-c559-488e-a41d-6048cb75ef69 service nova] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:56.095348 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f9f26-c559-488e-a41d-6048cb75ef69 service nova] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:56.119746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd51acb-539b-45a5-b00a-f5c6f2725a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:56.120541 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd51acb-539b-45a5-b00a-f5c6f2725a31 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:56.128766 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd51acb-539b-45a5-b00a-f5c6f2725a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:56.133831 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd51acb-539b-45a5-b00a-f5c6f2725a31 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:56.135536 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd51acb-539b-45a5-b00a-f5c6f2725a31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:56.139095 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd51acb-539b-45a5-b00a-f5c6f2725a31 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:56.313467 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7e4cc09e-e4fc-4cd5-a8cf-c8e8454b429a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90f1d747ae684d69be07c3780550e9e0'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:56.339361 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7e4cc09e-e4fc-4cd5-a8cf-c8e8454b429a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90f1d747ae684d69be07c3780550e9e0'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:56.357830 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7e4cc09e-e4fc-4cd5-a8cf-c8e8454b429a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90f1d747ae684d69be07c3780550e9e0'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:56.358717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7e4cc09e-e4fc-4cd5-a8cf-c8e8454b429a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90f1d747ae684d69be07c3780550e9e0'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:56.359350 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7e4cc09e-e4fc-4cd5-a8cf-c8e8454b429a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90f1d747ae684d69be07c3780550e9e0'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:56.402410 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 872/1731] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:59:56 2022] POST /identity/v3/projects => generated 355 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:56.405883 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd51acb-539b-45a5-b00a-f5c6f2725a31 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:56.413011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-acd51acb-539b-45a5-b00a-f5c6f2725a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:56.500174 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 860/1732] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 14:59:55 2022] DELETE /identity/v3/users/90f1d747ae684d69be07c3780550e9e0 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:56.589790 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd51acb-539b-45a5-b00a-f5c6f2725a31 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:56.710353 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f786a-bbe5-460c-b229-2fe2c50b27e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:56.711818 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f786a-bbe5-460c-b229-2fe2c50b27e4 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:56.712107 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f786a-bbe5-460c-b229-2fe2c50b27e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:56.712382 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f786a-bbe5-460c-b229-2fe2c50b27e4 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:56.713619 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f786a-bbe5-460c-b229-2fe2c50b27e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:56.716092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f786a-bbe5-460c-b229-2fe2c50b27e4 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:56.925390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 873/1733] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:59:56 2022] POST /identity/v3/users => generated 278 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:56.926099 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cc09e-e4fc-4cd5-a8cf-c8e8454b429a admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:56.934446 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cc09e-e4fc-4cd5-a8cf-c8e8454b429a admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:56.948594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021c69f-fc8c-479e-bbf9-8fbd269e080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:56.949263 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021c69f-fc8c-479e-bbf9-8fbd269e080e admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:56.949553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021c69f-fc8c-479e-bbf9-8fbd269e080e admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:56.949833 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021c69f-fc8c-479e-bbf9-8fbd269e080e admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:56.950584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021c69f-fc8c-479e-bbf9-8fbd269e080e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:56.952235 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021c69f-fc8c-479e-bbf9-8fbd269e080e admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:56.975284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 861/1734] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:56.976746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f786a-bbe5-460c-b229-2fe2c50b27e4 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:56.991987 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f786a-bbe5-460c-b229-2fe2c50b27e4 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:56.998797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c368f3b-f587-41ec-8318-055f215b2809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:57.000361 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c368f3b-f587-41ec-8318-055f215b2809 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:57.000914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c368f3b-f587-41ec-8318-055f215b2809 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:57.001346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c368f3b-f587-41ec-8318-055f215b2809 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:57.002726 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c368f3b-f587-41ec-8318-055f215b2809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:57.004597 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c368f3b-f587-41ec-8318-055f215b2809 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:57.019814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 874/1735] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:57.025385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021c69f-fc8c-479e-bbf9-8fbd269e080e admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:57.047687 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021c69f-fc8c-479e-bbf9-8fbd269e080e admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:57.055915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca69b2c-4a22-4471-ae05-1a5c48a11875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:57.057038 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca69b2c-4a22-4471-ae05-1a5c48a11875 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:57.057504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca69b2c-4a22-4471-ae05-1a5c48a11875 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:57.057959 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca69b2c-4a22-4471-ae05-1a5c48a11875 admin admin] PATH_INFO: `/v3/projects/989991b8dfef41638e4bf68ac0562acd/users/ad70c928faef4739af784d73b432ab55/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:57.091337 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca69b2c-4a22-4471-ae05-1a5c48a11875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=989991b8dfef41638e4bf68ac0562acd, user_id=ad70c928faef4739af784d73b432ab55, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:57.094789 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca69b2c-4a22-4471-ae05-1a5c48a11875 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:57.204724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 862/1736] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:57 2022] PUT /identity/v3/projects/989991b8dfef41638e4bf68ac0562acd/users/ad70c928faef4739af784d73b432ab55/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 14:59:57.216724 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a34b69-adbf-4e04-9752-8476a91ceafd None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:57.217225 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a34b69-adbf-4e04-9752-8476a91ceafd None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:57.217655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a34b69-adbf-4e04-9752-8476a91ceafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:57.283454 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-d2a34b69-adbf-4e04-9752-8476a91ceafd None None] MFA Rules not processed for user `ad70c928faef4739af784d73b432ab55`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:57.285719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d2a34b69-adbf-4e04-9752-8476a91ceafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:57.394712 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:57.456369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 875/1737] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:57 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:59:57.462836 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca69b2c-4a22-4471-ae05-1a5c48a11875 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:57.667555 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca69b2c-4a22-4471-ae05-1a5c48a11875 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:57.696773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eee949-404a-4063-8686-35503fb82e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:57.698297 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eee949-404a-4063-8686-35503fb82e26 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:57.704895 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eee949-404a-4063-8686-35503fb82e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:57.706599 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eee949-404a-4063-8686-35503fb82e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:57.707793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eee949-404a-4063-8686-35503fb82e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:57.712020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eee949-404a-4063-8686-35503fb82e26 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:57.982097 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 863/1738] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:59:57 2022] POST /identity/v3/projects => generated 357 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:57.992924 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a34b69-adbf-4e04-9752-8476a91ceafd None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:58.015697 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a34b69-adbf-4e04-9752-8476a91ceafd None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:58.106750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18835a45-7ddd-4623-bb61-7712c9dce283 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:58.114733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18835a45-7ddd-4623-bb61-7712c9dce283 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:58.114733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18835a45-7ddd-4623-bb61-7712c9dce283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:58.178042 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd7e7e-41b1-4427-b84f-a1dbda6f35bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:58.179214 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd7e7e-41b1-4427-b84f-a1dbda6f35bb admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:58.179214 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd7e7e-41b1-4427-b84f-a1dbda6f35bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:58.179214 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd7e7e-41b1-4427-b84f-a1dbda6f35bb admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:58.181806 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd7e7e-41b1-4427-b84f-a1dbda6f35bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:58.183797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd7e7e-41b1-4427-b84f-a1dbda6f35bb admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:58.190687 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-18835a45-7ddd-4623-bb61-7712c9dce283 None None] MFA Rules not processed for user `20b6346bf37a4190b5ce55766fd5f065`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:58.191946 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-18835a45-7ddd-4623-bb61-7712c9dce283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:58.342341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 876/1739] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 14:59:57 2022] POST /identity/v3/users => generated 285 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:58.342341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceb3ea-844e-42f8-be1e-40d25ebace90 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:58.342341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceb3ea-844e-42f8-be1e-40d25ebace90 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:58.342341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceb3ea-844e-42f8-be1e-40d25ebace90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:58.418499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-1dceb3ea-844e-42f8-be1e-40d25ebace90 None None] MFA Rules not processed for user `5cd44ebc6bf442bca1e68c8b0fa94f00`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:58.420016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-1dceb3ea-844e-42f8-be1e-40d25ebace90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:58.438520 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 864/1740] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:58.441475 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18835a45-7ddd-4623-bb61-7712c9dce283 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:58.490637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18835a45-7ddd-4623-bb61-7712c9dce283 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:58.506689 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b443e2b-06f1-4928-accd-399d9df449cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:58.509308 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b443e2b-06f1-4928-accd-399d9df449cd admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:58.509308 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b443e2b-06f1-4928-accd-399d9df449cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:58.509495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b443e2b-06f1-4928-accd-399d9df449cd admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:58.517897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b443e2b-06f1-4928-accd-399d9df449cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:58.517897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b443e2b-06f1-4928-accd-399d9df449cd admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:58.548242 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:58.589576 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 877/1741] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:58.590809 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dceb3ea-844e-42f8-be1e-40d25ebace90 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:58.592526 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-1dceb3ea-844e-42f8-be1e-40d25ebace90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:58.614256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 865/1742] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:59:58.614256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae7e91-7090-4e74-9409-a88962e27719 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:58.616076 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae7e91-7090-4e74-9409-a88962e27719 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:58.616374 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae7e91-7090-4e74-9409-a88962e27719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:58.692022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dceb3ea-844e-42f8-be1e-40d25ebace90 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:58.707303 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c61c5-6127-4ca8-864b-3cfb252759f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:58.708388 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c61c5-6127-4ca8-864b-3cfb252759f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:58.714175 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c61c5-6127-4ca8-864b-3cfb252759f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:58.714676 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c61c5-6127-4ca8-864b-3cfb252759f2 admin admin] PATH_INFO: `/v3/projects/38ad60e5378c42209718990ee15cf500` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:58.718880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c61c5-6127-4ca8-864b-3cfb252759f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38ad60e5378c42209718990ee15cf500)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:58.734071 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c61c5-6127-4ca8-864b-3cfb252759f2 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:58.777997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-f2ae7e91-7090-4e74-9409-a88962e27719 None None] MFA Rules not processed for user `0834be7405cd4c968763099251d37154`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:58.779836 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f2ae7e91-7090-4e74-9409-a88962e27719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:58.923911 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 866/1743] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jul 26 14:59:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:58.924791 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae7e91-7090-4e74-9409-a88962e27719 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:58.984565 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae7e91-7090-4e74-9409-a88962e27719 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:59.011119 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d108b6a-5cd4-425c-b89a-8a5fa8496f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:59.012047 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d108b6a-5cd4-425c-b89a-8a5fa8496f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:59.012342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d108b6a-5cd4-425c-b89a-8a5fa8496f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:59.013239 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d108b6a-5cd4-425c-b89a-8a5fa8496f7c admin admin] PATH_INFO: `/v3/projects/3df0417b68054b62a0033b465ff5d4f4/users/76e56b1d82c04a7eb2bed17d20e3c5a3/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:59.100676 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d108b6a-5cd4-425c-b89a-8a5fa8496f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df0417b68054b62a0033b465ff5d4f4, user_id=76e56b1d82c04a7eb2bed17d20e3c5a3, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:59.105715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d108b6a-5cd4-425c-b89a-8a5fa8496f7c admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:59.126063 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-165c61c5-6127-4ca8-864b-3cfb252759f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38ad60e5378c42209718990ee15cf500', 'request_id': 'req-165c61c5-6127-4ca8-864b-3cfb252759f2'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:59.136769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-165c61c5-6127-4ca8-864b-3cfb252759f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38ad60e5378c42209718990ee15cf500', 'request_id': 'req-165c61c5-6127-4ca8-864b-3cfb252759f2'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:59.154196 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-165c61c5-6127-4ca8-864b-3cfb252759f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38ad60e5378c42209718990ee15cf500', 'request_id': 'req-165c61c5-6127-4ca8-864b-3cfb252759f2'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:59.238208 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 867/1744] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:58 2022] PUT /identity/v3/projects/3df0417b68054b62a0033b465ff5d4f4/users/76e56b1d82c04a7eb2bed17d20e3c5a3/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:59.243745 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d108b6a-5cd4-425c-b89a-8a5fa8496f7c admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:59.328609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-165c61c5-6127-4ca8-864b-3cfb252759f2 admin admin] The token cache is being invalidate because project 38ad60e5378c42209718990ee15cf500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 14:59:59.328609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-165c61c5-6127-4ca8-864b-3cfb252759f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:59.336104 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-165c61c5-6127-4ca8-864b-3cfb252759f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:59:59.336104 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 878/1745] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 14:59:58 2022] DELETE /identity/v3/projects/38ad60e5378c42209718990ee15cf500 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:59.339541 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d20a8-ba30-4775-a61a-5de901ef479a None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:59.339838 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d20a8-ba30-4775-a61a-5de901ef479a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:59.340126 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d20a8-ba30-4775-a61a-5de901ef479a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:59.393948 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d108b6a-5cd4-425c-b89a-8a5fa8496f7c admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:59.395155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-ca4d20a8-ba30-4775-a61a-5de901ef479a None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:59.396543 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ca4d20a8-ba30-4775-a61a-5de901ef479a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:59.399153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832c7fe-c4c4-4ba0-9efd-4612124b99db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:59.399978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832c7fe-c4c4-4ba0-9efd-4612124b99db admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:59.400270 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832c7fe-c4c4-4ba0-9efd-4612124b99db admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:59.402420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832c7fe-c4c4-4ba0-9efd-4612124b99db admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:59.405605 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832c7fe-c4c4-4ba0-9efd-4612124b99db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:59.407560 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832c7fe-c4c4-4ba0-9efd-4612124b99db admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:59.419828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 879/1746] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:59:59.430142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f82f8-f61c-40ae-8ef0-681c3d04940b None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:59.430770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f82f8-f61c-40ae-8ef0-681c3d04940b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:59.431184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f82f8-f61c-40ae-8ef0-681c3d04940b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:59.458437 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 868/1747] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 14:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 14:59:59.463495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832c7fe-c4c4-4ba0-9efd-4612124b99db admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:59.472747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-6832c7fe-c4c4-4ba0-9efd-4612124b99db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:59.477974 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-e11f82f8-f61c-40ae-8ef0-681c3d04940b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:59.483922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e11f82f8-f61c-40ae-8ef0-681c3d04940b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:59.521981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832c7fe-c4c4-4ba0-9efd-4612124b99db admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:59.525383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 880/1748] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:59:59.529523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f82f8-f61c-40ae-8ef0-681c3d04940b None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:59.553393 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e26e0-f3e0-4c0a-939b-1318a066e30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:59.563548 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e26e0-f3e0-4c0a-939b-1318a066e30d admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:59.564911 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e26e0-f3e0-4c0a-939b-1318a066e30d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:59.567494 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e26e0-f3e0-4c0a-939b-1318a066e30d admin admin] PATH_INFO: `/v3/projects/3df0417b68054b62a0033b465ff5d4f4/users/76e56b1d82c04a7eb2bed17d20e3c5a3/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:59.573563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e26e0-f3e0-4c0a-939b-1318a066e30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df0417b68054b62a0033b465ff5d4f4, user_id=76e56b1d82c04a7eb2bed17d20e3c5a3, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:59.574334 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f82f8-f61c-40ae-8ef0-681c3d04940b None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:59.586142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e26e0-f3e0-4c0a-939b-1318a066e30d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:59.586292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e2eef-44ba-4006-b822-dcd1580fe740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:59.586292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e2eef-44ba-4006-b822-dcd1580fe740 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:59.586292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e2eef-44ba-4006-b822-dcd1580fe740 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:59.586292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e2eef-44ba-4006-b822-dcd1580fe740 admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:59.586626 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e2eef-44ba-4006-b822-dcd1580fe740 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:59:59.586626 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e2eef-44ba-4006-b822-dcd1580fe740 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:59.587545 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e2eef-44ba-4006-b822-dcd1580fe740 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:59.598094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 869/1749] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 14:59:59 2022] PUT /identity/v3/projects/3df0417b68054b62a0033b465ff5d4f4/users/76e56b1d82c04a7eb2bed17d20e3c5a3/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:59:59.611288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c151d1-f338-4eb6-a5fe-666338a3f10b None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:59.611736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c151d1-f338-4eb6-a5fe-666338a3f10b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:59.612081 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c151d1-f338-4eb6-a5fe-666338a3f10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:59.626788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 881/1750] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 14:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:59:59.628580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e2eef-44ba-4006-b822-dcd1580fe740 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:59.660862 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e2eef-44ba-4006-b822-dcd1580fe740 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:59:59.707374 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:59.734261 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-62c151d1-f338-4eb6-a5fe-666338a3f10b None None] MFA Rules not processed for user `76e56b1d82c04a7eb2bed17d20e3c5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:59:59.740178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-62c151d1-f338-4eb6-a5fe-666338a3f10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:59.820663 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa439afd-131a-4105-9457-8f23a10e4afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:59:59.821215 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa439afd-131a-4105-9457-8f23a10e4afd admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:59:59.821653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa439afd-131a-4105-9457-8f23a10e4afd admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:59:59.822100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa439afd-131a-4105-9457-8f23a10e4afd admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:59:59.823026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa439afd-131a-4105-9457-8f23a10e4afd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:59:59.825105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa439afd-131a-4105-9457-8f23a10e4afd admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:59:59.958985 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 870/1751] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 14:59:59 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:59:59.958985 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c151d1-f338-4eb6-a5fe-666338a3f10b None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:59.958985 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-62c151d1-f338-4eb6-a5fe-666338a3f10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:59:59.980416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 882/1752] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 14:59:59 2022] POST /identity/v3/projects => generated 385 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:59:59.981455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa439afd-131a-4105-9457-8f23a10e4afd admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:59:59.984520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-aa439afd-131a-4105-9457-8f23a10e4afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:00.164211 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa439afd-131a-4105-9457-8f23a10e4afd admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:00.176565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a8521-6778-42b1-bdb7-0b4cb58a639d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:00.176565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a8521-6778-42b1-bdb7-0b4cb58a639d service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:00.176709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a8521-6778-42b1-bdb7-0b4cb58a639d service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:00.177071 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a8521-6778-42b1-bdb7-0b4cb58a639d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:00.229503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c151d1-f338-4eb6-a5fe-666338a3f10b None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:00.309689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a8521-6778-42b1-bdb7-0b4cb58a639d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:00.311251 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a8521-6778-42b1-bdb7-0b4cb58a639d service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:00.332258 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 883/1753] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 14:59:59 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:00.333118 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a8521-6778-42b1-bdb7-0b4cb58a639d service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:00.362103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dc5f6-48f0-4dd8-8d76-2345d424c7d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '462ecbb85c6b4a17a952fb74fa2de65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:00.362789 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dc5f6-48f0-4dd8-8d76-2345d424c7d9 service swift] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:00.363082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dc5f6-48f0-4dd8-8d76-2345d424c7d9 service swift] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:00.363360 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dc5f6-48f0-4dd8-8d76-2345d424c7d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:00.367480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b63dc5f6-48f0-4dd8-8d76-2345d424c7d9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:00.441197 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a8521-6778-42b1-bdb7-0b4cb58a639d service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:00.450286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772ff97-4cb2-4ef9-b062-712bab511fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:00.450615 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772ff97-4cb2-4ef9-b062-712bab511fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:00.450850 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772ff97-4cb2-4ef9-b062-712bab511fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:00.451118 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772ff97-4cb2-4ef9-b062-712bab511fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:00.454650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772ff97-4cb2-4ef9-b062-712bab511fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:00.458651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772ff97-4cb2-4ef9-b062-712bab511fc1 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:00.579660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63dc5f6-48f0-4dd8-8d76-2345d424c7d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:00.584411 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63dc5f6-48f0-4dd8-8d76-2345d424c7d9 service swift] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:00.614046 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 871/1754] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jul 26 14:59:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:00:00.650492 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 884/1755] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:00 2022] POST /identity/v3/users => generated 293 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:00.654685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dc5f6-48f0-4dd8-8d76-2345d424c7d9 service swift] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:00.674932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dc5f6-48f0-4dd8-8d76-2345d424c7d9 service swift] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:00.706574 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646ed81-e49c-46c9-ade6-7d601ecb81b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:00.709945 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646ed81-e49c-46c9-ade6-7d601ecb81b6 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:00.712100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646ed81-e49c-46c9-ade6-7d601ecb81b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:00.713760 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646ed81-e49c-46c9-ade6-7d601ecb81b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:00.729285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646ed81-e49c-46c9-ade6-7d601ecb81b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:00.734345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646ed81-e49c-46c9-ade6-7d601ecb81b6 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:00.744190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772ff97-4cb2-4ef9-b062-712bab511fc1 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:00.769067 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772ff97-4cb2-4ef9-b062-712bab511fc1 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:00.796433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a291c-8986-4353-abfd-703ff4dc31ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:00.797107 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a291c-8986-4353-abfd-703ff4dc31ed service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:00.797387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a291c-8986-4353-abfd-703ff4dc31ed service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:00.797674 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a291c-8986-4353-abfd-703ff4dc31ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:00.803197 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 872/1756] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:00.804425 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646ed81-e49c-46c9-ade6-7d601ecb81b6 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:00.812113 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-fa6a291c-8986-4353-abfd-703ff4dc31ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:00.833455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646ed81-e49c-46c9-ade6-7d601ecb81b6 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:00.850018 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43534e-0ba5-49be-95ed-8ecd1ac89708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:00.850628 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43534e-0ba5-49be-95ed-8ecd1ac89708 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:00.858049 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43534e-0ba5-49be-95ed-8ecd1ac89708 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:00.864538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43534e-0ba5-49be-95ed-8ecd1ac89708 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:00.864538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43534e-0ba5-49be-95ed-8ecd1ac89708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:00.865255 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43534e-0ba5-49be-95ed-8ecd1ac89708 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:00.894871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 873/1757] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:00.899029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43534e-0ba5-49be-95ed-8ecd1ac89708 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:00.932281 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43534e-0ba5-49be-95ed-8ecd1ac89708 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:00.948222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f97e3-b7af-4628-a38b-3e5846ce4f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:00.949396 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f97e3-b7af-4628-a38b-3e5846ce4f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:00.949396 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f97e3-b7af-4628-a38b-3e5846ce4f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:00.949599 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f97e3-b7af-4628-a38b-3e5846ce4f86 admin admin] PATH_INFO: `/v3/projects/80f25df2c444473dbbb61ac4bcf3ccb5/users/8dbd6141edf74efeaab5aac1a0e65dc9/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:00.956773 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:01.032061 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f97e3-b7af-4628-a38b-3e5846ce4f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f25df2c444473dbbb61ac4bcf3ccb5, user_id=8dbd6141edf74efeaab5aac1a0e65dc9, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:01.049869 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f97e3-b7af-4628-a38b-3e5846ce4f86 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:01.135186 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a291c-8986-4353-abfd-703ff4dc31ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:01.136661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a291c-8986-4353-abfd-703ff4dc31ed service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:01.154324 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 885/1758] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:00 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:01.198773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 874/1759] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:00 2022] PUT /identity/v3/projects/80f25df2c444473dbbb61ac4bcf3ccb5/users/8dbd6141edf74efeaab5aac1a0e65dc9/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:01.200559 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf1859-228b-4cb0-98c7-d1c23c893a91 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:01.200865 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf1859-228b-4cb0-98c7-d1c23c893a91 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:01.201250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf1859-228b-4cb0-98c7-d1c23c893a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:01.281766 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-a7bf1859-228b-4cb0-98c7-d1c23c893a91 None None] MFA Rules not processed for user `8dbd6141edf74efeaab5aac1a0e65dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:01.283050 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a7bf1859-228b-4cb0-98c7-d1c23c893a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:01.578670 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f97e3-b7af-4628-a38b-3e5846ce4f86 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:01.595957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 886/1760] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:01.824796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f97e3-b7af-4628-a38b-3e5846ce4f86 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:01.887963 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be2c38-b9ca-4a07-a3c2-172e633baf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:01.896151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be2c38-b9ca-4a07-a3c2-172e633baf71 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:01.900572 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be2c38-b9ca-4a07-a3c2-172e633baf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:01.902679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be2c38-b9ca-4a07-a3c2-172e633baf71 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:01.902679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be2c38-b9ca-4a07-a3c2-172e633baf71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:01.909073 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be2c38-b9ca-4a07-a3c2-172e633baf71 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:02.091048 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 875/1761] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:01 2022] POST /identity/v3/projects => generated 387 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:02.096207 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf1859-228b-4cb0-98c7-d1c23c893a91 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:02.137588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf1859-228b-4cb0-98c7-d1c23c893a91 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:02.432251 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc39bd-f818-43d8-aee3-09364dd8986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:02.434274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc39bd-f818-43d8-aee3-09364dd8986c admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:02.436756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc39bd-f818-43d8-aee3-09364dd8986c admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:02.437198 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc39bd-f818-43d8-aee3-09364dd8986c admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:02.438476 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc39bd-f818-43d8-aee3-09364dd8986c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:02.454837 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc39bd-f818-43d8-aee3-09364dd8986c admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:02.716311 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6470e71-da3d-4b07-85bf-86f4360d59de None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:02.716311 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6470e71-da3d-4b07-85bf-86f4360d59de None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:02.716311 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6470e71-da3d-4b07-85bf-86f4360d59de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:02.770151 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 887/1762] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:02 2022] POST /identity/v3/users => generated 300 bytes in 661 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:02.770701 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-e6470e71-da3d-4b07-85bf-86f4360d59de None None] MFA Rules not processed for user `e71086ec00454e26b24337e0876bfe89`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:02.770701 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e6470e71-da3d-4b07-85bf-86f4360d59de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:02.771181 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc39bd-f818-43d8-aee3-09364dd8986c admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:02.796137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc39bd-f818-43d8-aee3-09364dd8986c admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:02.818216 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d609911-5047-481d-977e-e7eb53cac315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:02.836159 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d609911-5047-481d-977e-e7eb53cac315 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:02.836159 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d609911-5047-481d-977e-e7eb53cac315 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:02.836159 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d609911-5047-481d-977e-e7eb53cac315 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:02.836159 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d609911-5047-481d-977e-e7eb53cac315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:02.836159 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d609911-5047-481d-977e-e7eb53cac315 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:02.843294 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 888/1763] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:02.869527 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d609911-5047-481d-977e-e7eb53cac315 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:02.924330 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 876/1764] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Jul 26 15:00:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:02.930062 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d609911-5047-481d-977e-e7eb53cac315 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:02.958277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6e7fd-fa4d-4360-bd25-9a1ff7df19cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:02.959716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6e7fd-fa4d-4360-bd25-9a1ff7df19cb admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:02.962580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6e7fd-fa4d-4360-bd25-9a1ff7df19cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:02.963881 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6e7fd-fa4d-4360-bd25-9a1ff7df19cb admin admin] PATH_INFO: `/v3/projects/d6196443661f4f87865c543483a2e9e9/users/99318e8f3bd04fafb827eccc9484f0c8/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:03.002847 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6470e71-da3d-4b07-85bf-86f4360d59de None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:03.004300 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e6470e71-da3d-4b07-85bf-86f4360d59de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:03.011140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6e7fd-fa4d-4360-bd25-9a1ff7df19cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6196443661f4f87865c543483a2e9e9, user_id=99318e8f3bd04fafb827eccc9484f0c8, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:03.015536 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6e7fd-fa4d-4360-bd25-9a1ff7df19cb admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:03.026218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6470e71-da3d-4b07-85bf-86f4360d59de None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:03.049320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe9ce7-db24-474f-8d72-23b1b1234d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:03.050025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe9ce7-db24-474f-8d72-23b1b1234d48 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:03.062940 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe9ce7-db24-474f-8d72-23b1b1234d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:03.064498 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe9ce7-db24-474f-8d72-23b1b1234d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:03.093998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe9ce7-db24-474f-8d72-23b1b1234d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:03.095699 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe9ce7-db24-474f-8d72-23b1b1234d48 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:03.161727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 877/1765] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:03.313333 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 889/1766] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:02 2022] PUT /identity/v3/projects/d6196443661f4f87865c543483a2e9e9/users/99318e8f3bd04fafb827eccc9484f0c8/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:03.318260 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe9ce7-db24-474f-8d72-23b1b1234d48 service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:03.352759 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe9ce7-db24-474f-8d72-23b1b1234d48 service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:03.567928 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:03.601826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c85d7-db44-40f0-a31a-0e1ee174a6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:03.604604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c85d7-db44-40f0-a31a-0e1ee174a6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:03.610138 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c85d7-db44-40f0-a31a-0e1ee174a6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:03.611311 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c85d7-db44-40f0-a31a-0e1ee174a6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:03.617755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c85d7-db44-40f0-a31a-0e1ee174a6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:03.632245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c85d7-db44-40f0-a31a-0e1ee174a6a0 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:03.689510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 878/1767] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:03.692830 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6e7fd-fa4d-4360-bd25-9a1ff7df19cb admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:03.705969 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6e7fd-fa4d-4360-bd25-9a1ff7df19cb admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:03.729770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf4fa6-be8b-43d1-abe6-1da51790affe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:03.733597 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf4fa6-be8b-43d1-abe6-1da51790affe admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:03.733889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf4fa6-be8b-43d1-abe6-1da51790affe admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:03.734192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf4fa6-be8b-43d1-abe6-1da51790affe admin admin] PATH_INFO: `/v3/projects/d6196443661f4f87865c543483a2e9e9/users/99318e8f3bd04fafb827eccc9484f0c8/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:03.742431 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf4fa6-be8b-43d1-abe6-1da51790affe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6196443661f4f87865c543483a2e9e9, user_id=99318e8f3bd04fafb827eccc9484f0c8, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:03.745966 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf4fa6-be8b-43d1-abe6-1da51790affe admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:03.786796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 890/1768] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:03 2022] PUT /identity/v3/projects/d6196443661f4f87865c543483a2e9e9/users/99318e8f3bd04fafb827eccc9484f0c8/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:03.805034 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289af0ee-5156-4cab-9517-67f4f6651e77 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:03.805034 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289af0ee-5156-4cab-9517-67f4f6651e77 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:03.805034 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289af0ee-5156-4cab-9517-67f4f6651e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:03.920861 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-289af0ee-5156-4cab-9517-67f4f6651e77 None None] MFA Rules not processed for user `99318e8f3bd04fafb827eccc9484f0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:03.922260 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-289af0ee-5156-4cab-9517-67f4f6651e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:04.044245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 879/1769] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:04.057230 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf4fa6-be8b-43d1-abe6-1da51790affe admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:04.060841 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-cbaf4fa6-be8b-43d1-abe6-1da51790affe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:04.227733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf4fa6-be8b-43d1-abe6-1da51790affe admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:04.235158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b239cf-d36a-4ad9-959f-b4d91c92463a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:04.235938 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b239cf-d36a-4ad9-959f-b4d91c92463a service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:04.236373 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b239cf-d36a-4ad9-959f-b4d91c92463a service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:04.236880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b239cf-d36a-4ad9-959f-b4d91c92463a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:04.273336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b239cf-d36a-4ad9-959f-b4d91c92463a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:04.277802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b239cf-d36a-4ad9-959f-b4d91c92463a service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:04.324445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 891/1770] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:04.448702 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289af0ee-5156-4cab-9517-67f4f6651e77 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:04.582340 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289af0ee-5156-4cab-9517-67f4f6651e77 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:04.595218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8f419-e3e8-40cc-88cd-cf4552c12cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:04.600516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8f419-e3e8-40cc-88cd-cf4552c12cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:04.600516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8f419-e3e8-40cc-88cd-cf4552c12cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:04.600516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8f419-e3e8-40cc-88cd-cf4552c12cc9 admin admin] PATH_INFO: `/v3/users/8dbd6141edf74efeaab5aac1a0e65dc9` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:04.600516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8f419-e3e8-40cc-88cd-cf4552c12cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dbd6141edf74efeaab5aac1a0e65dc9)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:04.600516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8f419-e3e8-40cc-88cd-cf4552c12cc9 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:04.894089 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:04.901879 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7df8f419-e3e8-40cc-88cd-cf4552c12cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dbd6141edf74efeaab5aac1a0e65dc9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:04.913898 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca9d4d-3656-4917-97e6-54363e331ce9 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:04.914498 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca9d4d-3656-4917-97e6-54363e331ce9 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:04.914957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca9d4d-3656-4917-97e6-54363e331ce9 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:04.916807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 892/1771] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jul 26 15:00:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:00:04.924413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259fbe4-0b0f-4d88-b445-5b2356454e46 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:04.924939 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259fbe4-0b0f-4d88-b445-5b2356454e46 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:04.925392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259fbe4-0b0f-4d88-b445-5b2356454e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:04.926976 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7df8f419-e3e8-40cc-88cd-cf4552c12cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dbd6141edf74efeaab5aac1a0e65dc9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:04.965289 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-7259fbe4-0b0f-4d88-b445-5b2356454e46 None None] MFA Rules not processed for user `0fab620bc5d044479746d8ea17615a74`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:04.966833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-7259fbe4-0b0f-4d88-b445-5b2356454e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:04.984059 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7df8f419-e3e8-40cc-88cd-cf4552c12cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dbd6141edf74efeaab5aac1a0e65dc9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:04.990934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7df8f419-e3e8-40cc-88cd-cf4552c12cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dbd6141edf74efeaab5aac1a0e65dc9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:04.992236 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7df8f419-e3e8-40cc-88cd-cf4552c12cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dbd6141edf74efeaab5aac1a0e65dc9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:05.083364 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 880/1772] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:04 2022] DELETE /identity/v3/users/8dbd6141edf74efeaab5aac1a0e65dc9 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:05.095846 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a68f0-6d08-4477-ad75-a113973429b0 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:05.096384 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a68f0-6d08-4477-ad75-a113973429b0 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:05.096812 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a68f0-6d08-4477-ad75-a113973429b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:05.123483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 893/1773] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jul 26 15:00:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:00:05.159030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-875a68f0-6d08-4477-ad75-a113973429b0 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:05.170273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-875a68f0-6d08-4477-ad75-a113973429b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:05.173836 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259fbe4-0b0f-4d88-b445-5b2356454e46 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:05.175312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-7259fbe4-0b0f-4d88-b445-5b2356454e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:05.196205 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259fbe4-0b0f-4d88-b445-5b2356454e46 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:05.299658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 881/1774] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:05.380379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f29fb1-b436-4731-93b0-d6e980048e5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fab620bc5d044479746d8ea17615a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:05.381286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f29fb1-b436-4731-93b0-d6e980048e5c service placement] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:05.381719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f29fb1-b436-4731-93b0-d6e980048e5c service placement] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:05.382210 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f29fb1-b436-4731-93b0-d6e980048e5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:05.402819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f29fb1-b436-4731-93b0-d6e980048e5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:05.404717 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f29fb1-b436-4731-93b0-d6e980048e5c service placement] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:05.459359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 894/1775] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:00:05.648326 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a68f0-6d08-4477-ad75-a113973429b0 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:05.651024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-875a68f0-6d08-4477-ad75-a113973429b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:05.900042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a68f0-6d08-4477-ad75-a113973429b0 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:05.904914 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a76dc-38b0-456a-9de0-c1937c877958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:05.906353 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a76dc-38b0-456a-9de0-c1937c877958 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:05.906844 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a76dc-38b0-456a-9de0-c1937c877958 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:05.907281 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a76dc-38b0-456a-9de0-c1937c877958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:05.927274 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a76dc-38b0-456a-9de0-c1937c877958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:05.928746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a76dc-38b0-456a-9de0-c1937c877958 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:05.961365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 882/1776] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:06.478535 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:06.636390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:07.058590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f29fb1-b436-4731-93b0-d6e980048e5c service placement] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:07.061505 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-b0f29fb1-b436-4731-93b0-d6e980048e5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:07.094969 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f29fb1-b436-4731-93b0-d6e980048e5c service placement] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:07.111382 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c58ce-4470-4ae2-b86d-26b02fb8d2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:07.113803 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c58ce-4470-4ae2-b86d-26b02fb8d2e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:07.114351 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c58ce-4470-4ae2-b86d-26b02fb8d2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:07.115073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c58ce-4470-4ae2-b86d-26b02fb8d2e2 admin admin] PATH_INFO: `/v3/users/19af0f2865b042d686182f3a49f8ddc2` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:07.120178 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c58ce-4470-4ae2-b86d-26b02fb8d2e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19af0f2865b042d686182f3a49f8ddc2)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:07.125661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c58ce-4470-4ae2-b86d-26b02fb8d2e2 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:07.457616 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-bb6c58ce-4470-4ae2-b86d-26b02fb8d2e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19af0f2865b042d686182f3a49f8ddc2'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:07.460933 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-bb6c58ce-4470-4ae2-b86d-26b02fb8d2e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19af0f2865b042d686182f3a49f8ddc2'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:07.477007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-bb6c58ce-4470-4ae2-b86d-26b02fb8d2e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19af0f2865b042d686182f3a49f8ddc2'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:07.609539 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-bb6c58ce-4470-4ae2-b86d-26b02fb8d2e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19af0f2865b042d686182f3a49f8ddc2'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:07.612595 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-bb6c58ce-4470-4ae2-b86d-26b02fb8d2e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19af0f2865b042d686182f3a49f8ddc2'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:07.639418 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 895/1777] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:07 2022] DELETE /identity/v3/users/19af0f2865b042d686182f3a49f8ddc2 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:07.883233 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:08.806302 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a76dc-38b0-456a-9de0-c1937c877958 service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:08.821432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a76dc-38b0-456a-9de0-c1937c877958 service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:08.876634 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:09.036688 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17245f3-5f3a-484f-9423-12a5c6ef7250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:09.038082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17245f3-5f3a-484f-9423-12a5c6ef7250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:09.038818 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17245f3-5f3a-484f-9423-12a5c6ef7250 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:09.039098 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17245f3-5f3a-484f-9423-12a5c6ef7250 admin admin] PATH_INFO: `/v3/projects/e2011a6f20c64bfd9e180fa0b2caa607` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:09.041195 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17245f3-5f3a-484f-9423-12a5c6ef7250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2011a6f20c64bfd9e180fa0b2caa607)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:09.043636 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17245f3-5f3a-484f-9423-12a5c6ef7250 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:09.268822 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f17245f3-5f3a-484f-9423-12a5c6ef7250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2011a6f20c64bfd9e180fa0b2caa607', 'request_id': 'req-f17245f3-5f3a-484f-9423-12a5c6ef7250'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:09.285405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f17245f3-5f3a-484f-9423-12a5c6ef7250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2011a6f20c64bfd9e180fa0b2caa607', 'request_id': 'req-f17245f3-5f3a-484f-9423-12a5c6ef7250'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:09.317853 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d93815-f97c-41fd-949f-c76e0e14897d None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:09.318629 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d93815-f97c-41fd-949f-c76e0e14897d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:09.319528 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d93815-f97c-41fd-949f-c76e0e14897d None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:09.322545 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 896/1778] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jul 26 15:00:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 15:00:09.345092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc059-2ace-4a5f-a265-f000feea39cb None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:09.346206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc059-2ace-4a5f-a265-f000feea39cb None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:09.346564 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc059-2ace-4a5f-a265-f000feea39cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:09.387951 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-6f2cc059-2ace-4a5f-a265-f000feea39cb None None] MFA Rules not processed for user `d12fc26e640f4337b4a4da60cc4d9adc`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:09.390081 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-6f2cc059-2ace-4a5f-a265-f000feea39cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:09.431504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f17245f3-5f3a-484f-9423-12a5c6ef7250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2011a6f20c64bfd9e180fa0b2caa607', 'request_id': 'req-f17245f3-5f3a-484f-9423-12a5c6ef7250'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:09.457289 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f17245f3-5f3a-484f-9423-12a5c6ef7250 admin admin] The token cache is being invalidate because project e2011a6f20c64bfd9e180fa0b2caa607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:09.467521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f17245f3-5f3a-484f-9423-12a5c6ef7250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:09.471843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f17245f3-5f3a-484f-9423-12a5c6ef7250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:09.478125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 883/1779] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:08 2022] DELETE /identity/v3/projects/e2011a6f20c64bfd9e180fa0b2caa607 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:09.483858 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17245f3-5f3a-484f-9423-12a5c6ef7250 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:09.487056 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f17245f3-5f3a-484f-9423-12a5c6ef7250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:09.589268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 897/1780] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jul 26 15:00:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:09.589966 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cc059-2ace-4a5f-a265-f000feea39cb None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:09.593574 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-6f2cc059-2ace-4a5f-a265-f000feea39cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:09.712994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17245f3-5f3a-484f-9423-12a5c6ef7250 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:09.719922 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c11dae-b7a2-4695-818d-ec48a8b87228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:09.727908 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c11dae-b7a2-4695-818d-ec48a8b87228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:09.727908 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c11dae-b7a2-4695-818d-ec48a8b87228 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:09.728058 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c11dae-b7a2-4695-818d-ec48a8b87228 admin admin] PATH_INFO: `/v3/users/20b6346bf37a4190b5ce55766fd5f065` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:09.729870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c11dae-b7a2-4695-818d-ec48a8b87228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b6346bf37a4190b5ce55766fd5f065)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:09.732069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c11dae-b7a2-4695-818d-ec48a8b87228 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:09.748392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cc059-2ace-4a5f-a265-f000feea39cb None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:09.766706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a423d-a293-4c39-8cc8-9aefd2eadc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:09.766706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a423d-a293-4c39-8cc8-9aefd2eadc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:09.766706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a423d-a293-4c39-8cc8-9aefd2eadc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:09.770752 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a423d-a293-4c39-8cc8-9aefd2eadc7c admin admin] PATH_INFO: `/v3/projects/80f25df2c444473dbbb61ac4bcf3ccb5` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:09.773617 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a423d-a293-4c39-8cc8-9aefd2eadc7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f25df2c444473dbbb61ac4bcf3ccb5)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:09.778324 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a423d-a293-4c39-8cc8-9aefd2eadc7c admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:10.077993 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-693a423d-a293-4c39-8cc8-9aefd2eadc7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f25df2c444473dbbb61ac4bcf3ccb5', 'request_id': 'req-693a423d-a293-4c39-8cc8-9aefd2eadc7c'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:10.085965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-693a423d-a293-4c39-8cc8-9aefd2eadc7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f25df2c444473dbbb61ac4bcf3ccb5', 'request_id': 'req-693a423d-a293-4c39-8cc8-9aefd2eadc7c'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:10.087010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-36c11dae-b7a2-4695-818d-ec48a8b87228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b6346bf37a4190b5ce55766fd5f065'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:10.097602 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-693a423d-a293-4c39-8cc8-9aefd2eadc7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f25df2c444473dbbb61ac4bcf3ccb5', 'request_id': 'req-693a423d-a293-4c39-8cc8-9aefd2eadc7c'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:10.118124 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-36c11dae-b7a2-4695-818d-ec48a8b87228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b6346bf37a4190b5ce55766fd5f065'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:10.165715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-36c11dae-b7a2-4695-818d-ec48a8b87228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b6346bf37a4190b5ce55766fd5f065'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:10.166781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-36c11dae-b7a2-4695-818d-ec48a8b87228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b6346bf37a4190b5ce55766fd5f065'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:10.168862 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-36c11dae-b7a2-4695-818d-ec48a8b87228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b6346bf37a4190b5ce55766fd5f065'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:10.305159 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-693a423d-a293-4c39-8cc8-9aefd2eadc7c admin admin] The token cache is being invalidate because project 80f25df2c444473dbbb61ac4bcf3ccb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:10.305569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-693a423d-a293-4c39-8cc8-9aefd2eadc7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:10.307000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-693a423d-a293-4c39-8cc8-9aefd2eadc7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:10.311996 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 898/1781] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:09 2022] DELETE /identity/v3/projects/80f25df2c444473dbbb61ac4bcf3ccb5 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:10.313486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a423d-a293-4c39-8cc8-9aefd2eadc7c admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:10.324227 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-693a423d-a293-4c39-8cc8-9aefd2eadc7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:10.437450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 884/1782] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:09 2022] DELETE /identity/v3/users/20b6346bf37a4190b5ce55766fd5f065 => generated 0 bytes in 955 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:10.447773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c11dae-b7a2-4695-818d-ec48a8b87228 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:10.448408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-36c11dae-b7a2-4695-818d-ec48a8b87228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:10.555062 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a423d-a293-4c39-8cc8-9aefd2eadc7c admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:10.629317 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c11dae-b7a2-4695-818d-ec48a8b87228 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:10.646603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc19912-45c0-4c0e-855f-74889db1899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:10.647638 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc19912-45c0-4c0e-855f-74889db1899b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:10.648630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc19912-45c0-4c0e-855f-74889db1899b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:10.649139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc19912-45c0-4c0e-855f-74889db1899b admin admin] PATH_INFO: `/v3/users/99318e8f3bd04fafb827eccc9484f0c8` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:10.650884 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc19912-45c0-4c0e-855f-74889db1899b admin admin] RBAC: Authorizing `identity:delete_user(user_id=99318e8f3bd04fafb827eccc9484f0c8)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:10.653191 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc19912-45c0-4c0e-855f-74889db1899b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:10.775374 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160819b-e27c-4671-a13c-8adb8edf38b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:10.778952 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160819b-e27c-4671-a13c-8adb8edf38b6 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:10.778952 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160819b-e27c-4671-a13c-8adb8edf38b6 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:10.778952 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160819b-e27c-4671-a13c-8adb8edf38b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:10.787989 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-9160819b-e27c-4671-a13c-8adb8edf38b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:10.796676 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:10.816736 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160819b-e27c-4671-a13c-8adb8edf38b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:10.818932 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160819b-e27c-4671-a13c-8adb8edf38b6 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:10.893963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 899/1783] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:10.915365 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eb47e-fa12-4489-a6c1-147afd6ae237 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:10.915666 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eb47e-fa12-4489-a6c1-147afd6ae237 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:10.915952 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eb47e-fa12-4489-a6c1-147afd6ae237 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:10.923221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 900/1784] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jul 26 15:00:10 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:00:10.954669 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b03c7-cca1-43fa-bafe-09c7950e703f None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:10.955196 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b03c7-cca1-43fa-bafe-09c7950e703f None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:10.955636 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b03c7-cca1-43fa-bafe-09c7950e703f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:10.974854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-bdc19912-45c0-4c0e-855f-74889db1899b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99318e8f3bd04fafb827eccc9484f0c8'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:10.994064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-bdc19912-45c0-4c0e-855f-74889db1899b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99318e8f3bd04fafb827eccc9484f0c8'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:11.027960 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-bdc19912-45c0-4c0e-855f-74889db1899b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99318e8f3bd04fafb827eccc9484f0c8'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:11.028717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-bdc19912-45c0-4c0e-855f-74889db1899b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99318e8f3bd04fafb827eccc9484f0c8'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:11.029547 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-bb4b03c7-cca1-43fa-bafe-09c7950e703f None None] MFA Rules not processed for user `d12fc26e640f4337b4a4da60cc4d9adc`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:11.029721 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-bdc19912-45c0-4c0e-855f-74889db1899b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99318e8f3bd04fafb827eccc9484f0c8'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:11.041454 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-bb4b03c7-cca1-43fa-bafe-09c7950e703f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:11.072255 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 901/1785] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jul 26 15:00:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:00:11.194503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 885/1786] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:10 2022] DELETE /identity/v3/users/99318e8f3bd04fafb827eccc9484f0c8 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:11.356431 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b03c7-cca1-43fa-bafe-09c7950e703f None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:11.363040 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-bb4b03c7-cca1-43fa-bafe-09c7950e703f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:11.379377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b03c7-cca1-43fa-bafe-09c7950e703f None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:11.462954 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:11.487783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d62e4-1d7f-47f3-9376-3a8dc4c9e0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:11.488806 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d62e4-1d7f-47f3-9376-3a8dc4c9e0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:11.489421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d62e4-1d7f-47f3-9376-3a8dc4c9e0be admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:11.503759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d62e4-1d7f-47f3-9376-3a8dc4c9e0be admin admin] PATH_INFO: `/v3/projects/71ae70a3bd5d40af946a04b3a2fdf558` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:11.507453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d62e4-1d7f-47f3-9376-3a8dc4c9e0be admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ae70a3bd5d40af946a04b3a2fdf558)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:11.515148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d62e4-1d7f-47f3-9376-3a8dc4c9e0be admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:11.717866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc19912-45c0-4c0e-855f-74889db1899b admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:11.720405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-bdc19912-45c0-4c0e-855f-74889db1899b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:11.749146 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c48d62e4-1d7f-47f3-9376-3a8dc4c9e0be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ae70a3bd5d40af946a04b3a2fdf558', 'request_id': 'req-c48d62e4-1d7f-47f3-9376-3a8dc4c9e0be'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:11.771326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c48d62e4-1d7f-47f3-9376-3a8dc4c9e0be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ae70a3bd5d40af946a04b3a2fdf558', 'request_id': 'req-c48d62e4-1d7f-47f3-9376-3a8dc4c9e0be'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:11.784146 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c48d62e4-1d7f-47f3-9376-3a8dc4c9e0be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ae70a3bd5d40af946a04b3a2fdf558', 'request_id': 'req-c48d62e4-1d7f-47f3-9376-3a8dc4c9e0be'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:11.906885 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c48d62e4-1d7f-47f3-9376-3a8dc4c9e0be admin admin] The token cache is being invalidate because project 71ae70a3bd5d40af946a04b3a2fdf558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:11.907414 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c48d62e4-1d7f-47f3-9376-3a8dc4c9e0be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:11.908266 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c48d62e4-1d7f-47f3-9376-3a8dc4c9e0be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:11.911645 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 902/1787] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:11 2022] DELETE /identity/v3/projects/71ae70a3bd5d40af946a04b3a2fdf558 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:11.921272 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018b923-314a-443d-9a0e-2a042c1ac74a None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:11.922768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018b923-314a-443d-9a0e-2a042c1ac74a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:11.923194 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018b923-314a-443d-9a0e-2a042c1ac74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:11.926891 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc19912-45c0-4c0e-855f-74889db1899b admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:12.008638 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-a018b923-314a-443d-9a0e-2a042c1ac74a None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:12.009888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a018b923-314a-443d-9a0e-2a042c1ac74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:12.093797 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcf812-eaad-4054-877e-103d8d725e4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:12.094818 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcf812-eaad-4054-877e-103d8d725e4f service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:12.095292 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcf812-eaad-4054-877e-103d8d725e4f service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:12.095812 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcf812-eaad-4054-877e-103d8d725e4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:12.107731 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8dbcf812-eaad-4054-877e-103d8d725e4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:12.163532 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcf812-eaad-4054-877e-103d8d725e4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:12.165563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcf812-eaad-4054-877e-103d8d725e4f service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:12.229167 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 886/1788] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:00:12.312341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 903/1789] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:12.320494 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f6fbf-4575-4f37-a17d-143054761ae2 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:12.321272 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f6fbf-4575-4f37-a17d-143054761ae2 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:12.322087 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f6fbf-4575-4f37-a17d-143054761ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:12.412305 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-af8f6fbf-4575-4f37-a17d-143054761ae2 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:12.414824 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-af8f6fbf-4575-4f37-a17d-143054761ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:12.432815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 887/1790] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:12.437016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018b923-314a-443d-9a0e-2a042c1ac74a None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:12.455104 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018b923-314a-443d-9a0e-2a042c1ac74a None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:12.469882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5f199-4594-4378-8091-d96c9517a5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:12.470936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5f199-4594-4378-8091-d96c9517a5aa admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:12.471447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5f199-4594-4378-8091-d96c9517a5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:12.471942 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5f199-4594-4378-8091-d96c9517a5aa admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:12.472940 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5f199-4594-4378-8091-d96c9517a5aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:12.473484 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5f199-4594-4378-8091-d96c9517a5aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:12.475458 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5f199-4594-4378-8091-d96c9517a5aa admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:12.520531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 904/1791] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:12.521682 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f6fbf-4575-4f37-a17d-143054761ae2 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:12.541358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f6fbf-4575-4f37-a17d-143054761ae2 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:12.573714 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7b9d4-357d-48a7-9e4c-3dbb219e0051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:12.575353 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7b9d4-357d-48a7-9e4c-3dbb219e0051 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:12.576644 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7b9d4-357d-48a7-9e4c-3dbb219e0051 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:12.577128 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7b9d4-357d-48a7-9e4c-3dbb219e0051 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:12.578037 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7b9d4-357d-48a7-9e4c-3dbb219e0051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:12.580809 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7b9d4-357d-48a7-9e4c-3dbb219e0051 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:12.764717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 888/1792] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:12 2022] POST /identity/v3/projects => generated 369 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:12.772214 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5f199-4594-4378-8091-d96c9517a5aa admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:12.791745 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5f199-4594-4378-8091-d96c9517a5aa admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:12.988256 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a422d-1f7e-4a38-a4d6-bc22a7fc255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:12.989179 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a422d-1f7e-4a38-a4d6-bc22a7fc255a admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:12.991326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a422d-1f7e-4a38-a4d6-bc22a7fc255a admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:12.991326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a422d-1f7e-4a38-a4d6-bc22a7fc255a admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:12.991326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a422d-1f7e-4a38-a4d6-bc22a7fc255a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:12.996208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a422d-1f7e-4a38-a4d6-bc22a7fc255a admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:13.117815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 905/1793] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:12 2022] POST /identity/v3/users => generated 285 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:13.118547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7b9d4-357d-48a7-9e4c-3dbb219e0051 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:13.149734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7b9d4-357d-48a7-9e4c-3dbb219e0051 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:13.159251 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c8152-f151-483f-a8af-c057415f9890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:13.162445 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c8152-f151-483f-a8af-c057415f9890 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:13.163032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c8152-f151-483f-a8af-c057415f9890 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:13.163971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c8152-f151-483f-a8af-c057415f9890 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:13.164897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c8152-f151-483f-a8af-c057415f9890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:13.166688 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c8152-f151-483f-a8af-c057415f9890 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:13.177557 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 889/1794] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:13.181649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a422d-1f7e-4a38-a4d6-bc22a7fc255a admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:13.230938 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a422d-1f7e-4a38-a4d6-bc22a7fc255a admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:13.247623 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b88e6-3afc-4e11-96d5-9488da8f249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:13.249886 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b88e6-3afc-4e11-96d5-9488da8f249c admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:13.254349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b88e6-3afc-4e11-96d5-9488da8f249c admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:13.256489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b88e6-3afc-4e11-96d5-9488da8f249c admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:13.256489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b88e6-3afc-4e11-96d5-9488da8f249c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:13.260017 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b88e6-3afc-4e11-96d5-9488da8f249c admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:13.282340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 906/1795] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:00:13.286466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c8152-f151-483f-a8af-c057415f9890 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:13.300397 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c8152-f151-483f-a8af-c057415f9890 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:13.309579 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02839142-a311-47ca-afd9-deaea4be1ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:13.310718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02839142-a311-47ca-afd9-deaea4be1ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:13.311325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02839142-a311-47ca-afd9-deaea4be1ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:13.312105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02839142-a311-47ca-afd9-deaea4be1ba6 admin admin] PATH_INFO: `/v3/projects/2a575f3cd9e244908507024353c08c51/users/8f32bf2835c84365bdd85b15e5dc9a41/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:13.383178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02839142-a311-47ca-afd9-deaea4be1ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a575f3cd9e244908507024353c08c51, user_id=8f32bf2835c84365bdd85b15e5dc9a41, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:13.409000 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02839142-a311-47ca-afd9-deaea4be1ba6 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:13.519137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 890/1796] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:13 2022] PUT /identity/v3/projects/2a575f3cd9e244908507024353c08c51/users/8f32bf2835c84365bdd85b15e5dc9a41/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:13.532002 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b77cb-b5be-4a3d-a4ec-8df2b02cdf97 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:13.532628 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b77cb-b5be-4a3d-a4ec-8df2b02cdf97 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:13.533241 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b77cb-b5be-4a3d-a4ec-8df2b02cdf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:13.597316 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-814b77cb-b5be-4a3d-a4ec-8df2b02cdf97 None None] MFA Rules not processed for user `8f32bf2835c84365bdd85b15e5dc9a41`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:13.599546 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-814b77cb-b5be-4a3d-a4ec-8df2b02cdf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:13.622184 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02839142-a311-47ca-afd9-deaea4be1ba6 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:13.624249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-02839142-a311-47ca-afd9-deaea4be1ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:13.737311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 907/1797] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:13.748644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b77cb-b5be-4a3d-a4ec-8df2b02cdf97 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:13.803343 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02839142-a311-47ca-afd9-deaea4be1ba6 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:13.833078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4625ae8-f7cb-477b-9da3-937820cae65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:13.833738 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4625ae8-f7cb-477b-9da3-937820cae65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:13.834024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4625ae8-f7cb-477b-9da3-937820cae65f admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:13.834351 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4625ae8-f7cb-477b-9da3-937820cae65f admin admin] PATH_INFO: `/v3/projects/d6196443661f4f87865c543483a2e9e9` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:13.835716 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4625ae8-f7cb-477b-9da3-937820cae65f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6196443661f4f87865c543483a2e9e9)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:13.838066 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4625ae8-f7cb-477b-9da3-937820cae65f admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:13.889041 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b77cb-b5be-4a3d-a4ec-8df2b02cdf97 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:13.910881 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:13.915365 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe4005-6887-44a0-9ee4-a2383bf185ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:13.915365 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe4005-6887-44a0-9ee4-a2383bf185ba admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:13.915365 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe4005-6887-44a0-9ee4-a2383bf185ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:13.915365 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe4005-6887-44a0-9ee4-a2383bf185ba admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:13.916419 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe4005-6887-44a0-9ee4-a2383bf185ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:13.922973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe4005-6887-44a0-9ee4-a2383bf185ba admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:13.999182 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a4625ae8-f7cb-477b-9da3-937820cae65f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6196443661f4f87865c543483a2e9e9', 'request_id': 'req-a4625ae8-f7cb-477b-9da3-937820cae65f'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:14.017098 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a4625ae8-f7cb-477b-9da3-937820cae65f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6196443661f4f87865c543483a2e9e9', 'request_id': 'req-a4625ae8-f7cb-477b-9da3-937820cae65f'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:14.144742 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 908/1798] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:13 2022] POST /identity/v3/projects => generated 367 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:14.146321 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe4005-6887-44a0-9ee4-a2383bf185ba admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:14.190170 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a4625ae8-f7cb-477b-9da3-937820cae65f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6196443661f4f87865c543483a2e9e9', 'request_id': 'req-a4625ae8-f7cb-477b-9da3-937820cae65f'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:14.211535 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a4625ae8-f7cb-477b-9da3-937820cae65f admin admin] The token cache is being invalidate because project d6196443661f4f87865c543483a2e9e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:14.211906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a4625ae8-f7cb-477b-9da3-937820cae65f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:14.213719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a4625ae8-f7cb-477b-9da3-937820cae65f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:14.221168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 891/1799] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:13 2022] DELETE /identity/v3/projects/d6196443661f4f87865c543483a2e9e9 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:00:14.229892 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84776a34-40c4-4708-aa81-523c8b23a6a2 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:14.232983 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84776a34-40c4-4708-aa81-523c8b23a6a2 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:14.232983 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84776a34-40c4-4708-aa81-523c8b23a6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:14.266748 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe4005-6887-44a0-9ee4-a2383bf185ba admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:14.268413 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-84776a34-40c4-4708-aa81-523c8b23a6a2 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:14.271359 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-84776a34-40c4-4708-aa81-523c8b23a6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:14.272298 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c0456-f24e-4538-a266-77c26117881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:14.273562 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c0456-f24e-4538-a266-77c26117881f admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:14.273921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c0456-f24e-4538-a266-77c26117881f admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:14.274278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c0456-f24e-4538-a266-77c26117881f admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:14.275058 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c0456-f24e-4538-a266-77c26117881f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:14.277236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c0456-f24e-4538-a266-77c26117881f admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:14.297222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 892/1800] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:14.302552 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c588364-fd82-4b9d-994c-c39378686a5c None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:14.302552 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c588364-fd82-4b9d-994c-c39378686a5c None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:14.302810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c588364-fd82-4b9d-994c-c39378686a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:14.349543 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-1c588364-fd82-4b9d-994c-c39378686a5c None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:14.353390 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-1c588364-fd82-4b9d-994c-c39378686a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:14.379763 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 893/1801] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:14.393589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c588364-fd82-4b9d-994c-c39378686a5c None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:14.422557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 909/1802] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:14 2022] POST /identity/v3/users => generated 290 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:14.423119 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c588364-fd82-4b9d-994c-c39378686a5c None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:14.423448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c0456-f24e-4538-a266-77c26117881f admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:14.425329 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5f7c0456-f24e-4538-a266-77c26117881f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:14.433904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9135e3-b34a-4ed1-865e-5e4f086c5ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:14.434605 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9135e3-b34a-4ed1-865e-5e4f086c5ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:14.434889 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9135e3-b34a-4ed1-865e-5e4f086c5ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:14.435402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9135e3-b34a-4ed1-865e-5e4f086c5ec5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:14.436308 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9135e3-b34a-4ed1-865e-5e4f086c5ec5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:14.436667 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9135e3-b34a-4ed1-865e-5e4f086c5ec5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:14.438489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9135e3-b34a-4ed1-865e-5e4f086c5ec5 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:14.448252 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c0456-f24e-4538-a266-77c26117881f admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:14.464230 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a135da3-2692-4e76-9c82-a8a73adfa3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:14.464845 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a135da3-2692-4e76-9c82-a8a73adfa3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:14.465210 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a135da3-2692-4e76-9c82-a8a73adfa3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:14.465395 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a135da3-2692-4e76-9c82-a8a73adfa3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:14.466113 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a135da3-2692-4e76-9c82-a8a73adfa3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:14.467955 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a135da3-2692-4e76-9c82-a8a73adfa3a1 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:14.489494 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 894/1803] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:14.494356 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9135e3-b34a-4ed1-865e-5e4f086c5ec5 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:14.506085 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 910/1804] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:00:14.512284 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a135da3-2692-4e76-9c82-a8a73adfa3a1 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:14.536664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9135e3-b34a-4ed1-865e-5e4f086c5ec5 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:14.542800 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a135da3-2692-4e76-9c82-a8a73adfa3a1 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:14.552685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a7d28-7413-405d-8f8a-d1493c7e221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:14.553674 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a7d28-7413-405d-8f8a-d1493c7e221b admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:14.555141 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a7d28-7413-405d-8f8a-d1493c7e221b admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:14.557535 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a7d28-7413-405d-8f8a-d1493c7e221b admin admin] PATH_INFO: `/v3/projects/6f5ac294da0448f9bc94dc6f265da125/users/691957f035a442e79f218e612b259cc1/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:14.563711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:14.570325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689451b7-9e75-4986-a8d7-202fe92f7cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:14.570325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689451b7-9e75-4986-a8d7-202fe92f7cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:14.570325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689451b7-9e75-4986-a8d7-202fe92f7cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:14.570325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689451b7-9e75-4986-a8d7-202fe92f7cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:14.570741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689451b7-9e75-4986-a8d7-202fe92f7cf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:14.584333 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689451b7-9e75-4986-a8d7-202fe92f7cf8 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:14.594274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a7d28-7413-405d-8f8a-d1493c7e221b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f5ac294da0448f9bc94dc6f265da125, user_id=691957f035a442e79f218e612b259cc1, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:14.601056 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a7d28-7413-405d-8f8a-d1493c7e221b admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:14.684568 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 911/1805] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:14 2022] PUT /identity/v3/projects/6f5ac294da0448f9bc94dc6f265da125/users/691957f035a442e79f218e612b259cc1/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:00:14.689227 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a7d28-7413-405d-8f8a-d1493c7e221b admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:14.740652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 895/1806] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:14 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:14.743580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689451b7-9e75-4986-a8d7-202fe92f7cf8 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:14.863003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a7d28-7413-405d-8f8a-d1493c7e221b admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:14.975430 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689451b7-9e75-4986-a8d7-202fe92f7cf8 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:14.984766 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa8f79-8365-43ae-b51d-c1d2bfbd6d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:14.986431 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa8f79-8365-43ae-b51d-c1d2bfbd6d07 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:14.988435 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa8f79-8365-43ae-b51d-c1d2bfbd6d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:14.990416 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa8f79-8365-43ae-b51d-c1d2bfbd6d07 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:14.992978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa8f79-8365-43ae-b51d-c1d2bfbd6d07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:15.004602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa8f79-8365-43ae-b51d-c1d2bfbd6d07 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:15.058611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508fe1d-8510-4694-8734-fe355fc755d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:15.058611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508fe1d-8510-4694-8734-fe355fc755d8 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:15.058611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508fe1d-8510-4694-8734-fe355fc755d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:15.058611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508fe1d-8510-4694-8734-fe355fc755d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:15.058898 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508fe1d-8510-4694-8734-fe355fc755d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:15.058898 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508fe1d-8510-4694-8734-fe355fc755d8 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:15.084667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 912/1807] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:15.085978 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508fe1d-8510-4694-8734-fe355fc755d8 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:15.119258 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508fe1d-8510-4694-8734-fe355fc755d8 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:15.133944 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cc4b9-fc9d-4ec2-b8e0-5bfb367524bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:15.134705 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cc4b9-fc9d-4ec2-b8e0-5bfb367524bd admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:15.135024 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cc4b9-fc9d-4ec2-b8e0-5bfb367524bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:15.135310 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cc4b9-fc9d-4ec2-b8e0-5bfb367524bd admin admin] PATH_INFO: `/v3/projects/6f5ac294da0448f9bc94dc6f265da125/users/691957f035a442e79f218e612b259cc1/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:15.139451 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cc4b9-fc9d-4ec2-b8e0-5bfb367524bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f5ac294da0448f9bc94dc6f265da125, user_id=691957f035a442e79f218e612b259cc1, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:15.145894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cc4b9-fc9d-4ec2-b8e0-5bfb367524bd admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:15.150254 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 896/1808] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:14 2022] POST /identity/v3/users => generated 291 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:15.151424 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa8f79-8365-43ae-b51d-c1d2bfbd6d07 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:15.178721 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 913/1809] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:15 2022] PUT /identity/v3/projects/6f5ac294da0448f9bc94dc6f265da125/users/691957f035a442e79f218e612b259cc1/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:15.194650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96c46a-3d23-40ee-acbb-60e30128d464 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:15.194997 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96c46a-3d23-40ee-acbb-60e30128d464 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:15.195283 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96c46a-3d23-40ee-acbb-60e30128d464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:15.207479 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa8f79-8365-43ae-b51d-c1d2bfbd6d07 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:15.304988 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-3f96c46a-3d23-40ee-acbb-60e30128d464 None None] MFA Rules not processed for user `691957f035a442e79f218e612b259cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:15.315746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3f96c46a-3d23-40ee-acbb-60e30128d464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:15.364358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81dc7b-002f-4225-9f34-b506f2ac3664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:15.365002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81dc7b-002f-4225-9f34-b506f2ac3664 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:15.365226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81dc7b-002f-4225-9f34-b506f2ac3664 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:15.365704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81dc7b-002f-4225-9f34-b506f2ac3664 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:15.366675 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81dc7b-002f-4225-9f34-b506f2ac3664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:15.368635 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81dc7b-002f-4225-9f34-b506f2ac3664 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:15.397014 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 897/1810] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:15.401669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81dc7b-002f-4225-9f34-b506f2ac3664 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:15.423444 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81dc7b-002f-4225-9f34-b506f2ac3664 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:15.429741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c68ff-54d0-4105-ac10-ac99bddd89b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:15.429741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c68ff-54d0-4105-ac10-ac99bddd89b2 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:15.429741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c68ff-54d0-4105-ac10-ac99bddd89b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:15.429741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c68ff-54d0-4105-ac10-ac99bddd89b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:15.430550 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c68ff-54d0-4105-ac10-ac99bddd89b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:15.432409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c68ff-54d0-4105-ac10-ac99bddd89b2 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:15.470580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 898/1811] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:00:15.473510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c68ff-54d0-4105-ac10-ac99bddd89b2 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:15.488296 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 914/1812] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:15.489393 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96c46a-3d23-40ee-acbb-60e30128d464 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:15.496421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3f96c46a-3d23-40ee-acbb-60e30128d464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:15.506615 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c68ff-54d0-4105-ac10-ac99bddd89b2 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:15.522029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60e1c8-4c65-430e-9a8e-bb305c0caa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:15.524136 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60e1c8-4c65-430e-9a8e-bb305c0caa3f admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:15.524673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60e1c8-4c65-430e-9a8e-bb305c0caa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:15.524963 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60e1c8-4c65-430e-9a8e-bb305c0caa3f admin admin] PATH_INFO: `/v3/projects/aa1b120ac39a485b953969eb2a349a3a/users/d4585ec3dfd248abaf6f83054d8989e9/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:15.527964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:15.550781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60e1c8-4c65-430e-9a8e-bb305c0caa3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1b120ac39a485b953969eb2a349a3a, user_id=d4585ec3dfd248abaf6f83054d8989e9, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:15.560149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60e1c8-4c65-430e-9a8e-bb305c0caa3f admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:15.619395 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96c46a-3d23-40ee-acbb-60e30128d464 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:15.624293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7289919-4111-4d2f-92c5-a78ed40d6d9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:15.625271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7289919-4111-4d2f-92c5-a78ed40d6d9e service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:15.625780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7289919-4111-4d2f-92c5-a78ed40d6d9e service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:15.626281 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7289919-4111-4d2f-92c5-a78ed40d6d9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:15.638024 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7289919-4111-4d2f-92c5-a78ed40d6d9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:15.639842 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7289919-4111-4d2f-92c5-a78ed40d6d9e service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:15.658759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 915/1813] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:15.999352 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 899/1814] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:15 2022] PUT /identity/v3/projects/aa1b120ac39a485b953969eb2a349a3a/users/d4585ec3dfd248abaf6f83054d8989e9/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:16.005462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87a07d-db4e-4794-9009-3a8334d5e737 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:16.005811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87a07d-db4e-4794-9009-3a8334d5e737 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:16.006129 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87a07d-db4e-4794-9009-3a8334d5e737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:16.038435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-bf87a07d-db4e-4794-9009-3a8334d5e737 None None] MFA Rules not processed for user `d4585ec3dfd248abaf6f83054d8989e9`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:16.039800 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-bf87a07d-db4e-4794-9009-3a8334d5e737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:16.130696 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 916/1815] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:16.135774 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60e1c8-4c65-430e-9a8e-bb305c0caa3f admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:16.199276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60e1c8-4c65-430e-9a8e-bb305c0caa3f admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:16.203799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a48beb-f2b9-40d5-8b32-cff520675a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:16.204424 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a48beb-f2b9-40d5-8b32-cff520675a24 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:16.204713 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a48beb-f2b9-40d5-8b32-cff520675a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:16.204995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a48beb-f2b9-40d5-8b32-cff520675a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:16.205716 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a48beb-f2b9-40d5-8b32-cff520675a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:16.207654 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a48beb-f2b9-40d5-8b32-cff520675a24 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:16.264347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87a07d-db4e-4794-9009-3a8334d5e737 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:16.318447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87a07d-db4e-4794-9009-3a8334d5e737 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:16.322831 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc52e8-3f77-4aeb-bfed-d113bb3d9c33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:16.323455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc52e8-3f77-4aeb-bfed-d113bb3d9c33 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:16.323741 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc52e8-3f77-4aeb-bfed-d113bb3d9c33 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:16.324016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc52e8-3f77-4aeb-bfed-d113bb3d9c33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:16.325803 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0dcc52e8-3f77-4aeb-bfed-d113bb3d9c33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:16.380628 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 900/1816] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:16 2022] POST /identity/v3/projects => generated 381 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:16.383655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc52e8-3f77-4aeb-bfed-d113bb3d9c33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:16.384679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a48beb-f2b9-40d5-8b32-cff520675a24 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:16.385143 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc52e8-3f77-4aeb-bfed-d113bb3d9c33 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:16.394591 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 917/1817] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:00:16.452422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a48beb-f2b9-40d5-8b32-cff520675a24 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:16.457178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8aaed8-1478-4099-8253-eccfc881891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:16.457798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aaed8-1478-4099-8253-eccfc881891c admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:16.458080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aaed8-1478-4099-8253-eccfc881891c admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:16.458352 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aaed8-1478-4099-8253-eccfc881891c admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:16.459128 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8aaed8-1478-4099-8253-eccfc881891c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:16.460926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8aaed8-1478-4099-8253-eccfc881891c admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:16.586783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 901/1818] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:16 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:16.590493 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc52e8-3f77-4aeb-bfed-d113bb3d9c33 service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:16.603946 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc52e8-3f77-4aeb-bfed-d113bb3d9c33 service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:16.611914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b70b8-ef8c-4062-aa15-3f3cff3ceb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:16.615735 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b70b8-ef8c-4062-aa15-3f3cff3ceb00 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:16.615735 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b70b8-ef8c-4062-aa15-3f3cff3ceb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:16.615735 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b70b8-ef8c-4062-aa15-3f3cff3ceb00 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:16.615735 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b70b8-ef8c-4062-aa15-3f3cff3ceb00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:16.616080 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b70b8-ef8c-4062-aa15-3f3cff3ceb00 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:16.632111 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 918/1819] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:00:16.635641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8aaed8-1478-4099-8253-eccfc881891c admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:16.648376 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8aaed8-1478-4099-8253-eccfc881891c admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:16.653342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b649ce-b24f-4b33-9c14-59439c880fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:16.654020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b649ce-b24f-4b33-9c14-59439c880fec admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:16.654353 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b649ce-b24f-4b33-9c14-59439c880fec admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:16.654668 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b649ce-b24f-4b33-9c14-59439c880fec admin admin] PATH_INFO: `/v3/projects/f40f52b9a8bd448c9cd700a6b7813bd2/users/90669e824ddd43f98f2a85ead162f11a/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:16.678807 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b649ce-b24f-4b33-9c14-59439c880fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40f52b9a8bd448c9cd700a6b7813bd2, user_id=90669e824ddd43f98f2a85ead162f11a, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:16.682262 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b649ce-b24f-4b33-9c14-59439c880fec admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:16.785027 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 902/1820] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:16 2022] PUT /identity/v3/projects/f40f52b9a8bd448c9cd700a6b7813bd2/users/90669e824ddd43f98f2a85ead162f11a/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:16.797046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b70b8-ef8c-4062-aa15-3f3cff3ceb00 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:16.803691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b70b8-ef8c-4062-aa15-3f3cff3ceb00 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:16.867295 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740441d-f0a1-4f60-b07d-2226eb1e9f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:16.867928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740441d-f0a1-4f60-b07d-2226eb1e9f6d admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:16.868203 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740441d-f0a1-4f60-b07d-2226eb1e9f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:16.868494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740441d-f0a1-4f60-b07d-2226eb1e9f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:16.869177 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740441d-f0a1-4f60-b07d-2226eb1e9f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:16.870867 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740441d-f0a1-4f60-b07d-2226eb1e9f6d admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:16.881910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 919/1821] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:16.886129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b649ce-b24f-4b33-9c14-59439c880fec admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:16.897242 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b649ce-b24f-4b33-9c14-59439c880fec admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:16.902453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a41b8a-a35f-4a33-821a-e9ce099c6007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:16.904274 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a41b8a-a35f-4a33-821a-e9ce099c6007 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:16.904588 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a41b8a-a35f-4a33-821a-e9ce099c6007 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:16.904898 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a41b8a-a35f-4a33-821a-e9ce099c6007 admin admin] PATH_INFO: `/v3/projects/f40f52b9a8bd448c9cd700a6b7813bd2/users/90669e824ddd43f98f2a85ead162f11a/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:16.907284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a41b8a-a35f-4a33-821a-e9ce099c6007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40f52b9a8bd448c9cd700a6b7813bd2, user_id=90669e824ddd43f98f2a85ead162f11a, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:16.910082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a41b8a-a35f-4a33-821a-e9ce099c6007 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:16.924204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 903/1822] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:16 2022] PUT /identity/v3/projects/f40f52b9a8bd448c9cd700a6b7813bd2/users/90669e824ddd43f98f2a85ead162f11a/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:16.935699 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499db12e-b304-4d09-8c93-07c65df3afa3 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:16.935992 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499db12e-b304-4d09-8c93-07c65df3afa3 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:16.936271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499db12e-b304-4d09-8c93-07c65df3afa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:16.967520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-499db12e-b304-4d09-8c93-07c65df3afa3 None None] MFA Rules not processed for user `90669e824ddd43f98f2a85ead162f11a`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:16.968666 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-499db12e-b304-4d09-8c93-07c65df3afa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:17.045957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 920/1823] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:00:17.063434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a41b8a-a35f-4a33-821a-e9ce099c6007 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:17.065496 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-41a41b8a-a35f-4a33-821a-e9ce099c6007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:17.128953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a41b8a-a35f-4a33-821a-e9ce099c6007 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:17.134116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1efff-bf44-43b3-b55b-218b62f8c548 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:17.134779 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1efff-bf44-43b3-b55b-218b62f8c548 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:17.135063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1efff-bf44-43b3-b55b-218b62f8c548 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:17.135345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1efff-bf44-43b3-b55b-218b62f8c548 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:17.149989 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1efff-bf44-43b3-b55b-218b62f8c548 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:17.149989 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1efff-bf44-43b3-b55b-218b62f8c548 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:17.160869 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 904/1824] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:17.807599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:18.348329 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499db12e-b304-4d09-8c93-07c65df3afa3 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:18.360602 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499db12e-b304-4d09-8c93-07c65df3afa3 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:18.368200 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabecdad-0755-4fc2-b286-3ba7fe583179 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90669e824ddd43f98f2a85ead162f11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f40f52b9a8bd448c9cd700a6b7813bd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:18.368200 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabecdad-0755-4fc2-b286-3ba7fe583179 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:18.368200 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabecdad-0755-4fc2-b286-3ba7fe583179 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:18.368655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabecdad-0755-4fc2-b286-3ba7fe583179 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:18.368655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabecdad-0755-4fc2-b286-3ba7fe583179 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:18.368655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabecdad-0755-4fc2-b286-3ba7fe583179 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:18.370108 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabecdad-0755-4fc2-b286-3ba7fe583179 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:18.383894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 921/1825] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:18.387796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1efff-bf44-43b3-b55b-218b62f8c548 service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:18.397854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1efff-bf44-43b3-b55b-218b62f8c548 service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:18.402992 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce7c63-80e9-4c5f-a45f-59221526975e tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90669e824ddd43f98f2a85ead162f11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f40f52b9a8bd448c9cd700a6b7813bd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:18.403688 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce7c63-80e9-4c5f-a45f-59221526975e tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:18.405644 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce7c63-80e9-4c5f-a45f-59221526975e tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:18.405644 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce7c63-80e9-4c5f-a45f-59221526975e tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:18.405644 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce7c63-80e9-4c5f-a45f-59221526975e tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:18.407173 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce7c63-80e9-4c5f-a45f-59221526975e tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:18.501961 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 905/1826] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:18 2022] POST /identity/v3/projects => generated 353 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:18.502920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabecdad-0755-4fc2-b286-3ba7fe583179 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:18.525976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabecdad-0755-4fc2-b286-3ba7fe583179 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:18.528269 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:18.622090 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d79c64-c7d3-43e2-8c7a-90a841cf3ff6 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90669e824ddd43f98f2a85ead162f11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f40f52b9a8bd448c9cd700a6b7813bd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:18.622888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d79c64-c7d3-43e2-8c7a-90a841cf3ff6 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:18.623177 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d79c64-c7d3-43e2-8c7a-90a841cf3ff6 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:18.623465 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d79c64-c7d3-43e2-8c7a-90a841cf3ff6 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:18.624174 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d79c64-c7d3-43e2-8c7a-90a841cf3ff6 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:18.624486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d79c64-c7d3-43e2-8c7a-90a841cf3ff6 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:18.626258 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d79c64-c7d3-43e2-8c7a-90a841cf3ff6 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:18.643614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 922/1827] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:19.001237 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce7c63-80e9-4c5f-a45f-59221526975e tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:19.013621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce7c63-80e9-4c5f-a45f-59221526975e tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:19.019588 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a431a-7286-41e0-9194-13f481b141e3 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90669e824ddd43f98f2a85ead162f11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f40f52b9a8bd448c9cd700a6b7813bd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:19.020321 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a431a-7286-41e0-9194-13f481b141e3 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:19.020731 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a431a-7286-41e0-9194-13f481b141e3 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:19.021382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a431a-7286-41e0-9194-13f481b141e3 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] PATH_INFO: `/v3/projects/c4f28f20623a42d8b77efebca72c4132` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:19.022284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a431a-7286-41e0-9194-13f481b141e3 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c4f28f20623a42d8b77efebca72c4132)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:19.025003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a431a-7286-41e0-9194-13f481b141e3 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:19.187134 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-506a431a-7286-41e0-9194-13f481b141e3 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f28f20623a42d8b77efebca72c4132', 'request_id': 'req-506a431a-7286-41e0-9194-13f481b141e3'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:19.194678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-506a431a-7286-41e0-9194-13f481b141e3 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f28f20623a42d8b77efebca72c4132', 'request_id': 'req-506a431a-7286-41e0-9194-13f481b141e3'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:19.350175 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-506a431a-7286-41e0-9194-13f481b141e3 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f28f20623a42d8b77efebca72c4132', 'request_id': 'req-506a431a-7286-41e0-9194-13f481b141e3'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:19.366872 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-506a431a-7286-41e0-9194-13f481b141e3 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] The token cache is being invalidate because project c4f28f20623a42d8b77efebca72c4132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:19.366872 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-506a431a-7286-41e0-9194-13f481b141e3 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:19.368432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-506a431a-7286-41e0-9194-13f481b141e3 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:19.372932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 906/1828] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:19 2022] DELETE /identity/v3/projects/c4f28f20623a42d8b77efebca72c4132 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:20.245379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d79c64-c7d3-43e2-8c7a-90a841cf3ff6 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:20.247746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-27d79c64-c7d3-43e2-8c7a-90a841cf3ff6 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:20.322252 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d79c64-c7d3-43e2-8c7a-90a841cf3ff6 tempest-VolumeQuotaClassesTest-1319716597 tempest-VolumeQuotaClassesTest-1319716597-project-admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:20.378814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a916d-e32a-4973-9401-fb6634daf892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:20.379464 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a916d-e32a-4973-9401-fb6634daf892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:20.379746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a916d-e32a-4973-9401-fb6634daf892 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:20.380023 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a916d-e32a-4973-9401-fb6634daf892 admin admin] PATH_INFO: `/v3/users/d4585ec3dfd248abaf6f83054d8989e9` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:20.381235 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a916d-e32a-4973-9401-fb6634daf892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4585ec3dfd248abaf6f83054d8989e9)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:20.383228 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a916d-e32a-4973-9401-fb6634daf892 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:20.598216 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-680a916d-e32a-4973-9401-fb6634daf892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4585ec3dfd248abaf6f83054d8989e9'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:20.598954 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-680a916d-e32a-4973-9401-fb6634daf892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4585ec3dfd248abaf6f83054d8989e9'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:20.612291 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-680a916d-e32a-4973-9401-fb6634daf892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4585ec3dfd248abaf6f83054d8989e9'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:20.721682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-680a916d-e32a-4973-9401-fb6634daf892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4585ec3dfd248abaf6f83054d8989e9'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:20.722102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:20.722568 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-680a916d-e32a-4973-9401-fb6634daf892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4585ec3dfd248abaf6f83054d8989e9'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:20.736521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 923/1829] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:20 2022] DELETE /identity/v3/users/d4585ec3dfd248abaf6f83054d8989e9 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:20.740955 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef495e5-69a0-4923-b6d1-e96c6f37696d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:20.741233 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef495e5-69a0-4923-b6d1-e96c6f37696d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:20.741514 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef495e5-69a0-4923-b6d1-e96c6f37696d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:20.762136 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-eef495e5-69a0-4923-b6d1-e96c6f37696d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:20.763566 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-eef495e5-69a0-4923-b6d1-e96c6f37696d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:20.823983 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 907/1830] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:20.835568 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a916d-e32a-4973-9401-fb6634daf892 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:20.837878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-680a916d-e32a-4973-9401-fb6634daf892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:20.900709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a916d-e32a-4973-9401-fb6634daf892 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:20.904456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16793e-f163-47b8-86d1-49981b199de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:20.905151 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16793e-f163-47b8-86d1-49981b199de6 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:20.905439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16793e-f163-47b8-86d1-49981b199de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:20.905711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16793e-f163-47b8-86d1-49981b199de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:20.915540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16793e-f163-47b8-86d1-49981b199de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:20.919340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16793e-f163-47b8-86d1-49981b199de6 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:20.939070 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 924/1831] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:21.196551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:22.357237 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef495e5-69a0-4923-b6d1-e96c6f37696d None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:22.359679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-eef495e5-69a0-4923-b6d1-e96c6f37696d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:22.373135 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef495e5-69a0-4923-b6d1-e96c6f37696d None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:22.378063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426503d-bbfb-4710-b330-3cc3fdd619cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:22.378684 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426503d-bbfb-4710-b330-3cc3fdd619cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:22.378866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426503d-bbfb-4710-b330-3cc3fdd619cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:22.379144 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426503d-bbfb-4710-b330-3cc3fdd619cd admin admin] PATH_INFO: `/v3/projects/aa1b120ac39a485b953969eb2a349a3a` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:22.380306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426503d-bbfb-4710-b330-3cc3fdd619cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa1b120ac39a485b953969eb2a349a3a)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:22.382251 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426503d-bbfb-4710-b330-3cc3fdd619cd admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:22.477853 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16793e-f163-47b8-86d1-49981b199de6 service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:22.479394 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-8c16793e-f163-47b8-86d1-49981b199de6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:22.492302 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16793e-f163-47b8-86d1-49981b199de6 service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:22.496979 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14af13-88c5-4c32-ad4e-2e8062c5cf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:22.497611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14af13-88c5-4c32-ad4e-2e8062c5cf4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:22.497893 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14af13-88c5-4c32-ad4e-2e8062c5cf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:22.498171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14af13-88c5-4c32-ad4e-2e8062c5cf4f admin admin] PATH_INFO: `/v3/users/8f32bf2835c84365bdd85b15e5dc9a41` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:22.499355 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14af13-88c5-4c32-ad4e-2e8062c5cf4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f32bf2835c84365bdd85b15e5dc9a41)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:22.501263 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14af13-88c5-4c32-ad4e-2e8062c5cf4f admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:22.581394 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-1426503d-bbfb-4710-b330-3cc3fdd619cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa1b120ac39a485b953969eb2a349a3a', 'request_id': 'req-1426503d-bbfb-4710-b330-3cc3fdd619cd'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:22.588363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-1426503d-bbfb-4710-b330-3cc3fdd619cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa1b120ac39a485b953969eb2a349a3a', 'request_id': 'req-1426503d-bbfb-4710-b330-3cc3fdd619cd'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:22.676063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-1426503d-bbfb-4710-b330-3cc3fdd619cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa1b120ac39a485b953969eb2a349a3a', 'request_id': 'req-1426503d-bbfb-4710-b330-3cc3fdd619cd'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:22.688207 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-1426503d-bbfb-4710-b330-3cc3fdd619cd admin admin] The token cache is being invalidate because project aa1b120ac39a485b953969eb2a349a3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:22.688789 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-1426503d-bbfb-4710-b330-3cc3fdd619cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:22.689526 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-1426503d-bbfb-4710-b330-3cc3fdd619cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:22.691111 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 908/1832] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:22 2022] DELETE /identity/v3/projects/aa1b120ac39a485b953969eb2a349a3a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:22.694680 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426503d-bbfb-4710-b330-3cc3fdd619cd admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:22.696503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-1426503d-bbfb-4710-b330-3cc3fdd619cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:22.761587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426503d-bbfb-4710-b330-3cc3fdd619cd admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:22.766335 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554682b3-2471-481f-8d3c-67b090f5f065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:22.767007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554682b3-2471-481f-8d3c-67b090f5f065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:22.767293 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554682b3-2471-481f-8d3c-67b090f5f065 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:22.767573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554682b3-2471-481f-8d3c-67b090f5f065 admin admin] PATH_INFO: `/v3/users/90669e824ddd43f98f2a85ead162f11a` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:22.769030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554682b3-2471-481f-8d3c-67b090f5f065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90669e824ddd43f98f2a85ead162f11a)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:22.770997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554682b3-2471-481f-8d3c-67b090f5f065 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:22.788682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fa14af13-88c5-4c32-ad4e-2e8062c5cf4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f32bf2835c84365bdd85b15e5dc9a41'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:22.789170 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fa14af13-88c5-4c32-ad4e-2e8062c5cf4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f32bf2835c84365bdd85b15e5dc9a41'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:22.802427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fa14af13-88c5-4c32-ad4e-2e8062c5cf4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f32bf2835c84365bdd85b15e5dc9a41'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:22.989736 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fa14af13-88c5-4c32-ad4e-2e8062c5cf4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f32bf2835c84365bdd85b15e5dc9a41'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:22.990413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fa14af13-88c5-4c32-ad4e-2e8062c5cf4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f32bf2835c84365bdd85b15e5dc9a41'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:23.004894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 925/1833] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:22 2022] DELETE /identity/v3/users/8f32bf2835c84365bdd85b15e5dc9a41 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:00:23.009799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c0ada-c734-40a8-9726-2f7a70653094 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:23.010077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c0ada-c734-40a8-9726-2f7a70653094 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:23.010362 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c0ada-c734-40a8-9726-2f7a70653094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:23.030017 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-665c0ada-c734-40a8-9726-2f7a70653094 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:23.031185 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-665c0ada-c734-40a8-9726-2f7a70653094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:23.090597 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 926/1834] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:00:23.100479 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c0ada-c734-40a8-9726-2f7a70653094 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:23.102454 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-665c0ada-c734-40a8-9726-2f7a70653094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:23.141040 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-554682b3-2471-481f-8d3c-67b090f5f065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90669e824ddd43f98f2a85ead162f11a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:23.160483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-554682b3-2471-481f-8d3c-67b090f5f065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90669e824ddd43f98f2a85ead162f11a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:23.161723 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c0ada-c734-40a8-9726-2f7a70653094 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:23.163636 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-554682b3-2471-481f-8d3c-67b090f5f065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90669e824ddd43f98f2a85ead162f11a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:23.164371 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-554682b3-2471-481f-8d3c-67b090f5f065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90669e824ddd43f98f2a85ead162f11a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:23.165193 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-554682b3-2471-481f-8d3c-67b090f5f065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90669e824ddd43f98f2a85ead162f11a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:23.166107 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2ec53-e74d-4053-a38d-71660a6d5c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:23.166805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2ec53-e74d-4053-a38d-71660a6d5c72 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:23.167098 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2ec53-e74d-4053-a38d-71660a6d5c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:23.167372 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2ec53-e74d-4053-a38d-71660a6d5c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:23.169599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-b6e2ec53-e74d-4053-a38d-71660a6d5c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:23.181943 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2ec53-e74d-4053-a38d-71660a6d5c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:23.183817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2ec53-e74d-4053-a38d-71660a6d5c72 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:23.195967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 927/1835] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:23.271505 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 909/1836] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:22 2022] DELETE /identity/v3/users/90669e824ddd43f98f2a85ead162f11a => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:23.763766 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2ec53-e74d-4053-a38d-71660a6d5c72 service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:23.765371 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-b6e2ec53-e74d-4053-a38d-71660a6d5c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:23.780959 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2ec53-e74d-4053-a38d-71660a6d5c72 service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:23.838652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554682b3-2471-481f-8d3c-67b090f5f065 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:23.842010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-554682b3-2471-481f-8d3c-67b090f5f065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:23.843971 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8761f93-11bc-4f20-9aa0-6b70beb93d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:23.845023 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8761f93-11bc-4f20-9aa0-6b70beb93d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:23.845720 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8761f93-11bc-4f20-9aa0-6b70beb93d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:23.846177 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8761f93-11bc-4f20-9aa0-6b70beb93d22 admin admin] PATH_INFO: `/v3/projects/2a575f3cd9e244908507024353c08c51` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:23.848118 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8761f93-11bc-4f20-9aa0-6b70beb93d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a575f3cd9e244908507024353c08c51)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:23.852264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8761f93-11bc-4f20-9aa0-6b70beb93d22 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:23.873699 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554682b3-2471-481f-8d3c-67b090f5f065 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:23.884008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df4ac5-7ce3-4ca6-b69f-c09b08af6471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:23.884811 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df4ac5-7ce3-4ca6-b69f-c09b08af6471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:23.885089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df4ac5-7ce3-4ca6-b69f-c09b08af6471 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:23.885366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df4ac5-7ce3-4ca6-b69f-c09b08af6471 admin admin] PATH_INFO: `/v3/projects/f40f52b9a8bd448c9cd700a6b7813bd2` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:23.886708 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df4ac5-7ce3-4ca6-b69f-c09b08af6471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40f52b9a8bd448c9cd700a6b7813bd2)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:23.888683 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df4ac5-7ce3-4ca6-b69f-c09b08af6471 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:23.984941 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d8761f93-11bc-4f20-9aa0-6b70beb93d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a575f3cd9e244908507024353c08c51', 'request_id': 'req-d8761f93-11bc-4f20-9aa0-6b70beb93d22'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:23.991739 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d8761f93-11bc-4f20-9aa0-6b70beb93d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a575f3cd9e244908507024353c08c51', 'request_id': 'req-d8761f93-11bc-4f20-9aa0-6b70beb93d22'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:24.000441 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d8761f93-11bc-4f20-9aa0-6b70beb93d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a575f3cd9e244908507024353c08c51', 'request_id': 'req-d8761f93-11bc-4f20-9aa0-6b70beb93d22'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:24.014029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-58df4ac5-7ce3-4ca6-b69f-c09b08af6471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40f52b9a8bd448c9cd700a6b7813bd2', 'request_id': 'req-58df4ac5-7ce3-4ca6-b69f-c09b08af6471'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:24.020638 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-58df4ac5-7ce3-4ca6-b69f-c09b08af6471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40f52b9a8bd448c9cd700a6b7813bd2', 'request_id': 'req-58df4ac5-7ce3-4ca6-b69f-c09b08af6471'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:24.064866 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d8761f93-11bc-4f20-9aa0-6b70beb93d22 admin admin] The token cache is being invalidate because project 2a575f3cd9e244908507024353c08c51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:24.065239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d8761f93-11bc-4f20-9aa0-6b70beb93d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:24.065943 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d8761f93-11bc-4f20-9aa0-6b70beb93d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:24.067672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 928/1837] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:23 2022] DELETE /identity/v3/projects/2a575f3cd9e244908507024353c08c51 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:24.071428 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8761f93-11bc-4f20-9aa0-6b70beb93d22 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:24.072844 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d8761f93-11bc-4f20-9aa0-6b70beb93d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:24.140239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8761f93-11bc-4f20-9aa0-6b70beb93d22 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:24.155887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-58df4ac5-7ce3-4ca6-b69f-c09b08af6471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40f52b9a8bd448c9cd700a6b7813bd2', 'request_id': 'req-58df4ac5-7ce3-4ca6-b69f-c09b08af6471'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:24.168653 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-58df4ac5-7ce3-4ca6-b69f-c09b08af6471 admin admin] The token cache is being invalidate because project f40f52b9a8bd448c9cd700a6b7813bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:24.169358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-58df4ac5-7ce3-4ca6-b69f-c09b08af6471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:24.170280 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-58df4ac5-7ce3-4ca6-b69f-c09b08af6471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:24.175555 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 910/1838] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:23 2022] DELETE /identity/v3/projects/f40f52b9a8bd448c9cd700a6b7813bd2 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:24.177287 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72c95a-90c4-44d8-90ca-8d765721d103 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:24.177402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72c95a-90c4-44d8-90ca-8d765721d103 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:24.177658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72c95a-90c4-44d8-90ca-8d765721d103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:24.198424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60addb-347d-42b8-8379-c1ac631bfe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:24.198669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-2e72c95a-90c4-44d8-90ca-8d765721d103 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:24.199088 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60addb-347d-42b8-8379-c1ac631bfe74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:24.199383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60addb-347d-42b8-8379-c1ac631bfe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:24.199697 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60addb-347d-42b8-8379-c1ac631bfe74 admin admin] PATH_INFO: `/v3/users/691957f035a442e79f218e612b259cc1` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:24.199886 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2e72c95a-90c4-44d8-90ca-8d765721d103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:24.200914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60addb-347d-42b8-8379-c1ac631bfe74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=691957f035a442e79f218e612b259cc1)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:24.202925 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60addb-347d-42b8-8379-c1ac631bfe74 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:24.208716 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 911/1839] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:24.216783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac438b3-bdcd-462e-b561-7169acb3d541 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:24.219151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac438b3-bdcd-462e-b561-7169acb3d541 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:24.219151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac438b3-bdcd-462e-b561-7169acb3d541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:24.237621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-fac438b3-bdcd-462e-b561-7169acb3d541 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:24.242081 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-fac438b3-bdcd-462e-b561-7169acb3d541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:24.249200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 912/1840] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:00:24.254369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac438b3-bdcd-462e-b561-7169acb3d541 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:24.268532 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac438b3-bdcd-462e-b561-7169acb3d541 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:24.274625 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e239967-def4-4b70-965d-1340dc1caa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:24.275256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e239967-def4-4b70-965d-1340dc1caa9c admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:24.275539 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e239967-def4-4b70-965d-1340dc1caa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:24.275819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e239967-def4-4b70-965d-1340dc1caa9c admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:24.276531 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e239967-def4-4b70-965d-1340dc1caa9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:24.276840 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e239967-def4-4b70-965d-1340dc1caa9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:24.279231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e239967-def4-4b70-965d-1340dc1caa9c admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:24.298197 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 913/1841] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:24.302741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e239967-def4-4b70-965d-1340dc1caa9c admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:24.316940 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e239967-def4-4b70-965d-1340dc1caa9c admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:24.323647 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68d64b-664e-4776-9aee-6d81cc3ebfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:24.324280 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68d64b-664e-4776-9aee-6d81cc3ebfa1 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:24.324569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68d64b-664e-4776-9aee-6d81cc3ebfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:24.324853 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68d64b-664e-4776-9aee-6d81cc3ebfa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:24.325699 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68d64b-664e-4776-9aee-6d81cc3ebfa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:24.327624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68d64b-664e-4776-9aee-6d81cc3ebfa1 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:24.386683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-2e60addb-347d-42b8-8379-c1ac631bfe74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '691957f035a442e79f218e612b259cc1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:24.387386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-2e60addb-347d-42b8-8379-c1ac631bfe74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '691957f035a442e79f218e612b259cc1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:24.400466 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-2e60addb-347d-42b8-8379-c1ac631bfe74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '691957f035a442e79f218e612b259cc1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:24.443091 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 914/1842] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:24 2022] POST /identity/v3/projects => generated 389 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:24.448000 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68d64b-664e-4776-9aee-6d81cc3ebfa1 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:24.506476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68d64b-664e-4776-9aee-6d81cc3ebfa1 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:24.511709 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08e000-7488-4d9d-856a-5d73b16dff0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:24.512321 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08e000-7488-4d9d-856a-5d73b16dff0b admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:24.512601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08e000-7488-4d9d-856a-5d73b16dff0b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:24.512879 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08e000-7488-4d9d-856a-5d73b16dff0b admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:24.513533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08e000-7488-4d9d-856a-5d73b16dff0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:24.515423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-2e60addb-347d-42b8-8379-c1ac631bfe74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '691957f035a442e79f218e612b259cc1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:24.515564 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08e000-7488-4d9d-856a-5d73b16dff0b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:24.516204 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-2e60addb-347d-42b8-8379-c1ac631bfe74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '691957f035a442e79f218e612b259cc1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:24.529782 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 929/1843] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:24 2022] DELETE /identity/v3/users/691957f035a442e79f218e612b259cc1 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:00:24.621211 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 915/1844] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:24 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:24.624996 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60addb-347d-42b8-8379-c1ac631bfe74 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:24.626716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2e60addb-347d-42b8-8379-c1ac631bfe74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:24.730000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60addb-347d-42b8-8379-c1ac631bfe74 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:24.735483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77830502-0460-4ebb-a691-3bb36234ed7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:24.736115 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77830502-0460-4ebb-a691-3bb36234ed7b admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:24.736393 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77830502-0460-4ebb-a691-3bb36234ed7b admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:24.736659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77830502-0460-4ebb-a691-3bb36234ed7b admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:24.737519 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77830502-0460-4ebb-a691-3bb36234ed7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:24.739279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77830502-0460-4ebb-a691-3bb36234ed7b admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:24.755277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 930/1845] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:24.756530 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08e000-7488-4d9d-856a-5d73b16dff0b admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:24.788371 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08e000-7488-4d9d-856a-5d73b16dff0b admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:24.794198 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29702ed6-a961-4866-a1a8-20d5d7526252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:24.795092 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29702ed6-a961-4866-a1a8-20d5d7526252 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:24.795415 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29702ed6-a961-4866-a1a8-20d5d7526252 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:24.795641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29702ed6-a961-4866-a1a8-20d5d7526252 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:24.796368 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29702ed6-a961-4866-a1a8-20d5d7526252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:24.797994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29702ed6-a961-4866-a1a8-20d5d7526252 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:24.809129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 916/1846] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:00:24.816021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77830502-0460-4ebb-a691-3bb36234ed7b admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:24.824384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77830502-0460-4ebb-a691-3bb36234ed7b admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:24.829340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b9b00-698d-4348-bfb7-04afa56599f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:24.830031 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b9b00-698d-4348-bfb7-04afa56599f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:24.830322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b9b00-698d-4348-bfb7-04afa56599f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:24.830642 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b9b00-698d-4348-bfb7-04afa56599f0 admin admin] PATH_INFO: `/v3/projects/aa1af62fe98b4676b401b3ea90fed04b/users/c0ba2b7515e14bf29c3ca228dd487181/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:24.846867 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b9b00-698d-4348-bfb7-04afa56599f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1af62fe98b4676b401b3ea90fed04b, user_id=c0ba2b7515e14bf29c3ca228dd487181, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:24.849645 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b9b00-698d-4348-bfb7-04afa56599f0 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:24.971885 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 931/1847] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:24 2022] PUT /identity/v3/projects/aa1af62fe98b4676b401b3ea90fed04b/users/c0ba2b7515e14bf29c3ca228dd487181/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:24.971978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3607a2-041f-454b-bab1-0e9cd5f6f65b None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:24.971978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3607a2-041f-454b-bab1-0e9cd5f6f65b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:24.971978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3607a2-041f-454b-bab1-0e9cd5f6f65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:24.975402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:25.000641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-2b3607a2-041f-454b-bab1-0e9cd5f6f65b None None] MFA Rules not processed for user `c0ba2b7515e14bf29c3ca228dd487181`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:25.001954 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2b3607a2-041f-454b-bab1-0e9cd5f6f65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:25.088369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 917/1848] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:25.092882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b9b00-698d-4348-bfb7-04afa56599f0 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:25.167105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3607a2-041f-454b-bab1-0e9cd5f6f65b None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:25.169152 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2b3607a2-041f-454b-bab1-0e9cd5f6f65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:25.179469 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b9b00-698d-4348-bfb7-04afa56599f0 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:25.195272 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58b341-cfb0-44a3-b7e3-537763e857fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:25.195429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3607a2-041f-454b-bab1-0e9cd5f6f65b None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:25.198633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58b341-cfb0-44a3-b7e3-537763e857fc admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:25.199927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58b341-cfb0-44a3-b7e3-537763e857fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:25.200572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58b341-cfb0-44a3-b7e3-537763e857fc admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:25.200686 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b33b5c-42f5-499e-b66c-c5761eeb44e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:25.201357 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b33b5c-42f5-499e-b66c-c5761eeb44e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:25.201641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b33b5c-42f5-499e-b66c-c5761eeb44e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:25.201920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b33b5c-42f5-499e-b66c-c5761eeb44e9 admin admin] PATH_INFO: `/v3/projects/6f5ac294da0448f9bc94dc6f265da125` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:25.202420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58b341-cfb0-44a3-b7e3-537763e857fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:25.203121 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b33b5c-42f5-499e-b66c-c5761eeb44e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f5ac294da0448f9bc94dc6f265da125)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:25.205025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b33b5c-42f5-499e-b66c-c5761eeb44e9 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:25.217911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58b341-cfb0-44a3-b7e3-537763e857fc admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:25.366926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-b7b33b5c-42f5-499e-b66c-c5761eeb44e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f5ac294da0448f9bc94dc6f265da125', 'request_id': 'req-b7b33b5c-42f5-499e-b66c-c5761eeb44e9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:25.376453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-b7b33b5c-42f5-499e-b66c-c5761eeb44e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f5ac294da0448f9bc94dc6f265da125', 'request_id': 'req-b7b33b5c-42f5-499e-b66c-c5761eeb44e9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:25.389472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 932/1849] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:25 2022] POST /identity/v3/projects => generated 393 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:25.393340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58b341-cfb0-44a3-b7e3-537763e857fc admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:25.465149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58b341-cfb0-44a3-b7e3-537763e857fc admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:25.469925 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029aa67-77ee-4442-9c24-2ea991835398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:25.470584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029aa67-77ee-4442-9c24-2ea991835398 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:25.470877 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029aa67-77ee-4442-9c24-2ea991835398 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:25.471163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029aa67-77ee-4442-9c24-2ea991835398 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:25.472124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029aa67-77ee-4442-9c24-2ea991835398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:25.474134 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029aa67-77ee-4442-9c24-2ea991835398 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:25.487743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:25.521331 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-b7b33b5c-42f5-499e-b66c-c5761eeb44e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f5ac294da0448f9bc94dc6f265da125', 'request_id': 'req-b7b33b5c-42f5-499e-b66c-c5761eeb44e9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:25.533406 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-b7b33b5c-42f5-499e-b66c-c5761eeb44e9 admin admin] The token cache is being invalidate because project 6f5ac294da0448f9bc94dc6f265da125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:25.533694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-b7b33b5c-42f5-499e-b66c-c5761eeb44e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:25.534321 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-b7b33b5c-42f5-499e-b66c-c5761eeb44e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:25.535879 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 918/1850] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:25 2022] DELETE /identity/v3/projects/6f5ac294da0448f9bc94dc6f265da125 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:25.540471 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac7a63-7247-4df4-99c6-6625249bfa85 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:25.540762 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac7a63-7247-4df4-99c6-6625249bfa85 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:25.541043 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac7a63-7247-4df4-99c6-6625249bfa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:25.561325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-e8ac7a63-7247-4df4-99c6-6625249bfa85 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:25.562552 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e8ac7a63-7247-4df4-99c6-6625249bfa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:25.571661 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 919/1851] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:00:25.579500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9919f-3c4a-48ae-8d02-a6770294775e None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:25.579793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9919f-3c4a-48ae-8d02-a6770294775e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:25.580075 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9919f-3c4a-48ae-8d02-a6770294775e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:25.597131 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 933/1852] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:25 2022] POST /identity/v3/users => generated 303 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:25.600229 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-35d9919f-3c4a-48ae-8d02-a6770294775e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:25.601389 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-35d9919f-3c4a-48ae-8d02-a6770294775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:25.602377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029aa67-77ee-4442-9c24-2ea991835398 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:25.604101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e029aa67-77ee-4442-9c24-2ea991835398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:25.609211 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 920/1853] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:00:25.613306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9919f-3c4a-48ae-8d02-a6770294775e None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:25.616035 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029aa67-77ee-4442-9c24-2ea991835398 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:25.621093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd676b2-8e49-4b8a-90af-19977c6ba262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:25.631660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd676b2-8e49-4b8a-90af-19977c6ba262 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:25.631660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd676b2-8e49-4b8a-90af-19977c6ba262 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:25.631660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd676b2-8e49-4b8a-90af-19977c6ba262 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:25.631904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9919f-3c4a-48ae-8d02-a6770294775e None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:25.631997 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd676b2-8e49-4b8a-90af-19977c6ba262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:25.631997 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd676b2-8e49-4b8a-90af-19977c6ba262 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:25.632128 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f6369-8476-436e-bada-5a9a8644a79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:25.632128 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f6369-8476-436e-bada-5a9a8644a79a admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:25.632128 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f6369-8476-436e-bada-5a9a8644a79a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:25.632128 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f6369-8476-436e-bada-5a9a8644a79a admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:25.632403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f6369-8476-436e-bada-5a9a8644a79a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:25.632403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f6369-8476-436e-bada-5a9a8644a79a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:25.632403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f6369-8476-436e-bada-5a9a8644a79a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:25.636003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 934/1854] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:00:25.640226 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd676b2-8e49-4b8a-90af-19977c6ba262 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:25.644094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 921/1855] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:25.649054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f6369-8476-436e-bada-5a9a8644a79a admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:25.651079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd676b2-8e49-4b8a-90af-19977c6ba262 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:25.655703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b60ff-409f-46ff-bbe8-12890ffc27d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:25.656361 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b60ff-409f-46ff-bbe8-12890ffc27d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:25.656642 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b60ff-409f-46ff-bbe8-12890ffc27d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:25.657053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b60ff-409f-46ff-bbe8-12890ffc27d8 admin admin] PATH_INFO: `/v3/projects/89442169f0764c239891383526764557/users/487646cb341f476cae28d1fc1ca8d127/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:25.659306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f6369-8476-436e-bada-5a9a8644a79a admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:25.664493 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c7874-25c1-4c6d-b3c6-9f39b0e6c8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:25.665223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c7874-25c1-4c6d-b3c6-9f39b0e6c8df admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:25.665514 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c7874-25c1-4c6d-b3c6-9f39b0e6c8df admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:25.665793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c7874-25c1-4c6d-b3c6-9f39b0e6c8df admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:25.666746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c7874-25c1-4c6d-b3c6-9f39b0e6c8df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:25.668668 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c7874-25c1-4c6d-b3c6-9f39b0e6c8df admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:25.677530 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b60ff-409f-46ff-bbe8-12890ffc27d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89442169f0764c239891383526764557, user_id=487646cb341f476cae28d1fc1ca8d127, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:25.679035 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b60ff-409f-46ff-bbe8-12890ffc27d8 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:25.806904 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 935/1856] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:25 2022] PUT /identity/v3/projects/89442169f0764c239891383526764557/users/487646cb341f476cae28d1fc1ca8d127/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:25.810784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b60ff-409f-46ff-bbe8-12890ffc27d8 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:25.840144 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 922/1857] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:25 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:25.844383 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c7874-25c1-4c6d-b3c6-9f39b0e6c8df admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:25.884221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b60ff-409f-46ff-bbe8-12890ffc27d8 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:25.941124 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c7874-25c1-4c6d-b3c6-9f39b0e6c8df admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:25.947500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3473f2-0c2b-48f4-8763-b5b5accd2696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:25.948137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3473f2-0c2b-48f4-8763-b5b5accd2696 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:25.948435 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3473f2-0c2b-48f4-8763-b5b5accd2696 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:25.948762 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3473f2-0c2b-48f4-8763-b5b5accd2696 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:25.949493 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3473f2-0c2b-48f4-8763-b5b5accd2696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:25.951671 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3473f2-0c2b-48f4-8763-b5b5accd2696 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:25.969698 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5af2a-9a4d-4abb-87fb-34c8b7869665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:25.970748 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5af2a-9a4d-4abb-87fb-34c8b7869665 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:25.974482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5af2a-9a4d-4abb-87fb-34c8b7869665 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:25.974482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5af2a-9a4d-4abb-87fb-34c8b7869665 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:25.974482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5af2a-9a4d-4abb-87fb-34c8b7869665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:25.975847 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5af2a-9a4d-4abb-87fb-34c8b7869665 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:25.988923 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 936/1858] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:25.994146 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5af2a-9a4d-4abb-87fb-34c8b7869665 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:26.010694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5af2a-9a4d-4abb-87fb-34c8b7869665 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:26.016388 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8ee40-d547-45c9-8552-730f4bfe2cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:26.017254 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8ee40-d547-45c9-8552-730f4bfe2cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:26.017645 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8ee40-d547-45c9-8552-730f4bfe2cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:26.018272 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8ee40-d547-45c9-8552-730f4bfe2cbb admin admin] PATH_INFO: `/v3/projects/89442169f0764c239891383526764557/users/487646cb341f476cae28d1fc1ca8d127/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:26.033130 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8ee40-d547-45c9-8552-730f4bfe2cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=89442169f0764c239891383526764557, user_id=487646cb341f476cae28d1fc1ca8d127, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:26.036041 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8ee40-d547-45c9-8552-730f4bfe2cbb admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:26.039248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 923/1859] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:25 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:26.044225 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3473f2-0c2b-48f4-8763-b5b5accd2696 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:26.057456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 937/1860] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:25 2022] PUT /identity/v3/projects/89442169f0764c239891383526764557/users/487646cb341f476cae28d1fc1ca8d127/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:26.058918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3473f2-0c2b-48f4-8763-b5b5accd2696 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:26.075794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f0cc5-83a0-461e-9167-275b919bbbbc None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:26.076094 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f0cc5-83a0-461e-9167-275b919bbbbc None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:26.076378 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f0cc5-83a0-461e-9167-275b919bbbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:26.106455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-e17f0cc5-83a0-461e-9167-275b919bbbbc None None] MFA Rules not processed for user `487646cb341f476cae28d1fc1ca8d127`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:26.107936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e17f0cc5-83a0-461e-9167-275b919bbbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:26.120672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125f8cb-ee7d-465c-97ea-5e9a1c3359fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:26.121398 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125f8cb-ee7d-465c-97ea-5e9a1c3359fb admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:26.123922 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125f8cb-ee7d-465c-97ea-5e9a1c3359fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:26.123922 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125f8cb-ee7d-465c-97ea-5e9a1c3359fb admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:26.123922 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125f8cb-ee7d-465c-97ea-5e9a1c3359fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:26.124566 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125f8cb-ee7d-465c-97ea-5e9a1c3359fb admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:26.136036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 924/1861] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:26.140090 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125f8cb-ee7d-465c-97ea-5e9a1c3359fb admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:26.150372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125f8cb-ee7d-465c-97ea-5e9a1c3359fb admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:26.155228 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70598dc0-bd22-4c18-9dd3-59b069b730b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:26.155844 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70598dc0-bd22-4c18-9dd3-59b069b730b7 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:26.156919 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70598dc0-bd22-4c18-9dd3-59b069b730b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:26.156919 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70598dc0-bd22-4c18-9dd3-59b069b730b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:26.157094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70598dc0-bd22-4c18-9dd3-59b069b730b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:26.158682 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70598dc0-bd22-4c18-9dd3-59b069b730b7 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:26.169962 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 925/1862] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:00:26.174741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70598dc0-bd22-4c18-9dd3-59b069b730b7 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:26.183586 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 938/1863] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:26.184859 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70598dc0-bd22-4c18-9dd3-59b069b730b7 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:26.189801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56c91c-ca3e-4614-b189-b6dfa9c90cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:26.190511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56c91c-ca3e-4614-b189-b6dfa9c90cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:26.190801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56c91c-ca3e-4614-b189-b6dfa9c90cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:26.191082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56c91c-ca3e-4614-b189-b6dfa9c90cd7 admin admin] PATH_INFO: `/v3/projects/041ad1ebd1394225abf4fee59bc69518/users/c4eee00d660a44849d457fb4249f79ae/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:26.195374 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f0cc5-83a0-461e-9167-275b919bbbbc None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:26.196757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e17f0cc5-83a0-461e-9167-275b919bbbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:26.206656 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56c91c-ca3e-4614-b189-b6dfa9c90cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=041ad1ebd1394225abf4fee59bc69518, user_id=c4eee00d660a44849d457fb4249f79ae, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:26.209268 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56c91c-ca3e-4614-b189-b6dfa9c90cd7 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:26.253113 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f0cc5-83a0-461e-9167-275b919bbbbc None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:26.256920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604f654-1d3e-4b75-aede-7d91edb04361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:26.257772 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604f654-1d3e-4b75-aede-7d91edb04361 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:26.258065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604f654-1d3e-4b75-aede-7d91edb04361 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:26.259797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604f654-1d3e-4b75-aede-7d91edb04361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:26.268138 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604f654-1d3e-4b75-aede-7d91edb04361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:26.269594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604f654-1d3e-4b75-aede-7d91edb04361 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:26.280024 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 939/1864] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:00:26.332846 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 926/1865] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:26 2022] PUT /identity/v3/projects/041ad1ebd1394225abf4fee59bc69518/users/c4eee00d660a44849d457fb4249f79ae/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:26.340433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604f654-1d3e-4b75-aede-7d91edb04361 service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:26.341884 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-9604f654-1d3e-4b75-aede-7d91edb04361 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:26.344951 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadf56a-fc6b-4101-8e35-f82a0e9b93b3 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:26.345241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadf56a-fc6b-4101-8e35-f82a0e9b93b3 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:26.345520 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadf56a-fc6b-4101-8e35-f82a0e9b93b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:26.354770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604f654-1d3e-4b75-aede-7d91edb04361 service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:26.390950 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-8aadf56a-fc6b-4101-8e35-f82a0e9b93b3 None None] MFA Rules not processed for user `c4eee00d660a44849d457fb4249f79ae`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:26.392760 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8aadf56a-fc6b-4101-8e35-f82a0e9b93b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:26.430780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cae01-9c7e-487b-8533-a42c02f0c340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:26.431340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cae01-9c7e-487b-8533-a42c02f0c340 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:26.431623 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cae01-9c7e-487b-8533-a42c02f0c340 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:26.431894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cae01-9c7e-487b-8533-a42c02f0c340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:26.435314 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-311cae01-9c7e-487b-8533-a42c02f0c340 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:26.467728 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 927/1866] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:00:26.472291 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadf56a-fc6b-4101-8e35-f82a0e9b93b3 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:26.505324 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cae01-9c7e-487b-8533-a42c02f0c340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:26.508283 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cae01-9c7e-487b-8533-a42c02f0c340 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:26.524221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 940/1867] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:26.559062 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadf56a-fc6b-4101-8e35-f82a0e9b93b3 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:26.565575 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8b5ff-7d1a-460f-9beb-2e0e6fe48c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:26.566921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8b5ff-7d1a-460f-9beb-2e0e6fe48c4a admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:26.567744 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8b5ff-7d1a-460f-9beb-2e0e6fe48c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:26.568029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8b5ff-7d1a-460f-9beb-2e0e6fe48c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:26.569125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8b5ff-7d1a-460f-9beb-2e0e6fe48c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:26.571596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8b5ff-7d1a-460f-9beb-2e0e6fe48c4a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:26.820742 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 928/1868] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:26 2022] POST /identity/v3/projects => generated 387 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:26.824801 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cae01-9c7e-487b-8533-a42c02f0c340 service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:26.835339 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cae01-9c7e-487b-8533-a42c02f0c340 service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:26.891976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0247b96-67c8-4082-b6ef-1a287276623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:26.894051 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0247b96-67c8-4082-b6ef-1a287276623e admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:26.894051 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0247b96-67c8-4082-b6ef-1a287276623e admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:26.894051 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0247b96-67c8-4082-b6ef-1a287276623e admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:26.894051 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0247b96-67c8-4082-b6ef-1a287276623e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:26.896030 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0247b96-67c8-4082-b6ef-1a287276623e admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:27.002114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 941/1869] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:26 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:27.006117 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8b5ff-7d1a-460f-9beb-2e0e6fe48c4a admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:27.018628 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8b5ff-7d1a-460f-9beb-2e0e6fe48c4a admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:27.024051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5314174-544d-4bf0-85da-688d89f7a5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:27.024658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5314174-544d-4bf0-85da-688d89f7a5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:27.024942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5314174-544d-4bf0-85da-688d89f7a5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:27.025219 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5314174-544d-4bf0-85da-688d89f7a5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:27.025914 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5314174-544d-4bf0-85da-688d89f7a5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:27.027555 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5314174-544d-4bf0-85da-688d89f7a5f5 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:27.041597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 929/1870] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:27.042912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0247b96-67c8-4082-b6ef-1a287276623e admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:27.053987 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0247b96-67c8-4082-b6ef-1a287276623e admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:27.060913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f6e73-5eb0-4f5f-ad53-adbccf416cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:27.061660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f6e73-5eb0-4f5f-ad53-adbccf416cae admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:27.062508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f6e73-5eb0-4f5f-ad53-adbccf416cae admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:27.062508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f6e73-5eb0-4f5f-ad53-adbccf416cae admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:27.063383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f6e73-5eb0-4f5f-ad53-adbccf416cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:27.065260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f6e73-5eb0-4f5f-ad53-adbccf416cae admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:27.082489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 942/1871] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:27.093921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5314174-544d-4bf0-85da-688d89f7a5f5 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:27.115069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5314174-544d-4bf0-85da-688d89f7a5f5 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:27.129558 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830484dc-ccc9-4f21-a283-4fb735c34c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:27.130278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830484dc-ccc9-4f21-a283-4fb735c34c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:27.131679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830484dc-ccc9-4f21-a283-4fb735c34c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:27.131984 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830484dc-ccc9-4f21-a283-4fb735c34c63 admin admin] PATH_INFO: `/v3/projects/2193255399ef4ad3a7dc3d74903ef2e4/users/0d4f946db6774a0fa9dbfd1c0816bf3d/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:27.162338 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830484dc-ccc9-4f21-a283-4fb735c34c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2193255399ef4ad3a7dc3d74903ef2e4, user_id=0d4f946db6774a0fa9dbfd1c0816bf3d, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:27.165920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830484dc-ccc9-4f21-a283-4fb735c34c63 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:27.308587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 930/1872] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:27 2022] PUT /identity/v3/projects/2193255399ef4ad3a7dc3d74903ef2e4/users/0d4f946db6774a0fa9dbfd1c0816bf3d/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:27.318905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39d01c-f210-4701-ac3f-35a1e8e20bc6 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:27.319203 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39d01c-f210-4701-ac3f-35a1e8e20bc6 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:27.319538 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39d01c-f210-4701-ac3f-35a1e8e20bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:27.352499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-5f39d01c-f210-4701-ac3f-35a1e8e20bc6 None None] MFA Rules not processed for user `0d4f946db6774a0fa9dbfd1c0816bf3d`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:27.353432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5f39d01c-f210-4701-ac3f-35a1e8e20bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:27.446237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 943/1873] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:27.451021 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830484dc-ccc9-4f21-a283-4fb735c34c63 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:27.524991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830484dc-ccc9-4f21-a283-4fb735c34c63 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:27.534163 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8b0ff-3f1f-42bd-ab58-5a6c0dd0795c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:27.535409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8b0ff-3f1f-42bd-ab58-5a6c0dd0795c admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:27.535639 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8b0ff-3f1f-42bd-ab58-5a6c0dd0795c admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:27.535925 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8b0ff-3f1f-42bd-ab58-5a6c0dd0795c admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:27.536609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8b0ff-3f1f-42bd-ab58-5a6c0dd0795c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:27.542495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8b0ff-3f1f-42bd-ab58-5a6c0dd0795c admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:27.603194 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9061b-422e-46ef-a136-1bdbd64af214 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:27.603393 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9061b-422e-46ef-a136-1bdbd64af214 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:27.607344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9061b-422e-46ef-a136-1bdbd64af214 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:27.607344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 944/1874] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jul 26 15:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:00:27.616032 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47818f11-6e19-47b2-b20e-1054ec89882c None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:27.616430 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47818f11-6e19-47b2-b20e-1054ec89882c None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:27.616760 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47818f11-6e19-47b2-b20e-1054ec89882c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:27.639247 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-47818f11-6e19-47b2-b20e-1054ec89882c None None] MFA Rules not processed for user `d12fc26e640f4337b4a4da60cc4d9adc`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:27.641076 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-47818f11-6e19-47b2-b20e-1054ec89882c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:27.680154 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 931/1875] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:27 2022] POST /identity/v3/projects => generated 387 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:27.683758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8b0ff-3f1f-42bd-ab58-5a6c0dd0795c admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:27.795993 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 945/1876] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jul 26 15:00:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:27.816339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8b0ff-3f1f-42bd-ab58-5a6c0dd0795c admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:27.831301 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd579f-5464-4718-bc66-4686ccf6d7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:27.831632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd579f-5464-4718-bc66-4686ccf6d7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:27.831912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd579f-5464-4718-bc66-4686ccf6d7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:27.832605 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd579f-5464-4718-bc66-4686ccf6d7f1 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:27.832897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd579f-5464-4718-bc66-4686ccf6d7f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:27.835098 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd579f-5464-4718-bc66-4686ccf6d7f1 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:27.881715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47818f11-6e19-47b2-b20e-1054ec89882c None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:27.883727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-47818f11-6e19-47b2-b20e-1054ec89882c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:27.897560 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47818f11-6e19-47b2-b20e-1054ec89882c None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:27.962777 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f631225-cd77-4570-97e9-1d3ea6e968ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:27.963405 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f631225-cd77-4570-97e9-1d3ea6e968ad service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:27.963691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f631225-cd77-4570-97e9-1d3ea6e968ad service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:27.963969 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f631225-cd77-4570-97e9-1d3ea6e968ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:27.972844 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f631225-cd77-4570-97e9-1d3ea6e968ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:27.974475 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f631225-cd77-4570-97e9-1d3ea6e968ad service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:27.985619 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 946/1877] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:28.021799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 932/1878] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:27 2022] POST /identity/v3/users => generated 300 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:28.023396 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f631225-cd77-4570-97e9-1d3ea6e968ad service nova] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:28.032548 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:28.039279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f631225-cd77-4570-97e9-1d3ea6e968ad service nova] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:28.044252 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a8324-44ff-4a25-9629-5b5700effe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:28.044944 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a8324-44ff-4a25-9629-5b5700effe9e admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:28.045232 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a8324-44ff-4a25-9629-5b5700effe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:28.045512 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a8324-44ff-4a25-9629-5b5700effe9e admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:28.046405 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a8324-44ff-4a25-9629-5b5700effe9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:28.048028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a8324-44ff-4a25-9629-5b5700effe9e admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:28.064241 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 947/1879] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:28.066446 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd579f-5464-4718-bc66-4686ccf6d7f1 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:28.077472 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd579f-5464-4718-bc66-4686ccf6d7f1 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:28.083456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f8b93-64d3-4c3f-8c06-fb2ae87ada3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:28.084135 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f8b93-64d3-4c3f-8c06-fb2ae87ada3c admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:28.084417 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f8b93-64d3-4c3f-8c06-fb2ae87ada3c admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:28.085236 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f8b93-64d3-4c3f-8c06-fb2ae87ada3c admin admin] PATH_INFO: `/v3/projects/b876dcc994734df7ab3dc0cad6294b7a/users/c1da73526cb04e44a8a51ccc5e31cbb2/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:28.106079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f8b93-64d3-4c3f-8c06-fb2ae87ada3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b876dcc994734df7ab3dc0cad6294b7a, user_id=c1da73526cb04e44a8a51ccc5e31cbb2, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:28.109030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f8b93-64d3-4c3f-8c06-fb2ae87ada3c admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:28.251445 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 933/1880] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:28 2022] PUT /identity/v3/projects/b876dcc994734df7ab3dc0cad6294b7a/users/c1da73526cb04e44a8a51ccc5e31cbb2/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:28.255991 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a8324-44ff-4a25-9629-5b5700effe9e admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:28.264666 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f8b93-64d3-4c3f-8c06-fb2ae87ada3c admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:28.266575 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-bf2f8b93-64d3-4c3f-8c06-fb2ae87ada3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:28.268331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a8324-44ff-4a25-9629-5b5700effe9e admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:28.339069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f8b93-64d3-4c3f-8c06-fb2ae87ada3c admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:28.342428 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28773f-29e7-4b19-8cb4-b5d4b06ac70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:28.344171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28773f-29e7-4b19-8cb4-b5d4b06ac70a admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:28.350849 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28773f-29e7-4b19-8cb4-b5d4b06ac70a admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:28.350849 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28773f-29e7-4b19-8cb4-b5d4b06ac70a admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:28.350849 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28773f-29e7-4b19-8cb4-b5d4b06ac70a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:28.351863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb2f23-500e-439d-98cf-b63b60aec96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:28.351863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb2f23-500e-439d-98cf-b63b60aec96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:28.351863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb2f23-500e-439d-98cf-b63b60aec96f admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:28.352077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28773f-29e7-4b19-8cb4-b5d4b06ac70a admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:28.352147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb2f23-500e-439d-98cf-b63b60aec96f admin admin] PATH_INFO: `/v3/users/ad70c928faef4739af784d73b432ab55` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:28.353264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb2f23-500e-439d-98cf-b63b60aec96f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad70c928faef4739af784d73b432ab55)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:28.355365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb2f23-500e-439d-98cf-b63b60aec96f admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:28.359962 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 948/1881] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:28.364524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28773f-29e7-4b19-8cb4-b5d4b06ac70a admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:28.377511 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28773f-29e7-4b19-8cb4-b5d4b06ac70a admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:28.383783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433abf7-315b-49ca-9106-02746f4995c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:28.385012 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433abf7-315b-49ca-9106-02746f4995c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:28.385489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433abf7-315b-49ca-9106-02746f4995c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:28.385938 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433abf7-315b-49ca-9106-02746f4995c6 admin admin] PATH_INFO: `/v3/projects/b876dcc994734df7ab3dc0cad6294b7a/users/c1da73526cb04e44a8a51ccc5e31cbb2/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:28.388802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433abf7-315b-49ca-9106-02746f4995c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b876dcc994734df7ab3dc0cad6294b7a, user_id=c1da73526cb04e44a8a51ccc5e31cbb2, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:28.391786 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433abf7-315b-49ca-9106-02746f4995c6 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:28.411434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 949/1882] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:28 2022] PUT /identity/v3/projects/b876dcc994734df7ab3dc0cad6294b7a/users/c1da73526cb04e44a8a51ccc5e31cbb2/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:00:28.417167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890167c-4541-45bf-802d-fb6e7bae2dd8 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:28.417167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890167c-4541-45bf-802d-fb6e7bae2dd8 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:28.417167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890167c-4541-45bf-802d-fb6e7bae2dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:28.450870 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:28.454293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-e890167c-4541-45bf-802d-fb6e7bae2dd8 None None] MFA Rules not processed for user `c1da73526cb04e44a8a51ccc5e31cbb2`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:28.455615 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e890167c-4541-45bf-802d-fb6e7bae2dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:28.536979 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 950/1883] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:00:28.548284 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890167c-4541-45bf-802d-fb6e7bae2dd8 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:28.602906 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890167c-4541-45bf-802d-fb6e7bae2dd8 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:28.606603 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2886c2-e60b-4302-bdda-2ad652bbafa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:28.607253 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2886c2-e60b-4302-bdda-2ad652bbafa1 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:28.607535 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2886c2-e60b-4302-bdda-2ad652bbafa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:28.607808 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2886c2-e60b-4302-bdda-2ad652bbafa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:28.616147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-00fb2f23-500e-439d-98cf-b63b60aec96f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad70c928faef4739af784d73b432ab55'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:28.618912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2886c2-e60b-4302-bdda-2ad652bbafa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:28.620344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2886c2-e60b-4302-bdda-2ad652bbafa1 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:28.623554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-00fb2f23-500e-439d-98cf-b63b60aec96f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad70c928faef4739af784d73b432ab55'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:28.629689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 951/1884] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:00:28.640330 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-00fb2f23-500e-439d-98cf-b63b60aec96f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad70c928faef4739af784d73b432ab55'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:28.640330 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-00fb2f23-500e-439d-98cf-b63b60aec96f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad70c928faef4739af784d73b432ab55'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:28.640330 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-00fb2f23-500e-439d-98cf-b63b60aec96f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad70c928faef4739af784d73b432ab55'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:28.807823 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 934/1885] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:28 2022] DELETE /identity/v3/users/ad70c928faef4739af784d73b432ab55 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:00:28.812314 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b598d1b-f4b4-458d-96ab-a74ec83856c5 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:28.812609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b598d1b-f4b4-458d-96ab-a74ec83856c5 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:28.812895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b598d1b-f4b4-458d-96ab-a74ec83856c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:28.832385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-4b598d1b-f4b4-458d-96ab-a74ec83856c5 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:28.833703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4b598d1b-f4b4-458d-96ab-a74ec83856c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:28.898853 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 952/1886] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:28.908618 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb2f23-500e-439d-98cf-b63b60aec96f admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:28.910141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-00fb2f23-500e-439d-98cf-b63b60aec96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:28.974247 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb2f23-500e-439d-98cf-b63b60aec96f admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:28.981575 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43529f78-83ba-4a95-9f2f-147dc78478da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:28.984342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43529f78-83ba-4a95-9f2f-147dc78478da service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:28.984798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43529f78-83ba-4a95-9f2f-147dc78478da service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:28.985238 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43529f78-83ba-4a95-9f2f-147dc78478da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:29.002926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43529f78-83ba-4a95-9f2f-147dc78478da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:29.004524 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43529f78-83ba-4a95-9f2f-147dc78478da service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:29.020218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 935/1887] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:29.744850 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b598d1b-f4b4-458d-96ab-a74ec83856c5 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:29.747547 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4b598d1b-f4b4-458d-96ab-a74ec83856c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:29.777690 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b598d1b-f4b4-458d-96ab-a74ec83856c5 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:29.791057 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856e434-1c49-42fc-9be0-84554cc5b671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:29.792035 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856e434-1c49-42fc-9be0-84554cc5b671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:29.792561 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856e434-1c49-42fc-9be0-84554cc5b671 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:29.793041 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856e434-1c49-42fc-9be0-84554cc5b671 admin admin] PATH_INFO: `/v3/projects/989991b8dfef41638e4bf68ac0562acd` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:29.796365 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856e434-1c49-42fc-9be0-84554cc5b671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=989991b8dfef41638e4bf68ac0562acd)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:29.799060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856e434-1c49-42fc-9be0-84554cc5b671 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:29.946805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d856e434-1c49-42fc-9be0-84554cc5b671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '989991b8dfef41638e4bf68ac0562acd', 'request_id': 'req-d856e434-1c49-42fc-9be0-84554cc5b671'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:29.953769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d856e434-1c49-42fc-9be0-84554cc5b671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '989991b8dfef41638e4bf68ac0562acd', 'request_id': 'req-d856e434-1c49-42fc-9be0-84554cc5b671'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:29.961528 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d856e434-1c49-42fc-9be0-84554cc5b671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '989991b8dfef41638e4bf68ac0562acd', 'request_id': 'req-d856e434-1c49-42fc-9be0-84554cc5b671'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:30.081465 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d856e434-1c49-42fc-9be0-84554cc5b671 admin admin] The token cache is being invalidate because project 989991b8dfef41638e4bf68ac0562acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:30.081616 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d856e434-1c49-42fc-9be0-84554cc5b671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:30.083521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d856e434-1c49-42fc-9be0-84554cc5b671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:30.088924 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 953/1888] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:29 2022] DELETE /identity/v3/projects/989991b8dfef41638e4bf68ac0562acd => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:30.093333 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43529f78-83ba-4a95-9f2f-147dc78478da service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:30.113547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43529f78-83ba-4a95-9f2f-147dc78478da service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:30.223322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856e434-1c49-42fc-9be0-84554cc5b671 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:30.224868 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d856e434-1c49-42fc-9be0-84554cc5b671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:30.288775 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:30.295625 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13a7ec-8599-47c5-8052-e549c7bf9ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:30.298514 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13a7ec-8599-47c5-8052-e549c7bf9ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:30.299191 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13a7ec-8599-47c5-8052-e549c7bf9ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:30.299477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13a7ec-8599-47c5-8052-e549c7bf9ebb admin admin] PATH_INFO: `/v3/users/76e56b1d82c04a7eb2bed17d20e3c5a3` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:30.303823 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13a7ec-8599-47c5-8052-e549c7bf9ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=76e56b1d82c04a7eb2bed17d20e3c5a3)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:30.310645 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13a7ec-8599-47c5-8052-e549c7bf9ebb admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:30.339356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856e434-1c49-42fc-9be0-84554cc5b671 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:30.345649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aff631-2014-4425-b4fa-d549ced31f22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:30.346730 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aff631-2014-4425-b4fa-d549ced31f22 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:30.346730 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aff631-2014-4425-b4fa-d549ced31f22 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:30.347041 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aff631-2014-4425-b4fa-d549ced31f22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:30.348724 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-59aff631-2014-4425-b4fa-d549ced31f22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:30.449465 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aff631-2014-4425-b4fa-d549ced31f22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:30.451306 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aff631-2014-4425-b4fa-d549ced31f22 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:30.469929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 954/1889] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:00:30.620665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-9f13a7ec-8599-47c5-8052-e549c7bf9ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76e56b1d82c04a7eb2bed17d20e3c5a3'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:30.629472 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-9f13a7ec-8599-47c5-8052-e549c7bf9ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76e56b1d82c04a7eb2bed17d20e3c5a3'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:30.642596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-9f13a7ec-8599-47c5-8052-e549c7bf9ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76e56b1d82c04a7eb2bed17d20e3c5a3'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:30.643592 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-9f13a7ec-8599-47c5-8052-e549c7bf9ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76e56b1d82c04a7eb2bed17d20e3c5a3'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:30.644730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-9f13a7ec-8599-47c5-8052-e549c7bf9ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76e56b1d82c04a7eb2bed17d20e3c5a3'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:30.794075 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 936/1890] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:30 2022] DELETE /identity/v3/users/76e56b1d82c04a7eb2bed17d20e3c5a3 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:00:30.923931 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:31.363666 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aff631-2014-4425-b4fa-d549ced31f22 service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:31.365189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-59aff631-2014-4425-b4fa-d549ced31f22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:31.381754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aff631-2014-4425-b4fa-d549ced31f22 service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:31.453824 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee61c5c-f43e-43ac-9486-4809f41d8318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:31.454517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee61c5c-f43e-43ac-9486-4809f41d8318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:31.454795 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee61c5c-f43e-43ac-9486-4809f41d8318 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:31.455143 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee61c5c-f43e-43ac-9486-4809f41d8318 admin admin] PATH_INFO: `/v3/projects/3df0417b68054b62a0033b465ff5d4f4` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:31.456580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee61c5c-f43e-43ac-9486-4809f41d8318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df0417b68054b62a0033b465ff5d4f4)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:31.458517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee61c5c-f43e-43ac-9486-4809f41d8318 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:31.646423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-cee61c5c-f43e-43ac-9486-4809f41d8318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df0417b68054b62a0033b465ff5d4f4', 'request_id': 'req-cee61c5c-f43e-43ac-9486-4809f41d8318'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:31.660277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-cee61c5c-f43e-43ac-9486-4809f41d8318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df0417b68054b62a0033b465ff5d4f4', 'request_id': 'req-cee61c5c-f43e-43ac-9486-4809f41d8318'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:31.686906 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-cee61c5c-f43e-43ac-9486-4809f41d8318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df0417b68054b62a0033b465ff5d4f4', 'request_id': 'req-cee61c5c-f43e-43ac-9486-4809f41d8318'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:31.807182 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-cee61c5c-f43e-43ac-9486-4809f41d8318 admin admin] The token cache is being invalidate because project 3df0417b68054b62a0033b465ff5d4f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:31.807777 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-cee61c5c-f43e-43ac-9486-4809f41d8318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:31.808691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-cee61c5c-f43e-43ac-9486-4809f41d8318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:31.814857 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 955/1891] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:31 2022] DELETE /identity/v3/projects/3df0417b68054b62a0033b465ff5d4f4 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:31.817401 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59ebe2-2f07-4fba-b6b9-41bdcc8ee1b6 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:31.822423 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59ebe2-2f07-4fba-b6b9-41bdcc8ee1b6 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:31.822423 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59ebe2-2f07-4fba-b6b9-41bdcc8ee1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:31.839949 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-7d59ebe2-2f07-4fba-b6b9-41bdcc8ee1b6 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:31.841489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-7d59ebe2-2f07-4fba-b6b9-41bdcc8ee1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:31.916977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 937/1892] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:31.926638 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32955b7e-6b0e-4813-911c-fd902af39b8d None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:31.927180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32955b7e-6b0e-4813-911c-fd902af39b8d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:31.927585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32955b7e-6b0e-4813-911c-fd902af39b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:31.949252 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-32955b7e-6b0e-4813-911c-fd902af39b8d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:31.950558 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-32955b7e-6b0e-4813-911c-fd902af39b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:31.958585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 956/1893] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:00:31.963067 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59ebe2-2f07-4fba-b6b9-41bdcc8ee1b6 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:31.975088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59ebe2-2f07-4fba-b6b9-41bdcc8ee1b6 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:31.982533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454c583-a138-4f05-a41d-2a4b9ef39332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:31.983787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454c583-a138-4f05-a41d-2a4b9ef39332 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:31.984078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454c583-a138-4f05-a41d-2a4b9ef39332 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:31.984640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454c583-a138-4f05-a41d-2a4b9ef39332 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:31.985713 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454c583-a138-4f05-a41d-2a4b9ef39332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:31.986027 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454c583-a138-4f05-a41d-2a4b9ef39332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:31.987758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454c583-a138-4f05-a41d-2a4b9ef39332 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:31.989974 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:32.004264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 938/1894] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:32.009478 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32955b7e-6b0e-4813-911c-fd902af39b8d None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:32.020152 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32955b7e-6b0e-4813-911c-fd902af39b8d None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:32.025063 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc499d7-8184-4716-9f9d-8c8ac7637ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:32.026595 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc499d7-8184-4716-9f9d-8c8ac7637ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:32.026595 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc499d7-8184-4716-9f9d-8c8ac7637ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:32.026595 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc499d7-8184-4716-9f9d-8c8ac7637ad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:32.027053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc499d7-8184-4716-9f9d-8c8ac7637ad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:32.028945 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc499d7-8184-4716-9f9d-8c8ac7637ad3 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:32.133329 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 957/1895] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:32 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:32.137820 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454c583-a138-4f05-a41d-2a4b9ef39332 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:32.148773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454c583-a138-4f05-a41d-2a4b9ef39332 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:32.249348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c1b53-ae6e-49c7-80a6-34e97a20d501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:32.250128 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c1b53-ae6e-49c7-80a6-34e97a20d501 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:32.250518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c1b53-ae6e-49c7-80a6-34e97a20d501 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:32.250802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c1b53-ae6e-49c7-80a6-34e97a20d501 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:32.254662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c1b53-ae6e-49c7-80a6-34e97a20d501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:32.254662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c1b53-ae6e-49c7-80a6-34e97a20d501 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:32.344633 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 939/1896] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:32 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:32.348689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc499d7-8184-4716-9f9d-8c8ac7637ad3 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:32.359683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc499d7-8184-4716-9f9d-8c8ac7637ad3 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:32.364326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ceaf1-359f-47d0-b75b-61e3bff7aa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:32.364948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ceaf1-359f-47d0-b75b-61e3bff7aa42 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:32.365237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ceaf1-359f-47d0-b75b-61e3bff7aa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:32.365614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ceaf1-359f-47d0-b75b-61e3bff7aa42 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:32.368935 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ceaf1-359f-47d0-b75b-61e3bff7aa42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:32.370623 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ceaf1-359f-47d0-b75b-61e3bff7aa42 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:32.381121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 958/1897] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:32.385110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c1b53-ae6e-49c7-80a6-34e97a20d501 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:32.395327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c1b53-ae6e-49c7-80a6-34e97a20d501 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:32.399980 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ad00b-6277-4dd4-ab09-5046187df842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:32.400588 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ad00b-6277-4dd4-ab09-5046187df842 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:32.400874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ad00b-6277-4dd4-ab09-5046187df842 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:32.401154 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ad00b-6277-4dd4-ab09-5046187df842 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:32.405341 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ad00b-6277-4dd4-ab09-5046187df842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:32.405341 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ad00b-6277-4dd4-ab09-5046187df842 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:32.414952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 940/1898] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:00:32.419016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ceaf1-359f-47d0-b75b-61e3bff7aa42 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:32.428909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ceaf1-359f-47d0-b75b-61e3bff7aa42 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:32.433969 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6ecd6-0c2b-44b2-9d1f-33c37bcdbb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:32.434671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6ecd6-0c2b-44b2-9d1f-33c37bcdbb70 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:32.434961 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6ecd6-0c2b-44b2-9d1f-33c37bcdbb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:32.435244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6ecd6-0c2b-44b2-9d1f-33c37bcdbb70 admin admin] PATH_INFO: `/v3/projects/e91a389d6a264356904c51a06f0c6764/users/518e3d9b2e584602835a7b26b260c8e7/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:32.450334 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6ecd6-0c2b-44b2-9d1f-33c37bcdbb70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91a389d6a264356904c51a06f0c6764, user_id=518e3d9b2e584602835a7b26b260c8e7, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:32.453292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6ecd6-0c2b-44b2-9d1f-33c37bcdbb70 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:32.567872 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 959/1899] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:32 2022] PUT /identity/v3/projects/e91a389d6a264356904c51a06f0c6764/users/518e3d9b2e584602835a7b26b260c8e7/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:32.579068 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c91f4-e3fb-48af-a3df-34a281cd69e8 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:32.579359 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c91f4-e3fb-48af-a3df-34a281cd69e8 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:32.579652 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c91f4-e3fb-48af-a3df-34a281cd69e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:32.609089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-ec8c91f4-e3fb-48af-a3df-34a281cd69e8 None None] MFA Rules not processed for user `518e3d9b2e584602835a7b26b260c8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:32.610536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ec8c91f4-e3fb-48af-a3df-34a281cd69e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:32.715429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 941/1900] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:32.718992 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6ecd6-0c2b-44b2-9d1f-33c37bcdbb70 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:32.756147 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:32.796079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6ecd6-0c2b-44b2-9d1f-33c37bcdbb70 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:32.801928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79a073-9f26-4516-8234-9d6bedac1e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:32.802631 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79a073-9f26-4516-8234-9d6bedac1e06 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:32.802925 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79a073-9f26-4516-8234-9d6bedac1e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:32.803212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79a073-9f26-4516-8234-9d6bedac1e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:32.804278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79a073-9f26-4516-8234-9d6bedac1e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:32.806796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79a073-9f26-4516-8234-9d6bedac1e06 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:32.968331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 960/1901] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:32 2022] POST /identity/v3/projects => generated 375 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:32.969466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c91f4-e3fb-48af-a3df-34a281cd69e8 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:32.981538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c91f4-e3fb-48af-a3df-34a281cd69e8 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:33.044966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2cd51-5ff5-482f-a022-d18e64e983e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:33.045609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2cd51-5ff5-482f-a022-d18e64e983e1 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:33.046034 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2cd51-5ff5-482f-a022-d18e64e983e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:33.046249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2cd51-5ff5-482f-a022-d18e64e983e1 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:33.061432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2cd51-5ff5-482f-a022-d18e64e983e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:33.061432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2cd51-5ff5-482f-a022-d18e64e983e1 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:33.138935 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 942/1902] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:32 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:33.142944 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79a073-9f26-4516-8234-9d6bedac1e06 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:33.153559 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79a073-9f26-4516-8234-9d6bedac1e06 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:33.159188 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9af236-5bd0-4239-895a-390c61222d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:33.159810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9af236-5bd0-4239-895a-390c61222d79 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:33.160196 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9af236-5bd0-4239-895a-390c61222d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:33.160483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9af236-5bd0-4239-895a-390c61222d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:33.161214 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9af236-5bd0-4239-895a-390c61222d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:33.162910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9af236-5bd0-4239-895a-390c61222d79 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:33.175230 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 961/1903] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:33.179310 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2cd51-5ff5-482f-a022-d18e64e983e1 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:33.190071 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2cd51-5ff5-482f-a022-d18e64e983e1 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:33.194979 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98ff1b-4422-483f-91ff-ba101875afa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:33.195710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98ff1b-4422-483f-91ff-ba101875afa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:33.195994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98ff1b-4422-483f-91ff-ba101875afa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:33.196274 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98ff1b-4422-483f-91ff-ba101875afa4 admin admin] PATH_INFO: `/v3/projects/a58968ad4b2a46f18beb42511b500106/users/d4981f9cdbd74039bef8fa22ef2fe243/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:33.210974 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98ff1b-4422-483f-91ff-ba101875afa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58968ad4b2a46f18beb42511b500106, user_id=d4981f9cdbd74039bef8fa22ef2fe243, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:33.214137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98ff1b-4422-483f-91ff-ba101875afa4 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:33.298789 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 943/1904] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:33 2022] PUT /identity/v3/projects/a58968ad4b2a46f18beb42511b500106/users/d4981f9cdbd74039bef8fa22ef2fe243/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:33.303693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9af236-5bd0-4239-895a-390c61222d79 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:33.317999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9af236-5bd0-4239-895a-390c61222d79 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:33.382740 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bac78-aa25-472d-8cb8-7cbb34011174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:33.384213 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bac78-aa25-472d-8cb8-7cbb34011174 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:33.384534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bac78-aa25-472d-8cb8-7cbb34011174 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:33.384780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bac78-aa25-472d-8cb8-7cbb34011174 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:33.385013 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:33.385485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bac78-aa25-472d-8cb8-7cbb34011174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:33.387268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bac78-aa25-472d-8cb8-7cbb34011174 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:33.401621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 962/1905] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:33.402858 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98ff1b-4422-483f-91ff-ba101875afa4 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:33.413455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98ff1b-4422-483f-91ff-ba101875afa4 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:33.418334 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90d1be-e386-4e4e-9748-8f5a10f37380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:33.419050 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90d1be-e386-4e4e-9748-8f5a10f37380 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:33.419335 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90d1be-e386-4e4e-9748-8f5a10f37380 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:33.419616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90d1be-e386-4e4e-9748-8f5a10f37380 admin admin] PATH_INFO: `/v3/projects/a58968ad4b2a46f18beb42511b500106/users/d4981f9cdbd74039bef8fa22ef2fe243/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:33.421581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90d1be-e386-4e4e-9748-8f5a10f37380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58968ad4b2a46f18beb42511b500106, user_id=d4981f9cdbd74039bef8fa22ef2fe243, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:33.424409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90d1be-e386-4e4e-9748-8f5a10f37380 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:33.436523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 944/1906] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:33 2022] PUT /identity/v3/projects/a58968ad4b2a46f18beb42511b500106/users/d4981f9cdbd74039bef8fa22ef2fe243/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:33.449576 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957af07-72e0-4a81-9856-19fc82a1d481 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:33.449876 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957af07-72e0-4a81-9856-19fc82a1d481 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:33.450163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957af07-72e0-4a81-9856-19fc82a1d481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:33.477281 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-8957af07-72e0-4a81-9856-19fc82a1d481 None None] MFA Rules not processed for user `d4981f9cdbd74039bef8fa22ef2fe243`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:33.478542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-8957af07-72e0-4a81-9856-19fc82a1d481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:33.552603 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 963/1907] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:33.567902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90d1be-e386-4e4e-9748-8f5a10f37380 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:33.569604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-6c90d1be-e386-4e4e-9748-8f5a10f37380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:33.625998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90d1be-e386-4e4e-9748-8f5a10f37380 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:33.629555 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254aa0b-fd51-462b-9c5b-b737aa220ff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:33.630164 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254aa0b-fd51-462b-9c5b-b737aa220ff5 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:33.630473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254aa0b-fd51-462b-9c5b-b737aa220ff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:33.630752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254aa0b-fd51-462b-9c5b-b737aa220ff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:33.692382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254aa0b-fd51-462b-9c5b-b737aa220ff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:33.694155 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254aa0b-fd51-462b-9c5b-b737aa220ff5 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:33.706284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 945/1908] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:33.726163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957af07-72e0-4a81-9856-19fc82a1d481 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:33.726550 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-8957af07-72e0-4a81-9856-19fc82a1d481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:33.825712 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957af07-72e0-4a81-9856-19fc82a1d481 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:33.830822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81b105-8052-479f-8c9b-91c01b91d302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:33.831488 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81b105-8052-479f-8c9b-91c01b91d302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:33.831781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81b105-8052-479f-8c9b-91c01b91d302 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:33.832068 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81b105-8052-479f-8c9b-91c01b91d302 admin admin] PATH_INFO: `/v3/users/c0ba2b7515e14bf29c3ca228dd487181` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:33.833273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81b105-8052-479f-8c9b-91c01b91d302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ba2b7515e14bf29c3ca228dd487181)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:33.835477 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81b105-8052-479f-8c9b-91c01b91d302 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:33.843071 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:34.119631 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-8b81b105-8052-479f-8c9b-91c01b91d302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ba2b7515e14bf29c3ca228dd487181'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:34.120399 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-8b81b105-8052-479f-8c9b-91c01b91d302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ba2b7515e14bf29c3ca228dd487181'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:34.148267 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-8b81b105-8052-479f-8c9b-91c01b91d302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ba2b7515e14bf29c3ca228dd487181'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:34.275451 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-8b81b105-8052-479f-8c9b-91c01b91d302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ba2b7515e14bf29c3ca228dd487181'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:34.276280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-8b81b105-8052-479f-8c9b-91c01b91d302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ba2b7515e14bf29c3ca228dd487181'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:34.298426 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 964/1909] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:33 2022] DELETE /identity/v3/users/c0ba2b7515e14bf29c3ca228dd487181 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:34.301051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205553ad-40e4-48fc-bda5-31c849d2bc8f None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:34.301523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205553ad-40e4-48fc-bda5-31c849d2bc8f None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:34.301649 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205553ad-40e4-48fc-bda5-31c849d2bc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:34.325569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-205553ad-40e4-48fc-bda5-31c849d2bc8f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:34.326804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-205553ad-40e4-48fc-bda5-31c849d2bc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:34.387817 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 946/1910] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:34.398201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81b105-8052-479f-8c9b-91c01b91d302 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:34.399775 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-8b81b105-8052-479f-8c9b-91c01b91d302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:34.461559 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81b105-8052-479f-8c9b-91c01b91d302 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:34.465287 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2b374-c4eb-4cd5-bf47-9e896433ee7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:34.466086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2b374-c4eb-4cd5-bf47-9e896433ee7a service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:34.466344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2b374-c4eb-4cd5-bf47-9e896433ee7a service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:34.466506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2b374-c4eb-4cd5-bf47-9e896433ee7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:34.483083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2b374-c4eb-4cd5-bf47-9e896433ee7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:34.483083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2b374-c4eb-4cd5-bf47-9e896433ee7a service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:34.489656 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 965/1911] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:34.933650 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205553ad-40e4-48fc-bda5-31c849d2bc8f None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:34.935175 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-205553ad-40e4-48fc-bda5-31c849d2bc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:34.948433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205553ad-40e4-48fc-bda5-31c849d2bc8f None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:34.953393 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4483b9-7b4b-4e57-bf55-8fdfb9649f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:34.954114 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4483b9-7b4b-4e57-bf55-8fdfb9649f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:34.954589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4483b9-7b4b-4e57-bf55-8fdfb9649f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:34.954968 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4483b9-7b4b-4e57-bf55-8fdfb9649f0b admin admin] PATH_INFO: `/v3/users/6eae8055a6044f64b477cddafcf8600c` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:34.956177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4483b9-7b4b-4e57-bf55-8fdfb9649f0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eae8055a6044f64b477cddafcf8600c)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:34.958148 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4483b9-7b4b-4e57-bf55-8fdfb9649f0b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:35.154460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5c4483b9-7b4b-4e57-bf55-8fdfb9649f0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eae8055a6044f64b477cddafcf8600c'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:35.161609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5c4483b9-7b4b-4e57-bf55-8fdfb9649f0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eae8055a6044f64b477cddafcf8600c'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:35.175537 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2b374-c4eb-4cd5-bf47-9e896433ee7a service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:35.177391 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-9de2b374-c4eb-4cd5-bf47-9e896433ee7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:35.180213 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5c4483b9-7b4b-4e57-bf55-8fdfb9649f0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eae8055a6044f64b477cddafcf8600c'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:35.180993 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5c4483b9-7b4b-4e57-bf55-8fdfb9649f0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eae8055a6044f64b477cddafcf8600c'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:35.181835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5c4483b9-7b4b-4e57-bf55-8fdfb9649f0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eae8055a6044f64b477cddafcf8600c'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:35.210707 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2b374-c4eb-4cd5-bf47-9e896433ee7a service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:35.231592 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36785450-979e-4c45-badc-080da7826300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:35.232500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36785450-979e-4c45-badc-080da7826300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:35.232787 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36785450-979e-4c45-badc-080da7826300 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:35.233076 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36785450-979e-4c45-badc-080da7826300 admin admin] PATH_INFO: `/v3/projects/aa1af62fe98b4676b401b3ea90fed04b` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:35.234825 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36785450-979e-4c45-badc-080da7826300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa1af62fe98b4676b401b3ea90fed04b)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:35.236966 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36785450-979e-4c45-badc-080da7826300 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:35.299950 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 947/1912] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:34 2022] DELETE /identity/v3/users/6eae8055a6044f64b477cddafcf8600c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:35.304479 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cec86-9048-4190-a47e-241c9fb11e19 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:35.305075 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cec86-9048-4190-a47e-241c9fb11e19 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:35.305211 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cec86-9048-4190-a47e-241c9fb11e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:35.326277 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-ae7cec86-9048-4190-a47e-241c9fb11e19 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:35.327580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ae7cec86-9048-4190-a47e-241c9fb11e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:35.401108 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 948/1913] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:00:35.410651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cec86-9048-4190-a47e-241c9fb11e19 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:35.412044 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ae7cec86-9048-4190-a47e-241c9fb11e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:35.422613 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-36785450-979e-4c45-badc-080da7826300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa1af62fe98b4676b401b3ea90fed04b', 'request_id': 'req-36785450-979e-4c45-badc-080da7826300'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:35.430613 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-36785450-979e-4c45-badc-080da7826300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa1af62fe98b4676b401b3ea90fed04b', 'request_id': 'req-36785450-979e-4c45-badc-080da7826300'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:35.436716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-36785450-979e-4c45-badc-080da7826300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa1af62fe98b4676b401b3ea90fed04b', 'request_id': 'req-36785450-979e-4c45-badc-080da7826300'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:35.474181 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cec86-9048-4190-a47e-241c9fb11e19 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:35.524330 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a18f79-602d-4f1c-8fa4-81419a451a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:35.524960 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a18f79-602d-4f1c-8fa4-81419a451a6d service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:35.525302 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a18f79-602d-4f1c-8fa4-81419a451a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:35.525544 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a18f79-602d-4f1c-8fa4-81419a451a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:35.546138 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-36785450-979e-4c45-badc-080da7826300 admin admin] The token cache is being invalidate because project aa1af62fe98b4676b401b3ea90fed04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:35.546840 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-36785450-979e-4c45-badc-080da7826300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:35.549038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-36785450-979e-4c45-badc-080da7826300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:35.551026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 966/1914] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:35 2022] DELETE /identity/v3/projects/aa1af62fe98b4676b401b3ea90fed04b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:35.556443 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36785450-979e-4c45-badc-080da7826300 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:35.558149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-36785450-979e-4c45-badc-080da7826300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:35.597759 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a18f79-602d-4f1c-8fa4-81419a451a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:35.599361 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a18f79-602d-4f1c-8fa4-81419a451a6d service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:35.610150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 949/1915] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:00:35.636390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36785450-979e-4c45-badc-080da7826300 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:35.636390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9fbe9-35c3-4da5-9dc1-f4f6747bf27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:35.636390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9fbe9-35c3-4da5-9dc1-f4f6747bf27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:35.636390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9fbe9-35c3-4da5-9dc1-f4f6747bf27d admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:35.636707 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9fbe9-35c3-4da5-9dc1-f4f6747bf27d admin admin] PATH_INFO: `/v3/users/487646cb341f476cae28d1fc1ca8d127` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:35.636707 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9fbe9-35c3-4da5-9dc1-f4f6747bf27d admin admin] RBAC: Authorizing `identity:delete_user(user_id=487646cb341f476cae28d1fc1ca8d127)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:35.636707 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9fbe9-35c3-4da5-9dc1-f4f6747bf27d admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:35.859290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:35.954877 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-4cb9fbe9-35c3-4da5-9dc1-f4f6747bf27d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '487646cb341f476cae28d1fc1ca8d127'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:35.957472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-4cb9fbe9-35c3-4da5-9dc1-f4f6747bf27d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '487646cb341f476cae28d1fc1ca8d127'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:35.980015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-4cb9fbe9-35c3-4da5-9dc1-f4f6747bf27d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '487646cb341f476cae28d1fc1ca8d127'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:36.110114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-4cb9fbe9-35c3-4da5-9dc1-f4f6747bf27d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '487646cb341f476cae28d1fc1ca8d127'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:36.111478 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-4cb9fbe9-35c3-4da5-9dc1-f4f6747bf27d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '487646cb341f476cae28d1fc1ca8d127'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:36.128223 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 967/1916] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:35 2022] DELETE /identity/v3/users/487646cb341f476cae28d1fc1ca8d127 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:00:36.275985 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a18f79-602d-4f1c-8fa4-81419a451a6d service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:36.277444 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-20a18f79-602d-4f1c-8fa4-81419a451a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:36.302020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a18f79-602d-4f1c-8fa4-81419a451a6d service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:36.365829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2a8e6-205e-4327-93e8-95cd6e2a223b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:36.369956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2a8e6-205e-4327-93e8-95cd6e2a223b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:36.369956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2a8e6-205e-4327-93e8-95cd6e2a223b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:36.369956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2a8e6-205e-4327-93e8-95cd6e2a223b admin admin] PATH_INFO: `/v3/projects/c571a75696014d6594eb2ef814a99a17` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:36.369956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2a8e6-205e-4327-93e8-95cd6e2a223b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c571a75696014d6594eb2ef814a99a17)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:36.370325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2a8e6-205e-4327-93e8-95cd6e2a223b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:36.533153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-46f2a8e6-205e-4327-93e8-95cd6e2a223b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c571a75696014d6594eb2ef814a99a17', 'request_id': 'req-46f2a8e6-205e-4327-93e8-95cd6e2a223b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:36.540839 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-46f2a8e6-205e-4327-93e8-95cd6e2a223b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c571a75696014d6594eb2ef814a99a17', 'request_id': 'req-46f2a8e6-205e-4327-93e8-95cd6e2a223b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:36.635583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-46f2a8e6-205e-4327-93e8-95cd6e2a223b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c571a75696014d6594eb2ef814a99a17', 'request_id': 'req-46f2a8e6-205e-4327-93e8-95cd6e2a223b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:36.650733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-46f2a8e6-205e-4327-93e8-95cd6e2a223b admin admin] The token cache is being invalidate because project c571a75696014d6594eb2ef814a99a17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:36.650733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-46f2a8e6-205e-4327-93e8-95cd6e2a223b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:36.650733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-46f2a8e6-205e-4327-93e8-95cd6e2a223b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:36.651274 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 950/1917] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:36 2022] DELETE /identity/v3/projects/c571a75696014d6594eb2ef814a99a17 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:36.655134 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9fbe9-35c3-4da5-9dc1-f4f6747bf27d admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:36.657324 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4cb9fbe9-35c3-4da5-9dc1-f4f6747bf27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:36.670925 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9fbe9-35c3-4da5-9dc1-f4f6747bf27d admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:36.681710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:36.749244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e513d6-8927-4e3f-9a48-b519a2a76a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:36.749910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e513d6-8927-4e3f-9a48-b519a2a76a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:36.750208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e513d6-8927-4e3f-9a48-b519a2a76a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:36.750551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e513d6-8927-4e3f-9a48-b519a2a76a1b admin admin] PATH_INFO: `/v3/users/c058ae2168e24114bc858e4b1566c33d` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:36.751934 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e513d6-8927-4e3f-9a48-b519a2a76a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c058ae2168e24114bc858e4b1566c33d)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:36.753934 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e513d6-8927-4e3f-9a48-b519a2a76a1b admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:36.998896 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2a8e6-205e-4327-93e8-95cd6e2a223b admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:37.000583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-46f2a8e6-205e-4327-93e8-95cd6e2a223b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:37.010670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c5e513d6-8927-4e3f-9a48-b519a2a76a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c058ae2168e24114bc858e4b1566c33d'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:37.011301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c5e513d6-8927-4e3f-9a48-b519a2a76a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c058ae2168e24114bc858e4b1566c33d'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:37.017317 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2a8e6-205e-4327-93e8-95cd6e2a223b admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:37.022826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a065e6-625d-402f-93d7-6f53d6a182e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:37.025267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a065e6-625d-402f-93d7-6f53d6a182e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:37.025267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a065e6-625d-402f-93d7-6f53d6a182e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:37.025267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a065e6-625d-402f-93d7-6f53d6a182e1 admin admin] PATH_INFO: `/v3/projects/89442169f0764c239891383526764557` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:37.026372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a065e6-625d-402f-93d7-6f53d6a182e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89442169f0764c239891383526764557)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:37.029269 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a065e6-625d-402f-93d7-6f53d6a182e1 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:37.033340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c5e513d6-8927-4e3f-9a48-b519a2a76a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c058ae2168e24114bc858e4b1566c33d'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:37.093788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c5e513d6-8927-4e3f-9a48-b519a2a76a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c058ae2168e24114bc858e4b1566c33d'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:37.094603 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c5e513d6-8927-4e3f-9a48-b519a2a76a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c058ae2168e24114bc858e4b1566c33d'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:37.124926 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 968/1918] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:36 2022] DELETE /identity/v3/users/c058ae2168e24114bc858e4b1566c33d => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:37.191006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-52a065e6-625d-402f-93d7-6f53d6a182e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89442169f0764c239891383526764557', 'request_id': 'req-52a065e6-625d-402f-93d7-6f53d6a182e1'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:37.197882 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-52a065e6-625d-402f-93d7-6f53d6a182e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89442169f0764c239891383526764557', 'request_id': 'req-52a065e6-625d-402f-93d7-6f53d6a182e1'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:37.321696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-52a065e6-625d-402f-93d7-6f53d6a182e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89442169f0764c239891383526764557', 'request_id': 'req-52a065e6-625d-402f-93d7-6f53d6a182e1'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:37.337155 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-52a065e6-625d-402f-93d7-6f53d6a182e1 admin admin] The token cache is being invalidate because project 89442169f0764c239891383526764557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:37.337791 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-52a065e6-625d-402f-93d7-6f53d6a182e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:37.338638 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-52a065e6-625d-402f-93d7-6f53d6a182e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:37.340705 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 951/1919] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:36 2022] DELETE /identity/v3/projects/89442169f0764c239891383526764557 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:37.346362 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726776e-c0a7-4313-98e6-cb89aa2acb80 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:37.346692 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726776e-c0a7-4313-98e6-cb89aa2acb80 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:37.346979 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726776e-c0a7-4313-98e6-cb89aa2acb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:37.376455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-a726776e-c0a7-4313-98e6-cb89aa2acb80 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:37.378436 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a726776e-c0a7-4313-98e6-cb89aa2acb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:37.441618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 969/1920] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:37.449528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d02608-9ea0-4163-b756-28950f23aba0 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:37.450025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d02608-9ea0-4163-b756-28950f23aba0 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:37.450134 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d02608-9ea0-4163-b756-28950f23aba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:37.470378 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-f7d02608-9ea0-4163-b756-28950f23aba0 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:37.471645 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f7d02608-9ea0-4163-b756-28950f23aba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:37.485303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 952/1921] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:37.486215 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726776e-c0a7-4313-98e6-cb89aa2acb80 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:37.496649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726776e-c0a7-4313-98e6-cb89aa2acb80 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:37.501142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5835704-c9d9-4808-91cb-5ffbf41e0dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:37.501750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5835704-c9d9-4808-91cb-5ffbf41e0dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:37.502031 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5835704-c9d9-4808-91cb-5ffbf41e0dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:37.502305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5835704-c9d9-4808-91cb-5ffbf41e0dd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:37.503057 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5835704-c9d9-4808-91cb-5ffbf41e0dd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:37.503361 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5835704-c9d9-4808-91cb-5ffbf41e0dd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:37.504938 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5835704-c9d9-4808-91cb-5ffbf41e0dd6 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:37.516750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 970/1922] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:37.522025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d02608-9ea0-4163-b756-28950f23aba0 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:37.531565 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d02608-9ea0-4163-b756-28950f23aba0 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:37.536324 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25caec-dfc3-4fc8-a6d2-6bd12d3ca34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:37.536943 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25caec-dfc3-4fc8-a6d2-6bd12d3ca34e admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:37.537231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25caec-dfc3-4fc8-a6d2-6bd12d3ca34e admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:37.537515 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25caec-dfc3-4fc8-a6d2-6bd12d3ca34e admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:37.538225 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25caec-dfc3-4fc8-a6d2-6bd12d3ca34e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:37.540723 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25caec-dfc3-4fc8-a6d2-6bd12d3ca34e admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:37.638788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5835704-c9d9-4808-91cb-5ffbf41e0dd6 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:37.640616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 953/1923] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:37 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:37.642652 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e5835704-c9d9-4808-91cb-5ffbf41e0dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:37.648435 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25caec-dfc3-4fc8-a6d2-6bd12d3ca34e admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:37.659459 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5835704-c9d9-4808-91cb-5ffbf41e0dd6 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:37.740980 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25caec-dfc3-4fc8-a6d2-6bd12d3ca34e admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:37.741611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1701e0-641c-4fb8-baad-2790e497e8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:37.742272 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1701e0-641c-4fb8-baad-2790e497e8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:37.742822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1701e0-641c-4fb8-baad-2790e497e8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:37.743108 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1701e0-641c-4fb8-baad-2790e497e8a6 admin admin] PATH_INFO: `/v3/projects/b2ed095a71ec4d9cb40c6392777a9d89` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:37.744342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1701e0-641c-4fb8-baad-2790e497e8a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2ed095a71ec4d9cb40c6392777a9d89)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:37.746559 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1701e0-641c-4fb8-baad-2790e497e8a6 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:37.749653 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdbd45-22fd-4691-9f99-5c4db93be067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:37.750516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdbd45-22fd-4691-9f99-5c4db93be067 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:37.750938 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdbd45-22fd-4691-9f99-5c4db93be067 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:37.751381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdbd45-22fd-4691-9f99-5c4db93be067 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:37.752346 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdbd45-22fd-4691-9f99-5c4db93be067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:37.754955 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdbd45-22fd-4691-9f99-5c4db93be067 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:37.837064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 954/1924] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:37 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:37.841061 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdbd45-22fd-4691-9f99-5c4db93be067 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:37.854707 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdbd45-22fd-4691-9f99-5c4db93be067 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:37.860357 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedc56b-7f97-447b-917c-41268fd4b734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:37.861048 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc56b-7f97-447b-917c-41268fd4b734 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:37.861455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc56b-7f97-447b-917c-41268fd4b734 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:37.861738 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc56b-7f97-447b-917c-41268fd4b734 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:37.865306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedc56b-7f97-447b-917c-41268fd4b734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:37.867036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedc56b-7f97-447b-917c-41268fd4b734 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:37.887591 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 955/1925] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:37.891957 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedc56b-7f97-447b-917c-41268fd4b734 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:37.896405 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7a1701e0-641c-4fb8-baad-2790e497e8a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2ed095a71ec4d9cb40c6392777a9d89', 'request_id': 'req-7a1701e0-641c-4fb8-baad-2790e497e8a6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:37.908315 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7a1701e0-641c-4fb8-baad-2790e497e8a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2ed095a71ec4d9cb40c6392777a9d89', 'request_id': 'req-7a1701e0-641c-4fb8-baad-2790e497e8a6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:37.910064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedc56b-7f97-447b-917c-41268fd4b734 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:37.914088 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7a1701e0-641c-4fb8-baad-2790e497e8a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2ed095a71ec4d9cb40c6392777a9d89', 'request_id': 'req-7a1701e0-641c-4fb8-baad-2790e497e8a6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:37.968914 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc827c-8647-461f-b4e7-3b5b8d3f2bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:37.969635 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc827c-8647-461f-b4e7-3b5b8d3f2bbd admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:37.970008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc827c-8647-461f-b4e7-3b5b8d3f2bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:37.970357 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc827c-8647-461f-b4e7-3b5b8d3f2bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:37.971215 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc827c-8647-461f-b4e7-3b5b8d3f2bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:37.973074 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc827c-8647-461f-b4e7-3b5b8d3f2bbd admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:37.984083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 956/1926] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:37.989471 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc827c-8647-461f-b4e7-3b5b8d3f2bbd admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:37.990657 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7a1701e0-641c-4fb8-baad-2790e497e8a6 admin admin] The token cache is being invalidate because project b2ed095a71ec4d9cb40c6392777a9d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:37.991024 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7a1701e0-641c-4fb8-baad-2790e497e8a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:37.991764 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7a1701e0-641c-4fb8-baad-2790e497e8a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:37.993565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 971/1927] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:37 2022] DELETE /identity/v3/projects/b2ed095a71ec4d9cb40c6392777a9d89 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:37.999259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b1e52-bc73-4a54-8793-6ab5b1db97f0 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:37.999800 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc827c-8647-461f-b4e7-3b5b8d3f2bbd admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:38.000047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b1e52-bc73-4a54-8793-6ab5b1db97f0 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:38.000637 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b1e52-bc73-4a54-8793-6ab5b1db97f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:38.004666 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35e7b6-a638-44e6-a8cb-ae28a7fb4769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:38.005348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35e7b6-a638-44e6-a8cb-ae28a7fb4769 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:38.005637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35e7b6-a638-44e6-a8cb-ae28a7fb4769 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:38.005917 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35e7b6-a638-44e6-a8cb-ae28a7fb4769 admin admin] PATH_INFO: `/v3/projects/20fe518000f14acca1e10c23287e0f4d/users/e343cd7c8b234f9f946df95a0d129e7d/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:38.023532 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35e7b6-a638-44e6-a8cb-ae28a7fb4769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20fe518000f14acca1e10c23287e0f4d, user_id=e343cd7c8b234f9f946df95a0d129e7d, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:38.026994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35e7b6-a638-44e6-a8cb-ae28a7fb4769 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:38.038100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-d82b1e52-bc73-4a54-8793-6ab5b1db97f0 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:38.039944 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d82b1e52-bc73-4a54-8793-6ab5b1db97f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:38.047801 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 972/1928] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:00:38.055871 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbaf05-bb40-40e2-af7d-db6e731deb00 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:38.056155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbaf05-bb40-40e2-af7d-db6e731deb00 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:38.057922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbaf05-bb40-40e2-af7d-db6e731deb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:38.081603 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-a4bbaf05-bb40-40e2-af7d-db6e731deb00 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:38.082894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a4bbaf05-bb40-40e2-af7d-db6e731deb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:38.091520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 973/1929] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:00:38.095633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbaf05-bb40-40e2-af7d-db6e731deb00 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:38.104919 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbaf05-bb40-40e2-af7d-db6e731deb00 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:38.109534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b0c7d-57d1-4e6c-96bd-57105d36dfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:38.110139 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b0c7d-57d1-4e6c-96bd-57105d36dfcb admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:38.110464 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b0c7d-57d1-4e6c-96bd-57105d36dfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:38.110743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b0c7d-57d1-4e6c-96bd-57105d36dfcb admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:38.111457 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b0c7d-57d1-4e6c-96bd-57105d36dfcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:38.111741 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b0c7d-57d1-4e6c-96bd-57105d36dfcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:38.113328 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b0c7d-57d1-4e6c-96bd-57105d36dfcb admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:38.129316 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 974/1930] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:38.130075 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b0c7d-57d1-4e6c-96bd-57105d36dfcb admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:38.141695 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b0c7d-57d1-4e6c-96bd-57105d36dfcb admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:38.142348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 957/1931] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:37 2022] PUT /identity/v3/projects/20fe518000f14acca1e10c23287e0f4d/users/e343cd7c8b234f9f946df95a0d129e7d/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:00:38.154019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4af8b-2753-4e57-b161-31bd25d7a9a4 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:38.154365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4af8b-2753-4e57-b161-31bd25d7a9a4 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:38.154624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4af8b-2753-4e57-b161-31bd25d7a9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:38.210797 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-31f4af8b-2753-4e57-b161-31bd25d7a9a4 None None] MFA Rules not processed for user `e343cd7c8b234f9f946df95a0d129e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:38.216082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-31f4af8b-2753-4e57-b161-31bd25d7a9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:38.254131 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d399ad-3a40-4ed3-a7ef-d91bb2abdf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:38.255210 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d399ad-3a40-4ed3-a7ef-d91bb2abdf80 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:38.255874 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d399ad-3a40-4ed3-a7ef-d91bb2abdf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:38.255874 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d399ad-3a40-4ed3-a7ef-d91bb2abdf80 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:38.256797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d399ad-3a40-4ed3-a7ef-d91bb2abdf80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:38.259157 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d399ad-3a40-4ed3-a7ef-d91bb2abdf80 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:38.362649 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 958/1932] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:38.362852 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 975/1933] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:38 2022] POST /identity/v3/projects => generated 379 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:38.369545 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4af8b-2753-4e57-b161-31bd25d7a9a4 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:38.371041 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-31f4af8b-2753-4e57-b161-31bd25d7a9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:38.372152 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d399ad-3a40-4ed3-a7ef-d91bb2abdf80 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:38.396589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4af8b-2753-4e57-b161-31bd25d7a9a4 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:38.482951 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d399ad-3a40-4ed3-a7ef-d91bb2abdf80 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:38.514077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7dc25-d03d-4d95-8d18-7a61a0762e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:38.515294 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7dc25-d03d-4d95-8d18-7a61a0762e1f admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:38.515820 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7dc25-d03d-4d95-8d18-7a61a0762e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:38.516246 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7dc25-d03d-4d95-8d18-7a61a0762e1f admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:38.517092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7dc25-d03d-4d95-8d18-7a61a0762e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:38.519406 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee5936-eddf-4aae-9e2e-9e6b4afc300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:38.521317 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7dc25-d03d-4d95-8d18-7a61a0762e1f admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:38.527430 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee5936-eddf-4aae-9e2e-9e6b4afc300a admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:38.527430 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee5936-eddf-4aae-9e2e-9e6b4afc300a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:38.528042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee5936-eddf-4aae-9e2e-9e6b4afc300a admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:38.529734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:38.534462 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee5936-eddf-4aae-9e2e-9e6b4afc300a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:38.538755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee5936-eddf-4aae-9e2e-9e6b4afc300a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:38.666742 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 976/1934] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:38 2022] POST /identity/v3/users => generated 290 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:38.673291 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 959/1935] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:38 2022] POST /identity/v3/projects => generated 381 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:38.673493 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee5936-eddf-4aae-9e2e-9e6b4afc300a admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:38.675441 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7dc25-d03d-4d95-8d18-7a61a0762e1f admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:38.676914 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-fdee5936-eddf-4aae-9e2e-9e6b4afc300a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:38.677936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-11f7dc25-d03d-4d95-8d18-7a61a0762e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:38.739948 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee5936-eddf-4aae-9e2e-9e6b4afc300a admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:38.744793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed79c45-a9da-4e99-86b6-cff3509f3f23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:38.747760 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed79c45-a9da-4e99-86b6-cff3509f3f23 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:38.747760 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed79c45-a9da-4e99-86b6-cff3509f3f23 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:38.747760 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed79c45-a9da-4e99-86b6-cff3509f3f23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:38.748107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-6ed79c45-a9da-4e99-86b6-cff3509f3f23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:38.750252 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7dc25-d03d-4d95-8d18-7a61a0762e1f admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:38.754633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b50ace-8e5e-48bc-8892-0f9c61b3f7bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:38.755263 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b50ace-8e5e-48bc-8892-0f9c61b3f7bc service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:38.755549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b50ace-8e5e-48bc-8892-0f9c61b3f7bc service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:38.755885 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b50ace-8e5e-48bc-8892-0f9c61b3f7bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:38.757671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-15b50ace-8e5e-48bc-8892-0f9c61b3f7bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:38.769406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:38.812321 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed79c45-a9da-4e99-86b6-cff3509f3f23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:38.813773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed79c45-a9da-4e99-86b6-cff3509f3f23 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:38.823987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 960/1936] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:38.824975 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed79c45-a9da-4e99-86b6-cff3509f3f23 service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:38.837830 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b50ace-8e5e-48bc-8892-0f9c61b3f7bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:38.839328 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b50ace-8e5e-48bc-8892-0f9c61b3f7bc service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:38.848975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 977/1937] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:38.849618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b50ace-8e5e-48bc-8892-0f9c61b3f7bc service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:38.915949 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed79c45-a9da-4e99-86b6-cff3509f3f23 service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:38.922406 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b83df6-1df7-48e0-9e2c-c0cbbf15a2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:38.923149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b83df6-1df7-48e0-9e2c-c0cbbf15a2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:38.923441 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b83df6-1df7-48e0-9e2c-c0cbbf15a2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:38.923551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b50ace-8e5e-48bc-8892-0f9c61b3f7bc service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:38.923722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b83df6-1df7-48e0-9e2c-c0cbbf15a2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:38.924723 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b83df6-1df7-48e0-9e2c-c0cbbf15a2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:38.926440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b83df6-1df7-48e0-9e2c-c0cbbf15a2d2 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:38.928938 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0bb0e8-87a6-4585-9943-5cb5d6c6bc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:38.929566 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bb0e8-87a6-4585-9943-5cb5d6c6bc41 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:38.929903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bb0e8-87a6-4585-9943-5cb5d6c6bc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:38.930925 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bb0e8-87a6-4585-9943-5cb5d6c6bc41 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:38.931605 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0bb0e8-87a6-4585-9943-5cb5d6c6bc41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:38.936978 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0bb0e8-87a6-4585-9943-5cb5d6c6bc41 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:38.941254 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 961/1938] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:38.947024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b83df6-1df7-48e0-9e2c-c0cbbf15a2d2 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:38.960555 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b83df6-1df7-48e0-9e2c-c0cbbf15a2d2 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:38.966038 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242012a-5047-4eda-8d30-c3ff8ad04138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:38.967011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242012a-5047-4eda-8d30-c3ff8ad04138 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:38.967373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242012a-5047-4eda-8d30-c3ff8ad04138 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:38.967869 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242012a-5047-4eda-8d30-c3ff8ad04138 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:38.968978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242012a-5047-4eda-8d30-c3ff8ad04138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:38.971456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242012a-5047-4eda-8d30-c3ff8ad04138 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:38.988084 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 962/1939] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:39.005957 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242012a-5047-4eda-8d30-c3ff8ad04138 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:39.005957 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242012a-5047-4eda-8d30-c3ff8ad04138 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:39.011215 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bff99a-1ce0-4f6c-9d57-a7a5d7088ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:39.012052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bff99a-1ce0-4f6c-9d57-a7a5d7088ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:39.012446 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bff99a-1ce0-4f6c-9d57-a7a5d7088ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:39.012855 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bff99a-1ce0-4f6c-9d57-a7a5d7088ba8 admin admin] PATH_INFO: `/v3/projects/e1b465dc739d4a17ab9eb2de456c910b/users/34ef9b0c91e643069cd2129fc5d27873/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:39.036935 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bff99a-1ce0-4f6c-9d57-a7a5d7088ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b465dc739d4a17ab9eb2de456c910b, user_id=34ef9b0c91e643069cd2129fc5d27873, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:39.039894 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bff99a-1ce0-4f6c-9d57-a7a5d7088ba8 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:39.084721 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 978/1940] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:38 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:39.089371 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0bb0e8-87a6-4585-9943-5cb5d6c6bc41 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:39.102007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0bb0e8-87a6-4585-9943-5cb5d6c6bc41 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:39.107703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a8c4a-b8fb-45c3-8fe8-d0601d4eab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:39.107968 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a8c4a-b8fb-45c3-8fe8-d0601d4eab8c admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:39.108257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a8c4a-b8fb-45c3-8fe8-d0601d4eab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:39.108547 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a8c4a-b8fb-45c3-8fe8-d0601d4eab8c admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:39.109384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a8c4a-b8fb-45c3-8fe8-d0601d4eab8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:39.111169 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a8c4a-b8fb-45c3-8fe8-d0601d4eab8c admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:39.126258 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 979/1941] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:39.135550 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a8c4a-b8fb-45c3-8fe8-d0601d4eab8c admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:39.145907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a8c4a-b8fb-45c3-8fe8-d0601d4eab8c admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:39.151190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50ba95-3cf4-4100-906b-ea4db68e9a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:39.151853 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50ba95-3cf4-4100-906b-ea4db68e9a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:39.152140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50ba95-3cf4-4100-906b-ea4db68e9a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:39.152423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50ba95-3cf4-4100-906b-ea4db68e9a67 admin admin] PATH_INFO: `/v3/projects/4bce8f720dd342e68e4123edc87c023b/users/6976961651184078bfc5b5f562ec353d/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:39.167256 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50ba95-3cf4-4100-906b-ea4db68e9a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bce8f720dd342e68e4123edc87c023b, user_id=6976961651184078bfc5b5f562ec353d, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:39.169940 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50ba95-3cf4-4100-906b-ea4db68e9a67 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:39.196678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 963/1942] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:38 2022] PUT /identity/v3/projects/e1b465dc739d4a17ab9eb2de456c910b/users/34ef9b0c91e643069cd2129fc5d27873/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:39.207915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c53d3d-c8ad-479d-afbd-f2928f4bc592 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:39.208224 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c53d3d-c8ad-479d-afbd-f2928f4bc592 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:39.208482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c53d3d-c8ad-479d-afbd-f2928f4bc592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:39.236143 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-80c53d3d-c8ad-479d-afbd-f2928f4bc592 None None] MFA Rules not processed for user `34ef9b0c91e643069cd2129fc5d27873`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:39.237338 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-80c53d3d-c8ad-479d-afbd-f2928f4bc592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:39.305336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 964/1943] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:00:39.311666 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c53d3d-c8ad-479d-afbd-f2928f4bc592 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:39.328601 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 980/1944] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:39 2022] PUT /identity/v3/projects/4bce8f720dd342e68e4123edc87c023b/users/6976961651184078bfc5b5f562ec353d/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:00:39.332630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50ba95-3cf4-4100-906b-ea4db68e9a67 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:39.382471 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c53d3d-c8ad-479d-afbd-f2928f4bc592 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:39.396537 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50ba95-3cf4-4100-906b-ea4db68e9a67 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:39.401549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430ae04-c218-49d6-a62a-aa2006e0c85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:39.402174 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430ae04-c218-49d6-a62a-aa2006e0c85a admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:39.402522 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430ae04-c218-49d6-a62a-aa2006e0c85a admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:39.402808 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430ae04-c218-49d6-a62a-aa2006e0c85a admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:39.403520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430ae04-c218-49d6-a62a-aa2006e0c85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:39.405135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430ae04-c218-49d6-a62a-aa2006e0c85a admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:39.418558 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 981/1945] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:39.420454 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430ae04-c218-49d6-a62a-aa2006e0c85a admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:39.431439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430ae04-c218-49d6-a62a-aa2006e0c85a admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:39.436696 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef34391-4e44-4177-b3d5-26a1728e4046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:39.437417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef34391-4e44-4177-b3d5-26a1728e4046 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:39.437697 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef34391-4e44-4177-b3d5-26a1728e4046 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:39.437973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef34391-4e44-4177-b3d5-26a1728e4046 admin admin] PATH_INFO: `/v3/projects/4bce8f720dd342e68e4123edc87c023b/users/6976961651184078bfc5b5f562ec353d/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:39.440177 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef34391-4e44-4177-b3d5-26a1728e4046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bce8f720dd342e68e4123edc87c023b, user_id=6976961651184078bfc5b5f562ec353d, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:39.441906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ca70b-c446-4a3f-b245-06626330ec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:39.442579 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ca70b-c446-4a3f-b245-06626330ec4a admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:39.442866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ca70b-c446-4a3f-b245-06626330ec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:39.442972 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef34391-4e44-4177-b3d5-26a1728e4046 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:39.443133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ca70b-c446-4a3f-b245-06626330ec4a admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:39.443969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ca70b-c446-4a3f-b245-06626330ec4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:39.446521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ca70b-c446-4a3f-b245-06626330ec4a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:39.454514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 982/1946] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:39 2022] PUT /identity/v3/projects/4bce8f720dd342e68e4123edc87c023b/users/6976961651184078bfc5b5f562ec353d/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:00:39.471653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25655-b367-41eb-a404-c30d54a4518a None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:39.471949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25655-b367-41eb-a404-c30d54a4518a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:39.472277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25655-b367-41eb-a404-c30d54a4518a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:39.502373 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-ded25655-b367-41eb-a404-c30d54a4518a None None] MFA Rules not processed for user `6976961651184078bfc5b5f562ec353d`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:39.503682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ded25655-b367-41eb-a404-c30d54a4518a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:39.595684 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 965/1947] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:39 2022] POST /identity/v3/projects => generated 379 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:39.611419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ca70b-c446-4a3f-b245-06626330ec4a admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:39.625594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 983/1948] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:39.686708 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ca70b-c446-4a3f-b245-06626330ec4a admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:39.691576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84472f3a-677a-4b8d-97c7-3c48dd72c8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:39.692361 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84472f3a-677a-4b8d-97c7-3c48dd72c8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:39.692646 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84472f3a-677a-4b8d-97c7-3c48dd72c8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:39.692922 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84472f3a-677a-4b8d-97c7-3c48dd72c8f6 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:39.693653 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84472f3a-677a-4b8d-97c7-3c48dd72c8f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:39.695623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84472f3a-677a-4b8d-97c7-3c48dd72c8f6 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:39.757802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded25655-b367-41eb-a404-c30d54a4518a None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:39.817633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded25655-b367-41eb-a404-c30d54a4518a None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:39.864529 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 966/1949] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:39 2022] POST /identity/v3/users => generated 296 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:39.869226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84472f3a-677a-4b8d-97c7-3c48dd72c8f6 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:39.874915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0c76f-c5c3-4bc5-9dc9-99fa87524f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:39.875606 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0c76f-c5c3-4bc5-9dc9-99fa87524f99 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:39.875899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0c76f-c5c3-4bc5-9dc9-99fa87524f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:39.876180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0c76f-c5c3-4bc5-9dc9-99fa87524f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:39.888467 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84472f3a-677a-4b8d-97c7-3c48dd72c8f6 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:39.906480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523c939-724d-49cc-a1cc-c0e2f7aa7a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:39.906480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523c939-724d-49cc-a1cc-c0e2f7aa7a63 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:39.906480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523c939-724d-49cc-a1cc-c0e2f7aa7a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:39.906480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523c939-724d-49cc-a1cc-c0e2f7aa7a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:39.906808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523c939-724d-49cc-a1cc-c0e2f7aa7a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:39.906808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523c939-724d-49cc-a1cc-c0e2f7aa7a63 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:39.911186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 967/1950] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:39.916029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523c939-724d-49cc-a1cc-c0e2f7aa7a63 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:39.928568 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523c939-724d-49cc-a1cc-c0e2f7aa7a63 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:39.933889 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457207f-9952-4241-8354-ea3bd386d900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:39.934589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457207f-9952-4241-8354-ea3bd386d900 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:39.935102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457207f-9952-4241-8354-ea3bd386d900 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:39.935232 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457207f-9952-4241-8354-ea3bd386d900 admin admin] PATH_INFO: `/v3/projects/7e77b8083afa4443ac75213faeaecb6d/users/7dfda6c094d3404caabf8baf74c11052/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:39.948083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0c76f-c5c3-4bc5-9dc9-99fa87524f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:39.949766 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0c76f-c5c3-4bc5-9dc9-99fa87524f99 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:39.950450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7457207f-9952-4241-8354-ea3bd386d900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e77b8083afa4443ac75213faeaecb6d, user_id=7dfda6c094d3404caabf8baf74c11052, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:39.953137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7457207f-9952-4241-8354-ea3bd386d900 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:39.962586 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 984/1951] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:00:40.093810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 968/1952] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:39 2022] PUT /identity/v3/projects/7e77b8083afa4443ac75213faeaecb6d/users/7dfda6c094d3404caabf8baf74c11052/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:40.097869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0c76f-c5c3-4bc5-9dc9-99fa87524f99 service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:40.109641 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0c76f-c5c3-4bc5-9dc9-99fa87524f99 service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:40.210021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923ff21-bd54-4430-93da-2e6a97b637e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:40.210812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923ff21-bd54-4430-93da-2e6a97b637e2 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:40.214897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923ff21-bd54-4430-93da-2e6a97b637e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:40.215276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923ff21-bd54-4430-93da-2e6a97b637e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:40.216281 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923ff21-bd54-4430-93da-2e6a97b637e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:40.218240 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923ff21-bd54-4430-93da-2e6a97b637e2 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:40.237335 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 985/1953] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:40.241515 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457207f-9952-4241-8354-ea3bd386d900 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:40.254114 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457207f-9952-4241-8354-ea3bd386d900 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:40.259705 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fa5eb-9ffa-44ef-b21f-00997c368272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:40.260423 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fa5eb-9ffa-44ef-b21f-00997c368272 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:40.260800 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fa5eb-9ffa-44ef-b21f-00997c368272 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:40.261141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fa5eb-9ffa-44ef-b21f-00997c368272 admin admin] PATH_INFO: `/v3/projects/7e77b8083afa4443ac75213faeaecb6d/users/7dfda6c094d3404caabf8baf74c11052/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:40.263234 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107fa5eb-9ffa-44ef-b21f-00997c368272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e77b8083afa4443ac75213faeaecb6d, user_id=7dfda6c094d3404caabf8baf74c11052, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:40.266107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107fa5eb-9ffa-44ef-b21f-00997c368272 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:40.278710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 969/1954] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:40 2022] PUT /identity/v3/projects/7e77b8083afa4443ac75213faeaecb6d/users/7dfda6c094d3404caabf8baf74c11052/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:00:40.290849 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f808455-a1a4-44e1-9f64-afed433eca05 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:40.291064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f808455-a1a4-44e1-9f64-afed433eca05 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:40.291349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f808455-a1a4-44e1-9f64-afed433eca05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:40.331540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-2f808455-a1a4-44e1-9f64-afed433eca05 None None] MFA Rules not processed for user `7dfda6c094d3404caabf8baf74c11052`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:40.332853 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2f808455-a1a4-44e1-9f64-afed433eca05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:40.423071 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 986/1955] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:40.915730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fa5eb-9ffa-44ef-b21f-00997c368272 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:40.971232 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fa5eb-9ffa-44ef-b21f-00997c368272 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:40.975283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff795e2-08cb-4a1a-853d-9d613738b310 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:40.975904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff795e2-08cb-4a1a-853d-9d613738b310 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:40.976186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff795e2-08cb-4a1a-853d-9d613738b310 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:40.976457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff795e2-08cb-4a1a-853d-9d613738b310 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:40.986609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff795e2-08cb-4a1a-853d-9d613738b310 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:40.988036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff795e2-08cb-4a1a-853d-9d613738b310 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:40.999056 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 970/1956] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:41.285729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f808455-a1a4-44e1-9f64-afed433eca05 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:41.299085 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f808455-a1a4-44e1-9f64-afed433eca05 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:41.309200 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb41e7-8b8a-4df5-b3ad-94cdef9ed5d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:41.309200 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb41e7-8b8a-4df5-b3ad-94cdef9ed5d2 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:41.309200 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb41e7-8b8a-4df5-b3ad-94cdef9ed5d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:41.309200 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb41e7-8b8a-4df5-b3ad-94cdef9ed5d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:41.362322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:41.388376 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb41e7-8b8a-4df5-b3ad-94cdef9ed5d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:41.389866 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb41e7-8b8a-4df5-b3ad-94cdef9ed5d2 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:41.403550 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 987/1957] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:41.584580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:41.887823 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff795e2-08cb-4a1a-853d-9d613738b310 service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:41.975905 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff795e2-08cb-4a1a-853d-9d613738b310 service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:41.981312 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad49cb-cecd-4c0e-b7d2-c232c121c4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:41.981965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad49cb-cecd-4c0e-b7d2-c232c121c4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:41.982246 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad49cb-cecd-4c0e-b7d2-c232c121c4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:41.982559 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad49cb-cecd-4c0e-b7d2-c232c121c4e4 admin admin] PATH_INFO: `/v3/users/e343cd7c8b234f9f946df95a0d129e7d` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:41.983732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad49cb-cecd-4c0e-b7d2-c232c121c4e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e343cd7c8b234f9f946df95a0d129e7d)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:41.985686 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad49cb-cecd-4c0e-b7d2-c232c121c4e4 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:42.256029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6dad49cb-cecd-4c0e-b7d2-c232c121c4e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e343cd7c8b234f9f946df95a0d129e7d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:42.263759 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6dad49cb-cecd-4c0e-b7d2-c232c121c4e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e343cd7c8b234f9f946df95a0d129e7d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:42.276938 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6dad49cb-cecd-4c0e-b7d2-c232c121c4e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e343cd7c8b234f9f946df95a0d129e7d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:42.277676 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6dad49cb-cecd-4c0e-b7d2-c232c121c4e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e343cd7c8b234f9f946df95a0d129e7d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:42.278307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6dad49cb-cecd-4c0e-b7d2-c232c121c4e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e343cd7c8b234f9f946df95a0d129e7d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:42.401878 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 971/1958] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:41 2022] DELETE /identity/v3/users/e343cd7c8b234f9f946df95a0d129e7d => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:42.409567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37705d51-1d97-498d-b26a-7d376907afe2 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:42.410103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37705d51-1d97-498d-b26a-7d376907afe2 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:42.410103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37705d51-1d97-498d-b26a-7d376907afe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:42.430801 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-37705d51-1d97-498d-b26a-7d376907afe2 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:42.432026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-37705d51-1d97-498d-b26a-7d376907afe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:42.525929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 988/1959] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:42.542929 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad49cb-cecd-4c0e-b7d2-c232c121c4e4 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:42.542929 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-6dad49cb-cecd-4c0e-b7d2-c232c121c4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:42.598672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad49cb-cecd-4c0e-b7d2-c232c121c4e4 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:42.603348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a379f2e-f8bd-4c41-a7fe-e891d763050c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:42.603986 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a379f2e-f8bd-4c41-a7fe-e891d763050c service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:42.604275 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a379f2e-f8bd-4c41-a7fe-e891d763050c service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:42.605501 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a379f2e-f8bd-4c41-a7fe-e891d763050c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:42.616048 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a379f2e-f8bd-4c41-a7fe-e891d763050c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:42.617594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a379f2e-f8bd-4c41-a7fe-e891d763050c service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:42.628393 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 972/1960] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:43.244728 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37705d51-1d97-498d-b26a-7d376907afe2 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:43.246276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-37705d51-1d97-498d-b26a-7d376907afe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:43.259021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37705d51-1d97-498d-b26a-7d376907afe2 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:43.270375 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b449a3-e334-449b-8f66-3de949b20d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:43.271549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b449a3-e334-449b-8f66-3de949b20d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:43.271897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b449a3-e334-449b-8f66-3de949b20d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:43.273019 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b449a3-e334-449b-8f66-3de949b20d15 admin admin] PATH_INFO: `/v3/projects/20fe518000f14acca1e10c23287e0f4d` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:43.273814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b449a3-e334-449b-8f66-3de949b20d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20fe518000f14acca1e10c23287e0f4d)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:43.275841 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b449a3-e334-449b-8f66-3de949b20d15 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:43.463705 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c8b449a3-e334-449b-8f66-3de949b20d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20fe518000f14acca1e10c23287e0f4d', 'request_id': 'req-c8b449a3-e334-449b-8f66-3de949b20d15'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:43.471249 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c8b449a3-e334-449b-8f66-3de949b20d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20fe518000f14acca1e10c23287e0f4d', 'request_id': 'req-c8b449a3-e334-449b-8f66-3de949b20d15'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:43.478525 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c8b449a3-e334-449b-8f66-3de949b20d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20fe518000f14acca1e10c23287e0f4d', 'request_id': 'req-c8b449a3-e334-449b-8f66-3de949b20d15'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:43.612340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c8b449a3-e334-449b-8f66-3de949b20d15 admin admin] The token cache is being invalidate because project 20fe518000f14acca1e10c23287e0f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:43.612701 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c8b449a3-e334-449b-8f66-3de949b20d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:43.613420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c8b449a3-e334-449b-8f66-3de949b20d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:43.615334 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 989/1961] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:43 2022] DELETE /identity/v3/projects/20fe518000f14acca1e10c23287e0f4d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:43.619760 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a379f2e-f8bd-4c41-a7fe-e891d763050c service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:43.641880 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a379f2e-f8bd-4c41-a7fe-e891d763050c service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:43.744740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477235f2-25f6-43b8-969a-b0100c8bad84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:43.745407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477235f2-25f6-43b8-969a-b0100c8bad84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:43.745698 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477235f2-25f6-43b8-969a-b0100c8bad84 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:43.745983 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477235f2-25f6-43b8-969a-b0100c8bad84 admin admin] PATH_INFO: `/v3/users/6976961651184078bfc5b5f562ec353d` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:43.747446 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477235f2-25f6-43b8-969a-b0100c8bad84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6976961651184078bfc5b5f562ec353d)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:43.750025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477235f2-25f6-43b8-969a-b0100c8bad84 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:44.121549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-477235f2-25f6-43b8-969a-b0100c8bad84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6976961651184078bfc5b5f562ec353d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:44.133935 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-477235f2-25f6-43b8-969a-b0100c8bad84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6976961651184078bfc5b5f562ec353d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:44.151653 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-477235f2-25f6-43b8-969a-b0100c8bad84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6976961651184078bfc5b5f562ec353d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:44.152715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-477235f2-25f6-43b8-969a-b0100c8bad84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6976961651184078bfc5b5f562ec353d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:44.153607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-477235f2-25f6-43b8-969a-b0100c8bad84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6976961651184078bfc5b5f562ec353d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:44.328513 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:44.344471 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 973/1962] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:43 2022] DELETE /identity/v3/users/6976961651184078bfc5b5f562ec353d => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:44.596422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:44.930673 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b449a3-e334-449b-8f66-3de949b20d15 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:44.939581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c8b449a3-e334-449b-8f66-3de949b20d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:44.944866 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b449a3-e334-449b-8f66-3de949b20d15 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:44.990594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477235f2-25f6-43b8-969a-b0100c8bad84 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:44.990594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-477235f2-25f6-43b8-969a-b0100c8bad84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:45.048140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f49fd-d410-4d98-a687-d742ed0eada2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:45.048558 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f49fd-d410-4d98-a687-d742ed0eada2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:45.049012 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f49fd-d410-4d98-a687-d742ed0eada2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:45.049437 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f49fd-d410-4d98-a687-d742ed0eada2 admin admin] PATH_INFO: `/v3/users/c4eee00d660a44849d457fb4249f79ae` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:45.055828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f49fd-d410-4d98-a687-d742ed0eada2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4eee00d660a44849d457fb4249f79ae)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:45.058167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f49fd-d410-4d98-a687-d742ed0eada2 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:45.122583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477235f2-25f6-43b8-969a-b0100c8bad84 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:45.135415 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f20b4b-5faf-45d1-a0e9-878796fe5fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:45.136360 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f20b4b-5faf-45d1-a0e9-878796fe5fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:45.136749 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f20b4b-5faf-45d1-a0e9-878796fe5fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:45.139125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f20b4b-5faf-45d1-a0e9-878796fe5fb7 admin admin] PATH_INFO: `/v3/projects/4bce8f720dd342e68e4123edc87c023b` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:45.151687 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f20b4b-5faf-45d1-a0e9-878796fe5fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bce8f720dd342e68e4123edc87c023b)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:45.155804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f20b4b-5faf-45d1-a0e9-878796fe5fb7 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:45.256478 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5e5f49fd-d410-4d98-a687-d742ed0eada2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4eee00d660a44849d457fb4249f79ae'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:45.259577 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5e5f49fd-d410-4d98-a687-d742ed0eada2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4eee00d660a44849d457fb4249f79ae'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:45.278540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5e5f49fd-d410-4d98-a687-d742ed0eada2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4eee00d660a44849d457fb4249f79ae'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:45.283454 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f1f20b4b-5faf-45d1-a0e9-878796fe5fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bce8f720dd342e68e4123edc87c023b', 'request_id': 'req-f1f20b4b-5faf-45d1-a0e9-878796fe5fb7'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:45.292907 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f1f20b4b-5faf-45d1-a0e9-878796fe5fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bce8f720dd342e68e4123edc87c023b', 'request_id': 'req-f1f20b4b-5faf-45d1-a0e9-878796fe5fb7'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:45.367423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5e5f49fd-d410-4d98-a687-d742ed0eada2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4eee00d660a44849d457fb4249f79ae'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:45.368130 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5e5f49fd-d410-4d98-a687-d742ed0eada2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4eee00d660a44849d457fb4249f79ae'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:45.381818 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 990/1963] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:44 2022] DELETE /identity/v3/users/c4eee00d660a44849d457fb4249f79ae => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:45.386248 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d10d92-d6ff-43dc-8743-cbb365a20fb0 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:45.386650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d10d92-d6ff-43dc-8743-cbb365a20fb0 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:45.386936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d10d92-d6ff-43dc-8743-cbb365a20fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:45.406916 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-05d10d92-d6ff-43dc-8743-cbb365a20fb0 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:45.408184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-05d10d92-d6ff-43dc-8743-cbb365a20fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:45.457776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f1f20b4b-5faf-45d1-a0e9-878796fe5fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bce8f720dd342e68e4123edc87c023b', 'request_id': 'req-f1f20b4b-5faf-45d1-a0e9-878796fe5fb7'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:45.480690 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 991/1964] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:00:45.484896 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f1f20b4b-5faf-45d1-a0e9-878796fe5fb7 admin admin] The token cache is being invalidate because project 4bce8f720dd342e68e4123edc87c023b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:45.485340 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f1f20b4b-5faf-45d1-a0e9-878796fe5fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:45.486457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f1f20b4b-5faf-45d1-a0e9-878796fe5fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:45.487074 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d10d92-d6ff-43dc-8743-cbb365a20fb0 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:45.492209 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 974/1965] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:44 2022] DELETE /identity/v3/projects/4bce8f720dd342e68e4123edc87c023b => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:45.493298 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-05d10d92-d6ff-43dc-8743-cbb365a20fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:45.497250 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eee09-a54c-45fe-bfd0-bb504237cf02 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:45.497250 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eee09-a54c-45fe-bfd0-bb504237cf02 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:45.497250 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eee09-a54c-45fe-bfd0-bb504237cf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:45.522611 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-d33eee09-a54c-45fe-bfd0-bb504237cf02 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:45.524449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d33eee09-a54c-45fe-bfd0-bb504237cf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:45.534452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 975/1966] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:45.544121 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c482d6c-822b-423a-859a-c97faa9da998 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:45.544494 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c482d6c-822b-423a-859a-c97faa9da998 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:45.544972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c482d6c-822b-423a-859a-c97faa9da998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:45.569321 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-8c482d6c-822b-423a-859a-c97faa9da998 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:45.569548 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d10d92-d6ff-43dc-8743-cbb365a20fb0 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:45.571163 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8c482d6c-822b-423a-859a-c97faa9da998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:45.573919 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4c905-ef16-450e-9373-92d34b90fcdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:45.574723 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4c905-ef16-450e-9373-92d34b90fcdd service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:45.575103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4c905-ef16-450e-9373-92d34b90fcdd service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:45.575393 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4c905-ef16-450e-9373-92d34b90fcdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:45.577526 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-f8d4c905-ef16-450e-9373-92d34b90fcdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:45.579698 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 976/1967] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:45.583614 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c482d6c-822b-423a-859a-c97faa9da998 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:45.592460 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4c905-ef16-450e-9373-92d34b90fcdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:45.593568 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c482d6c-822b-423a-859a-c97faa9da998 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:45.594365 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4c905-ef16-450e-9373-92d34b90fcdd service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:45.598273 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06754be3-0b18-4a21-9cde-1d075d7765f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:45.599044 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06754be3-0b18-4a21-9cde-1d075d7765f5 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:45.599323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06754be3-0b18-4a21-9cde-1d075d7765f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:45.599592 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06754be3-0b18-4a21-9cde-1d075d7765f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:45.600740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06754be3-0b18-4a21-9cde-1d075d7765f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:45.600740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06754be3-0b18-4a21-9cde-1d075d7765f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:45.602202 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06754be3-0b18-4a21-9cde-1d075d7765f5 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:45.606216 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 992/1968] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:00:45.622434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 977/1969] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:00:45.624471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4c905-ef16-450e-9373-92d34b90fcdd service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:45.635145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4c905-ef16-450e-9373-92d34b90fcdd service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:45.639936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70224d94-07e2-4e19-892f-c82f87de89b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:45.640562 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70224d94-07e2-4e19-892f-c82f87de89b9 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:45.640848 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70224d94-07e2-4e19-892f-c82f87de89b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:45.641131 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70224d94-07e2-4e19-892f-c82f87de89b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:45.641804 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70224d94-07e2-4e19-892f-c82f87de89b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:45.644039 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70224d94-07e2-4e19-892f-c82f87de89b9 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:45.764937 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 993/1970] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:45 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:45.769318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06754be3-0b18-4a21-9cde-1d075d7765f5 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:45.780158 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06754be3-0b18-4a21-9cde-1d075d7765f5 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:45.845976 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a0c4b-38ab-4ecc-8768-34a7cb86ce7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:45.846638 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a0c4b-38ab-4ecc-8768-34a7cb86ce7f admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:45.846935 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a0c4b-38ab-4ecc-8768-34a7cb86ce7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:45.847213 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a0c4b-38ab-4ecc-8768-34a7cb86ce7f admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:45.848040 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a0c4b-38ab-4ecc-8768-34a7cb86ce7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:45.850276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a0c4b-38ab-4ecc-8768-34a7cb86ce7f admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:46.010657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 978/1971] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:45 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:46.015185 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70224d94-07e2-4e19-892f-c82f87de89b9 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:46.028310 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70224d94-07e2-4e19-892f-c82f87de89b9 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:46.034355 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04cc69-6ca2-43da-a2f5-9c3c6f83e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:46.035189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04cc69-6ca2-43da-a2f5-9c3c6f83e573 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:46.039942 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04cc69-6ca2-43da-a2f5-9c3c6f83e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:46.039942 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04cc69-6ca2-43da-a2f5-9c3c6f83e573 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:46.039942 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04cc69-6ca2-43da-a2f5-9c3c6f83e573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:46.039942 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04cc69-6ca2-43da-a2f5-9c3c6f83e573 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:46.053063 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 994/1972] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:46.058011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a0c4b-38ab-4ecc-8768-34a7cb86ce7f admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:46.071724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a0c4b-38ab-4ecc-8768-34a7cb86ce7f admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:46.076857 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c9a90-041a-435d-84de-3bc2ffe05b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:46.077562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c9a90-041a-435d-84de-3bc2ffe05b43 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:46.077916 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c9a90-041a-435d-84de-3bc2ffe05b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:46.078261 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c9a90-041a-435d-84de-3bc2ffe05b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:46.079082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c9a90-041a-435d-84de-3bc2ffe05b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:46.080925 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c9a90-041a-435d-84de-3bc2ffe05b43 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:46.095406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:46.097126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 979/1973] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:46.097787 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04cc69-6ca2-43da-a2f5-9c3c6f83e573 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:46.110429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04cc69-6ca2-43da-a2f5-9c3c6f83e573 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:46.115582 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ad0ca-31ef-4a04-9eec-9b5f32ec20d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:46.116263 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ad0ca-31ef-4a04-9eec-9b5f32ec20d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:46.116686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ad0ca-31ef-4a04-9eec-9b5f32ec20d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:46.116970 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ad0ca-31ef-4a04-9eec-9b5f32ec20d4 admin admin] PATH_INFO: `/v3/projects/b4dd36bf44394e17aaa1246b050ae07d/users/9f76c776592b4db6afcda0a4d56940a3/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:46.146855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ad0ca-31ef-4a04-9eec-9b5f32ec20d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4dd36bf44394e17aaa1246b050ae07d, user_id=9f76c776592b4db6afcda0a4d56940a3, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:46.151001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ad0ca-31ef-4a04-9eec-9b5f32ec20d4 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:46.230293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 995/1974] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:46 2022] PUT /identity/v3/projects/b4dd36bf44394e17aaa1246b050ae07d/users/9f76c776592b4db6afcda0a4d56940a3/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:00:46.243304 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8518-2bb0-40f8-ac6b-431c9458a9a0 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:46.243807 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8518-2bb0-40f8-ac6b-431c9458a9a0 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:46.244087 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8518-2bb0-40f8-ac6b-431c9458a9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:46.290333 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-edea8518-2bb0-40f8-ac6b-431c9458a9a0 None None] MFA Rules not processed for user `9f76c776592b4db6afcda0a4d56940a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:46.292180 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-edea8518-2bb0-40f8-ac6b-431c9458a9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:46.341305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ad0ca-31ef-4a04-9eec-9b5f32ec20d4 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:46.343662 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-1f3ad0ca-31ef-4a04-9eec-9b5f32ec20d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:46.422747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 980/1975] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:46.427571 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea8518-2bb0-40f8-ac6b-431c9458a9a0 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:46.478359 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:46.504962 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ad0ca-31ef-4a04-9eec-9b5f32ec20d4 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:46.526004 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd4602-a1e7-4a53-be5c-d9b358b701bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:46.526004 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd4602-a1e7-4a53-be5c-d9b358b701bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:46.526004 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd4602-a1e7-4a53-be5c-d9b358b701bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:46.526582 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd4602-a1e7-4a53-be5c-d9b358b701bf admin admin] PATH_INFO: `/v3/projects/041ad1ebd1394225abf4fee59bc69518` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:46.528625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd4602-a1e7-4a53-be5c-d9b358b701bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=041ad1ebd1394225abf4fee59bc69518)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:46.543433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd4602-a1e7-4a53-be5c-d9b358b701bf admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:46.570959 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea8518-2bb0-40f8-ac6b-431c9458a9a0 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:46.576726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42bbbe-690c-4c4e-a28d-a2cfc532042d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:46.577418 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42bbbe-690c-4c4e-a28d-a2cfc532042d admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:46.577710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42bbbe-690c-4c4e-a28d-a2cfc532042d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:46.577995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42bbbe-690c-4c4e-a28d-a2cfc532042d admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:46.578708 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42bbbe-690c-4c4e-a28d-a2cfc532042d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:46.582734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42bbbe-690c-4c4e-a28d-a2cfc532042d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:46.727535 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 981/1976] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:46 2022] POST /identity/v3/projects => generated 383 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:46.731797 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42bbbe-690c-4c4e-a28d-a2cfc532042d admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:46.741038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-28cd4602-a1e7-4a53-be5c-d9b358b701bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041ad1ebd1394225abf4fee59bc69518', 'request_id': 'req-28cd4602-a1e7-4a53-be5c-d9b358b701bf'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:46.754869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-28cd4602-a1e7-4a53-be5c-d9b358b701bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041ad1ebd1394225abf4fee59bc69518', 'request_id': 'req-28cd4602-a1e7-4a53-be5c-d9b358b701bf'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:46.761899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-28cd4602-a1e7-4a53-be5c-d9b358b701bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041ad1ebd1394225abf4fee59bc69518', 'request_id': 'req-28cd4602-a1e7-4a53-be5c-d9b358b701bf'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:46.818706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42bbbe-690c-4c4e-a28d-a2cfc532042d admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:46.823736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4a91b-65a6-4af2-a28e-462ad8c32c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:46.824466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4a91b-65a6-4af2-a28e-462ad8c32c9a admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:46.824855 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4a91b-65a6-4af2-a28e-462ad8c32c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:46.825196 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4a91b-65a6-4af2-a28e-462ad8c32c9a admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:46.825883 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4a91b-65a6-4af2-a28e-462ad8c32c9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:46.827921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4a91b-65a6-4af2-a28e-462ad8c32c9a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:46.875640 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-28cd4602-a1e7-4a53-be5c-d9b358b701bf admin admin] The token cache is being invalidate because project 041ad1ebd1394225abf4fee59bc69518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:46.875640 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-28cd4602-a1e7-4a53-be5c-d9b358b701bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:46.875640 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-28cd4602-a1e7-4a53-be5c-d9b358b701bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:46.875640 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 996/1977] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:46 2022] DELETE /identity/v3/projects/041ad1ebd1394225abf4fee59bc69518 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:46.876350 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd4602-a1e7-4a53-be5c-d9b358b701bf admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:46.877867 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-28cd4602-a1e7-4a53-be5c-d9b358b701bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:46.946797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd4602-a1e7-4a53-be5c-d9b358b701bf admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:46.951420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c21bf4-1e79-422f-ad6f-6e72a0cb723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:46.952067 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c21bf4-1e79-422f-ad6f-6e72a0cb723e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:46.952346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c21bf4-1e79-422f-ad6f-6e72a0cb723e admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:46.952621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c21bf4-1e79-422f-ad6f-6e72a0cb723e admin admin] PATH_INFO: `/v3/users/0d4f946db6774a0fa9dbfd1c0816bf3d` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:46.953837 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c21bf4-1e79-422f-ad6f-6e72a0cb723e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d4f946db6774a0fa9dbfd1c0816bf3d)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:46.955891 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c21bf4-1e79-422f-ad6f-6e72a0cb723e admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:46.968307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 982/1978] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:46 2022] POST /identity/v3/users => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:46.971887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4a91b-65a6-4af2-a28e-462ad8c32c9a admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:46.974921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-57c4a91b-65a6-4af2-a28e-462ad8c32c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:46.989533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4a91b-65a6-4af2-a28e-462ad8c32c9a admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:46.994311 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ccd74-983c-422f-b7b2-a5f4afb12448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:46.995031 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ccd74-983c-422f-b7b2-a5f4afb12448 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:46.995379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ccd74-983c-422f-b7b2-a5f4afb12448 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:46.995723 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ccd74-983c-422f-b7b2-a5f4afb12448 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:46.996490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ccd74-983c-422f-b7b2-a5f4afb12448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:46.998156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ccd74-983c-422f-b7b2-a5f4afb12448 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:47.011387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 983/1979] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:00:47.015545 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ccd74-983c-422f-b7b2-a5f4afb12448 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:47.025972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ccd74-983c-422f-b7b2-a5f4afb12448 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:47.030683 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76901eb6-370c-4aa5-8caf-c17fdecab0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:47.031399 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76901eb6-370c-4aa5-8caf-c17fdecab0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:47.031684 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76901eb6-370c-4aa5-8caf-c17fdecab0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:47.032006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76901eb6-370c-4aa5-8caf-c17fdecab0b4 admin admin] PATH_INFO: `/v3/projects/8ee30d4719a54d25822e9804b13a169c/users/59589d731d174c24a91828ae6933bc1a/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:47.047380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76901eb6-370c-4aa5-8caf-c17fdecab0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee30d4719a54d25822e9804b13a169c, user_id=59589d731d174c24a91828ae6933bc1a, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:47.050038 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76901eb6-370c-4aa5-8caf-c17fdecab0b4 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:47.252843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 984/1980] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:47 2022] PUT /identity/v3/projects/8ee30d4719a54d25822e9804b13a169c/users/59589d731d174c24a91828ae6933bc1a/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:47.256753 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76901eb6-370c-4aa5-8caf-c17fdecab0b4 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:47.302825 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a0c21bf4-1e79-422f-ad6f-6e72a0cb723e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d4f946db6774a0fa9dbfd1c0816bf3d'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:47.303486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a0c21bf4-1e79-422f-ad6f-6e72a0cb723e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d4f946db6774a0fa9dbfd1c0816bf3d'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:47.317773 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a0c21bf4-1e79-422f-ad6f-6e72a0cb723e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d4f946db6774a0fa9dbfd1c0816bf3d'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:47.325517 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76901eb6-370c-4aa5-8caf-c17fdecab0b4 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:47.330346 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb568a-64ee-48ae-b640-3be71c175ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:47.331046 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb568a-64ee-48ae-b640-3be71c175ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:47.331389 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb568a-64ee-48ae-b640-3be71c175ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:47.331677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb568a-64ee-48ae-b640-3be71c175ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:47.332378 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb568a-64ee-48ae-b640-3be71c175ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:47.334138 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb568a-64ee-48ae-b640-3be71c175ca6 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:47.345013 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 985/1981] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:00:47.349293 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb568a-64ee-48ae-b640-3be71c175ca6 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:47.360012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb568a-64ee-48ae-b640-3be71c175ca6 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:47.364897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd938fa-c3d3-445f-9a56-d8825d9f2ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:47.365664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd938fa-c3d3-445f-9a56-d8825d9f2ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:47.365951 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd938fa-c3d3-445f-9a56-d8825d9f2ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:47.366233 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd938fa-c3d3-445f-9a56-d8825d9f2ed8 admin admin] PATH_INFO: `/v3/projects/8ee30d4719a54d25822e9804b13a169c/users/59589d731d174c24a91828ae6933bc1a/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:47.368836 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd938fa-c3d3-445f-9a56-d8825d9f2ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee30d4719a54d25822e9804b13a169c, user_id=59589d731d174c24a91828ae6933bc1a, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:47.371526 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd938fa-c3d3-445f-9a56-d8825d9f2ed8 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:47.381510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 986/1982] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:47 2022] PUT /identity/v3/projects/8ee30d4719a54d25822e9804b13a169c/users/59589d731d174c24a91828ae6933bc1a/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:00:47.384782 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a0c21bf4-1e79-422f-ad6f-6e72a0cb723e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d4f946db6774a0fa9dbfd1c0816bf3d'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:47.386013 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a0c21bf4-1e79-422f-ad6f-6e72a0cb723e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d4f946db6774a0fa9dbfd1c0816bf3d'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:47.392035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488fb57-73ed-4a59-813f-bb35f2ce9106 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:47.395678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488fb57-73ed-4a59-813f-bb35f2ce9106 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:47.395678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488fb57-73ed-4a59-813f-bb35f2ce9106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:47.400400 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 997/1983] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:46 2022] DELETE /identity/v3/users/0d4f946db6774a0fa9dbfd1c0816bf3d => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:00:47.421653 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-8488fb57-73ed-4a59-813f-bb35f2ce9106 None None] MFA Rules not processed for user `59589d731d174c24a91828ae6933bc1a`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:47.422916 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8488fb57-73ed-4a59-813f-bb35f2ce9106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:47.497787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 987/1984] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:00:47.509396 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c21bf4-1e79-422f-ad6f-6e72a0cb723e admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:47.510964 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a0c21bf4-1e79-422f-ad6f-6e72a0cb723e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:47.569369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c21bf4-1e79-422f-ad6f-6e72a0cb723e admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:47.573244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bed4b1-4443-46c1-8db2-bfd81c10519a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:47.573874 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bed4b1-4443-46c1-8db2-bfd81c10519a service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:47.574213 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bed4b1-4443-46c1-8db2-bfd81c10519a service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:47.574538 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bed4b1-4443-46c1-8db2-bfd81c10519a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:47.576383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e3bed4b1-4443-46c1-8db2-bfd81c10519a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:47.774812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bed4b1-4443-46c1-8db2-bfd81c10519a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:47.774812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bed4b1-4443-46c1-8db2-bfd81c10519a service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:47.774812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 998/1985] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:48.168457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488fb57-73ed-4a59-813f-bb35f2ce9106 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:48.170635 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8488fb57-73ed-4a59-813f-bb35f2ce9106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:48.251752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488fb57-73ed-4a59-813f-bb35f2ce9106 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:48.262549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c3151-fd70-4f09-b5f3-1383388e7a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:48.262549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c3151-fd70-4f09-b5f3-1383388e7a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:48.262549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c3151-fd70-4f09-b5f3-1383388e7a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:48.262549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c3151-fd70-4f09-b5f3-1383388e7a10 admin admin] PATH_INFO: `/v3/projects/2193255399ef4ad3a7dc3d74903ef2e4` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:48.262978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c3151-fd70-4f09-b5f3-1383388e7a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2193255399ef4ad3a7dc3d74903ef2e4)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:48.262978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c3151-fd70-4f09-b5f3-1383388e7a10 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:48.338664 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:48.396925 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6d4c3151-fd70-4f09-b5f3-1383388e7a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2193255399ef4ad3a7dc3d74903ef2e4', 'request_id': 'req-6d4c3151-fd70-4f09-b5f3-1383388e7a10'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:48.404007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6d4c3151-fd70-4f09-b5f3-1383388e7a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2193255399ef4ad3a7dc3d74903ef2e4', 'request_id': 'req-6d4c3151-fd70-4f09-b5f3-1383388e7a10'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:48.526702 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6d4c3151-fd70-4f09-b5f3-1383388e7a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2193255399ef4ad3a7dc3d74903ef2e4', 'request_id': 'req-6d4c3151-fd70-4f09-b5f3-1383388e7a10'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:48.538610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6d4c3151-fd70-4f09-b5f3-1383388e7a10 admin admin] The token cache is being invalidate because project 2193255399ef4ad3a7dc3d74903ef2e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:48.538900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6d4c3151-fd70-4f09-b5f3-1383388e7a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:48.540142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6d4c3151-fd70-4f09-b5f3-1383388e7a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:48.541657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 988/1986] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:48 2022] DELETE /identity/v3/projects/2193255399ef4ad3a7dc3d74903ef2e4 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:48.545957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bed4b1-4443-46c1-8db2-bfd81c10519a service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:48.556798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bed4b1-4443-46c1-8db2-bfd81c10519a service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:48.616023 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332109bd-198d-4b36-8246-7b452d21f68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:48.616751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332109bd-198d-4b36-8246-7b452d21f68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:48.617044 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332109bd-198d-4b36-8246-7b452d21f68d admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:48.617360 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332109bd-198d-4b36-8246-7b452d21f68d admin admin] PATH_INFO: `/v3/users/c1da73526cb04e44a8a51ccc5e31cbb2` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:48.618633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332109bd-198d-4b36-8246-7b452d21f68d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1da73526cb04e44a8a51ccc5e31cbb2)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:48.620594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332109bd-198d-4b36-8246-7b452d21f68d admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:48.839885 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-332109bd-198d-4b36-8246-7b452d21f68d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1da73526cb04e44a8a51ccc5e31cbb2'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:48.841554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-332109bd-198d-4b36-8246-7b452d21f68d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1da73526cb04e44a8a51ccc5e31cbb2'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:48.862666 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-332109bd-198d-4b36-8246-7b452d21f68d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1da73526cb04e44a8a51ccc5e31cbb2'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:48.932618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-332109bd-198d-4b36-8246-7b452d21f68d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1da73526cb04e44a8a51ccc5e31cbb2'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:48.933327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-332109bd-198d-4b36-8246-7b452d21f68d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1da73526cb04e44a8a51ccc5e31cbb2'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:48.949905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 999/1987] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:48 2022] DELETE /identity/v3/users/c1da73526cb04e44a8a51ccc5e31cbb2 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:49.058301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:49.428079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c3151-fd70-4f09-b5f3-1383388e7a10 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:49.431670 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-6d4c3151-fd70-4f09-b5f3-1383388e7a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:49.445654 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c3151-fd70-4f09-b5f3-1383388e7a10 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:49.504065 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c658a2e-6c0f-46de-b118-7b5d5ebbbba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:49.504726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c658a2e-6c0f-46de-b118-7b5d5ebbbba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:49.505014 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c658a2e-6c0f-46de-b118-7b5d5ebbbba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:49.505292 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c658a2e-6c0f-46de-b118-7b5d5ebbbba0 admin admin] PATH_INFO: `/v3/projects/b876dcc994734df7ab3dc0cad6294b7a` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:49.506484 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c658a2e-6c0f-46de-b118-7b5d5ebbbba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b876dcc994734df7ab3dc0cad6294b7a)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:49.508460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c658a2e-6c0f-46de-b118-7b5d5ebbbba0 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:49.612807 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:49.675200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0c658a2e-6c0f-46de-b118-7b5d5ebbbba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b876dcc994734df7ab3dc0cad6294b7a', 'request_id': 'req-0c658a2e-6c0f-46de-b118-7b5d5ebbbba0'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:49.684594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0c658a2e-6c0f-46de-b118-7b5d5ebbbba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b876dcc994734df7ab3dc0cad6294b7a', 'request_id': 'req-0c658a2e-6c0f-46de-b118-7b5d5ebbbba0'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:49.909734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0c658a2e-6c0f-46de-b118-7b5d5ebbbba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b876dcc994734df7ab3dc0cad6294b7a', 'request_id': 'req-0c658a2e-6c0f-46de-b118-7b5d5ebbbba0'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:49.921022 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0c658a2e-6c0f-46de-b118-7b5d5ebbbba0 admin admin] The token cache is being invalidate because project b876dcc994734df7ab3dc0cad6294b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:49.921322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0c658a2e-6c0f-46de-b118-7b5d5ebbbba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:49.921921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0c658a2e-6c0f-46de-b118-7b5d5ebbbba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:49.923600 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 989/1988] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:49 2022] DELETE /identity/v3/projects/b876dcc994734df7ab3dc0cad6294b7a => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:49.929595 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331ee0d-1913-43f8-8051-ebc45b5f4264 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:49.930073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331ee0d-1913-43f8-8051-ebc45b5f4264 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:49.930198 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331ee0d-1913-43f8-8051-ebc45b5f4264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:49.949705 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-c331ee0d-1913-43f8-8051-ebc45b5f4264 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:49.960389 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c331ee0d-1913-43f8-8051-ebc45b5f4264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:50.011700 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1000/1989] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:50.021735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd86d0-87ca-49c9-bdb7-637366f36c87 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:50.022026 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd86d0-87ca-49c9-bdb7-637366f36c87 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:50.022304 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd86d0-87ca-49c9-bdb7-637366f36c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:50.044342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-39dd86d0-87ca-49c9-bdb7-637366f36c87 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:50.045684 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-39dd86d0-87ca-49c9-bdb7-637366f36c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:50.058227 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 990/1990] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:50.062500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331ee0d-1913-43f8-8051-ebc45b5f4264 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:50.072656 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331ee0d-1913-43f8-8051-ebc45b5f4264 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:50.077841 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5dba5d-1db3-40d5-9b20-e288e73ffe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:50.078570 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dba5d-1db3-40d5-9b20-e288e73ffe40 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:50.078856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dba5d-1db3-40d5-9b20-e288e73ffe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:50.079132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dba5d-1db3-40d5-9b20-e288e73ffe40 admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:50.079950 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5dba5d-1db3-40d5-9b20-e288e73ffe40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:50.080260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5dba5d-1db3-40d5-9b20-e288e73ffe40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:50.082126 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5dba5d-1db3-40d5-9b20-e288e73ffe40 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:50.098752 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1001/1991] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:50.101624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd86d0-87ca-49c9-bdb7-637366f36c87 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:50.112370 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd86d0-87ca-49c9-bdb7-637366f36c87 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:50.118325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b423f-e8fc-4697-be6b-b93a6f2a326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:50.119172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b423f-e8fc-4697-be6b-b93a6f2a326e admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:50.119422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b423f-e8fc-4697-be6b-b93a6f2a326e admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:50.119705 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b423f-e8fc-4697-be6b-b93a6f2a326e admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:50.120391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b423f-e8fc-4697-be6b-b93a6f2a326e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:50.122557 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b423f-e8fc-4697-be6b-b93a6f2a326e admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:50.230663 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 991/1992] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:50 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:50.235333 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5dba5d-1db3-40d5-9b20-e288e73ffe40 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:50.245404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5dba5d-1db3-40d5-9b20-e288e73ffe40 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:50.301972 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c57d1-fac1-4494-a8b2-26822d9b1c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:50.302642 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c57d1-fac1-4494-a8b2-26822d9b1c33 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:50.302930 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c57d1-fac1-4494-a8b2-26822d9b1c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:50.303208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c57d1-fac1-4494-a8b2-26822d9b1c33 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:50.303925 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c57d1-fac1-4494-a8b2-26822d9b1c33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:50.305901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c57d1-fac1-4494-a8b2-26822d9b1c33 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:50.428240 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1002/1993] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:50 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:50.428780 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b423f-e8fc-4697-be6b-b93a6f2a326e admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:50.439796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b423f-e8fc-4697-be6b-b93a6f2a326e admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:50.446320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e78b87-9a55-4497-a0b7-b18fc698e3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:50.446937 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e78b87-9a55-4497-a0b7-b18fc698e3ac admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:50.447219 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e78b87-9a55-4497-a0b7-b18fc698e3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:50.447500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e78b87-9a55-4497-a0b7-b18fc698e3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:50.448199 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e78b87-9a55-4497-a0b7-b18fc698e3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:50.449905 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e78b87-9a55-4497-a0b7-b18fc698e3ac admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:50.460535 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 992/1994] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:50.471503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c57d1-fac1-4494-a8b2-26822d9b1c33 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:50.482325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c57d1-fac1-4494-a8b2-26822d9b1c33 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:50.487176 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86f781-37a6-40ae-b9a7-4d5ca1df3a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:50.487798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86f781-37a6-40ae-b9a7-4d5ca1df3a58 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:50.488087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86f781-37a6-40ae-b9a7-4d5ca1df3a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:50.488373 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86f781-37a6-40ae-b9a7-4d5ca1df3a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:50.489074 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86f781-37a6-40ae-b9a7-4d5ca1df3a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:50.490782 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86f781-37a6-40ae-b9a7-4d5ca1df3a58 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:50.502771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1003/1995] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:50.507064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e78b87-9a55-4497-a0b7-b18fc698e3ac admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:50.517485 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e78b87-9a55-4497-a0b7-b18fc698e3ac admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:50.524867 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928380c7-52ef-4f69-8064-d3ee866b8167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:50.524867 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928380c7-52ef-4f69-8064-d3ee866b8167 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:50.525100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928380c7-52ef-4f69-8064-d3ee866b8167 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:50.525282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928380c7-52ef-4f69-8064-d3ee866b8167 admin admin] PATH_INFO: `/v3/projects/476bcbb767fc4e6eb5d7ada6ece91a16/users/8b3e4a1d6af14afbad4edea82ec51fb6/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:50.542451 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928380c7-52ef-4f69-8064-d3ee866b8167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=476bcbb767fc4e6eb5d7ada6ece91a16, user_id=8b3e4a1d6af14afbad4edea82ec51fb6, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:50.546200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928380c7-52ef-4f69-8064-d3ee866b8167 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:50.653260 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 993/1996] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:50 2022] PUT /identity/v3/projects/476bcbb767fc4e6eb5d7ada6ece91a16/users/8b3e4a1d6af14afbad4edea82ec51fb6/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:50.665179 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506be8f6-7d5d-4e48-a042-383aa6f71658 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:50.665469 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506be8f6-7d5d-4e48-a042-383aa6f71658 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:50.665745 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506be8f6-7d5d-4e48-a042-383aa6f71658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:50.694122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-506be8f6-7d5d-4e48-a042-383aa6f71658 None None] MFA Rules not processed for user `8b3e4a1d6af14afbad4edea82ec51fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:50.695705 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-506be8f6-7d5d-4e48-a042-383aa6f71658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:50.768646 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1004/1997] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:50.773203 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928380c7-52ef-4f69-8064-d3ee866b8167 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:50.839463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928380c7-52ef-4f69-8064-d3ee866b8167 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:50.847226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7061e4-33c0-4bdf-84dc-673fd739f7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:50.847226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7061e4-33c0-4bdf-84dc-673fd739f7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:50.847226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7061e4-33c0-4bdf-84dc-673fd739f7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:50.847226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7061e4-33c0-4bdf-84dc-673fd739f7d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:50.847657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7061e4-33c0-4bdf-84dc-673fd739f7d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:50.848047 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7061e4-33c0-4bdf-84dc-673fd739f7d6 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:51.020191 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 994/1998] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:50 2022] POST /identity/v3/projects => generated 379 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:51.024869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506be8f6-7d5d-4e48-a042-383aa6f71658 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:51.035602 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506be8f6-7d5d-4e48-a042-383aa6f71658 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:51.092921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e84e9-0baf-4e46-b424-f74492ed76fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:51.093547 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e84e9-0baf-4e46-b424-f74492ed76fc admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:51.093832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e84e9-0baf-4e46-b424-f74492ed76fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:51.094195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e84e9-0baf-4e46-b424-f74492ed76fc admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:51.094818 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e84e9-0baf-4e46-b424-f74492ed76fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:51.096776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e84e9-0baf-4e46-b424-f74492ed76fc admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:51.238891 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1005/1999] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:51 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:51.240249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7061e4-33c0-4bdf-84dc-673fd739f7d6 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:51.251312 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7061e4-33c0-4bdf-84dc-673fd739f7d6 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:51.255827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bb06c-2af0-46aa-a318-d4b78f37b975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:51.256486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bb06c-2af0-46aa-a318-d4b78f37b975 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:51.256765 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bb06c-2af0-46aa-a318-d4b78f37b975 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:51.257129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bb06c-2af0-46aa-a318-d4b78f37b975 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:51.258414 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3bb06c-2af0-46aa-a318-d4b78f37b975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:51.260020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3bb06c-2af0-46aa-a318-d4b78f37b975 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:51.279222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 995/2000] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:51.279355 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e84e9-0baf-4e46-b424-f74492ed76fc admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:51.292626 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e84e9-0baf-4e46-b424-f74492ed76fc admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:51.300034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad414bf-3acb-43ef-95cf-bd0d835ab566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:51.300780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad414bf-3acb-43ef-95cf-bd0d835ab566 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:51.301065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad414bf-3acb-43ef-95cf-bd0d835ab566 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:51.301341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad414bf-3acb-43ef-95cf-bd0d835ab566 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:51.302043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad414bf-3acb-43ef-95cf-bd0d835ab566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:51.303730 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad414bf-3acb-43ef-95cf-bd0d835ab566 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:51.321398 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1006/2001] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:51.322660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bb06c-2af0-46aa-a318-d4b78f37b975 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:51.332649 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bb06c-2af0-46aa-a318-d4b78f37b975 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:51.337815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f481e3-e747-4c08-addf-1490f1401bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:51.338527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f481e3-e747-4c08-addf-1490f1401bf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:51.338814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f481e3-e747-4c08-addf-1490f1401bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:51.339093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f481e3-e747-4c08-addf-1490f1401bf9 admin admin] PATH_INFO: `/v3/projects/bbd162f2c9b948aa8d760c0835ac191e/users/50af4fedabd4493a93f47104a099bd1b/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:51.354003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f481e3-e747-4c08-addf-1490f1401bf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd162f2c9b948aa8d760c0835ac191e, user_id=50af4fedabd4493a93f47104a099bd1b, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:51.356818 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f481e3-e747-4c08-addf-1490f1401bf9 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:51.515816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 996/2002] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:51 2022] PUT /identity/v3/projects/bbd162f2c9b948aa8d760c0835ac191e/users/50af4fedabd4493a93f47104a099bd1b/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:51.526493 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80593213-826c-4c9a-bbca-af5831bf7ac8 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:51.526810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80593213-826c-4c9a-bbca-af5831bf7ac8 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:51.527099 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80593213-826c-4c9a-bbca-af5831bf7ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:51.549992 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:51.556548 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-80593213-826c-4c9a-bbca-af5831bf7ac8 None None] MFA Rules not processed for user `50af4fedabd4493a93f47104a099bd1b`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:51.557750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-80593213-826c-4c9a-bbca-af5831bf7ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:51.627202 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1007/2003] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:51.631725 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f481e3-e747-4c08-addf-1490f1401bf9 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:51.700855 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f481e3-e747-4c08-addf-1490f1401bf9 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:51.705700 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc49158-f1a9-478d-90cc-7de7d249fd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:51.706330 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc49158-f1a9-478d-90cc-7de7d249fd8d admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:51.706651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc49158-f1a9-478d-90cc-7de7d249fd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:51.706936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc49158-f1a9-478d-90cc-7de7d249fd8d admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:51.707613 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc49158-f1a9-478d-90cc-7de7d249fd8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:51.709638 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc49158-f1a9-478d-90cc-7de7d249fd8d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:51.877161 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 997/2004] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:51 2022] POST /identity/v3/projects => generated 379 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:51.882108 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80593213-826c-4c9a-bbca-af5831bf7ac8 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:51.895838 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80593213-826c-4c9a-bbca-af5831bf7ac8 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:51.955943 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f601541-4ec2-4fa9-82a2-ce369d9b7a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:51.956570 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f601541-4ec2-4fa9-82a2-ce369d9b7a37 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:51.956854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f601541-4ec2-4fa9-82a2-ce369d9b7a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:51.957129 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f601541-4ec2-4fa9-82a2-ce369d9b7a37 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:51.957792 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f601541-4ec2-4fa9-82a2-ce369d9b7a37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:51.959866 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f601541-4ec2-4fa9-82a2-ce369d9b7a37 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:52.063658 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1008/2005] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:51 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:52.067833 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc49158-f1a9-478d-90cc-7de7d249fd8d admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:52.078109 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc49158-f1a9-478d-90cc-7de7d249fd8d admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:52.082784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fb2bf-3a3b-47ea-b8df-14854ab093cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:52.083406 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fb2bf-3a3b-47ea-b8df-14854ab093cd admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:52.083699 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fb2bf-3a3b-47ea-b8df-14854ab093cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:52.083981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fb2bf-3a3b-47ea-b8df-14854ab093cd admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:52.084739 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fb2bf-3a3b-47ea-b8df-14854ab093cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:52.086891 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fb2bf-3a3b-47ea-b8df-14854ab093cd admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:52.102770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 998/2006] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:52.102929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f601541-4ec2-4fa9-82a2-ce369d9b7a37 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:52.111697 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f601541-4ec2-4fa9-82a2-ce369d9b7a37 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:52.116328 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9005e-5bfc-4f66-a36e-13c0a41a30aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:52.117099 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9005e-5bfc-4f66-a36e-13c0a41a30aa admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:52.117400 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9005e-5bfc-4f66-a36e-13c0a41a30aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:52.117684 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9005e-5bfc-4f66-a36e-13c0a41a30aa admin admin] PATH_INFO: `/v3/projects/5dc79fa79fcf486eae15f60a239adcc4/users/435679c4b6a4463e9c8c420981f4e599/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:52.132820 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9005e-5bfc-4f66-a36e-13c0a41a30aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc79fa79fcf486eae15f60a239adcc4, user_id=435679c4b6a4463e9c8c420981f4e599, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:52.135563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9005e-5bfc-4f66-a36e-13c0a41a30aa admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:52.264261 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1009/2007] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:52 2022] PUT /identity/v3/projects/5dc79fa79fcf486eae15f60a239adcc4/users/435679c4b6a4463e9c8c420981f4e599/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:52.268757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fb2bf-3a3b-47ea-b8df-14854ab093cd admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:52.279394 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fb2bf-3a3b-47ea-b8df-14854ab093cd admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:52.343041 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9814e-cc7a-42b3-bc7c-da44d9a054ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:52.343041 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9814e-cc7a-42b3-bc7c-da44d9a054ed admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:52.343340 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9814e-cc7a-42b3-bc7c-da44d9a054ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:52.343574 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9814e-cc7a-42b3-bc7c-da44d9a054ed admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:52.344251 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9814e-cc7a-42b3-bc7c-da44d9a054ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:52.349609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9814e-cc7a-42b3-bc7c-da44d9a054ed admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:52.356994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 999/2008] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:52.361426 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9005e-5bfc-4f66-a36e-13c0a41a30aa admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:52.372430 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9005e-5bfc-4f66-a36e-13c0a41a30aa admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:52.377402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18648acf-08f6-40e4-898f-884f40dcb96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:52.378085 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18648acf-08f6-40e4-898f-884f40dcb96f admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:52.378923 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18648acf-08f6-40e4-898f-884f40dcb96f admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:52.379293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18648acf-08f6-40e4-898f-884f40dcb96f admin admin] PATH_INFO: `/v3/projects/5dc79fa79fcf486eae15f60a239adcc4/users/435679c4b6a4463e9c8c420981f4e599/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:52.380626 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:52.381490 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18648acf-08f6-40e4-898f-884f40dcb96f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc79fa79fcf486eae15f60a239adcc4, user_id=435679c4b6a4463e9c8c420981f4e599, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:52.384870 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18648acf-08f6-40e4-898f-884f40dcb96f admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:52.397248 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1010/2009] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:52 2022] PUT /identity/v3/projects/5dc79fa79fcf486eae15f60a239adcc4/users/435679c4b6a4463e9c8c420981f4e599/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:52.409105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0505011-017a-4815-93bb-7e94e1c748bb None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:52.409422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0505011-017a-4815-93bb-7e94e1c748bb None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:52.409700 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0505011-017a-4815-93bb-7e94e1c748bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:52.440866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-d0505011-017a-4815-93bb-7e94e1c748bb None None] MFA Rules not processed for user `435679c4b6a4463e9c8c420981f4e599`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:52.442171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d0505011-017a-4815-93bb-7e94e1c748bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:52.524360 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1000/2010] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:52.535397 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18648acf-08f6-40e4-898f-884f40dcb96f admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:52.537962 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-18648acf-08f6-40e4-898f-884f40dcb96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:52.601726 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18648acf-08f6-40e4-898f-884f40dcb96f admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:52.605314 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d01f79-b5b0-4665-9d14-d125f4288803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:52.605989 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d01f79-b5b0-4665-9d14-d125f4288803 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:52.606219 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d01f79-b5b0-4665-9d14-d125f4288803 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:52.606542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d01f79-b5b0-4665-9d14-d125f4288803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:52.615259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d01f79-b5b0-4665-9d14-d125f4288803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:52.617407 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d01f79-b5b0-4665-9d14-d125f4288803 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:52.627155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1011/2011] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:52.781205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0505011-017a-4815-93bb-7e94e1c748bb None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:52.783097 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d0505011-017a-4815-93bb-7e94e1c748bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:52.796999 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0505011-017a-4815-93bb-7e94e1c748bb None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:52.801437 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc913f6-32e2-485e-a276-e54ed25fa8c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:52.802183 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc913f6-32e2-485e-a276-e54ed25fa8c8 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:52.805513 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc913f6-32e2-485e-a276-e54ed25fa8c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:52.805513 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc913f6-32e2-485e-a276-e54ed25fa8c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:52.875391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc913f6-32e2-485e-a276-e54ed25fa8c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:52.877858 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc913f6-32e2-485e-a276-e54ed25fa8c8 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:52.890328 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1001/2012] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:53.527233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:54.292701 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:54.791810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d01f79-b5b0-4665-9d14-d125f4288803 service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:54.794199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-76d01f79-b5b0-4665-9d14-d125f4288803 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:54.887255 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d01f79-b5b0-4665-9d14-d125f4288803 service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:54.892701 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfce7e8-8f52-4340-baa6-969f4433ea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:54.893664 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfce7e8-8f52-4340-baa6-969f4433ea84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:54.893952 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfce7e8-8f52-4340-baa6-969f4433ea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:54.897442 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfce7e8-8f52-4340-baa6-969f4433ea84 admin admin] PATH_INFO: `/v3/users/34ef9b0c91e643069cd2129fc5d27873` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:54.897442 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfce7e8-8f52-4340-baa6-969f4433ea84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ef9b0c91e643069cd2129fc5d27873)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:54.897753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfce7e8-8f52-4340-baa6-969f4433ea84 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:55.117582 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-2dfce7e8-8f52-4340-baa6-969f4433ea84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ef9b0c91e643069cd2129fc5d27873'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:55.118244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-2dfce7e8-8f52-4340-baa6-969f4433ea84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ef9b0c91e643069cd2129fc5d27873'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:55.131166 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-2dfce7e8-8f52-4340-baa6-969f4433ea84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ef9b0c91e643069cd2129fc5d27873'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:55.210136 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-2dfce7e8-8f52-4340-baa6-969f4433ea84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ef9b0c91e643069cd2129fc5d27873'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:55.210136 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-2dfce7e8-8f52-4340-baa6-969f4433ea84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ef9b0c91e643069cd2129fc5d27873'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:55.224741 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1012/2013] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:54 2022] DELETE /identity/v3/users/34ef9b0c91e643069cd2129fc5d27873 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:55.229398 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99011741-4e58-46fc-bdea-590094ce3a32 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:55.229757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99011741-4e58-46fc-bdea-590094ce3a32 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:55.230160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99011741-4e58-46fc-bdea-590094ce3a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:55.250267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-99011741-4e58-46fc-bdea-590094ce3a32 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:55.251608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-99011741-4e58-46fc-bdea-590094ce3a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:55.315358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1002/2014] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:55.325534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfce7e8-8f52-4340-baa6-969f4433ea84 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:55.326997 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2dfce7e8-8f52-4340-baa6-969f4433ea84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:55.385383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfce7e8-8f52-4340-baa6-969f4433ea84 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:55.388975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd6ac4-25af-4869-8c24-1cfeb5e8dcea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:55.389588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd6ac4-25af-4869-8c24-1cfeb5e8dcea service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:55.389869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd6ac4-25af-4869-8c24-1cfeb5e8dcea service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:55.390143 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd6ac4-25af-4869-8c24-1cfeb5e8dcea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:55.399287 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd6ac4-25af-4869-8c24-1cfeb5e8dcea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:55.400833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd6ac4-25af-4869-8c24-1cfeb5e8dcea service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:55.410058 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1013/2015] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:55.848687 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99011741-4e58-46fc-bdea-590094ce3a32 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:55.850972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-99011741-4e58-46fc-bdea-590094ce3a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:55.869164 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99011741-4e58-46fc-bdea-590094ce3a32 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:55.873950 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653daea1-602a-48cb-acdb-3745c70c5a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:55.874721 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653daea1-602a-48cb-acdb-3745c70c5a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:55.875009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653daea1-602a-48cb-acdb-3745c70c5a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:55.875289 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653daea1-602a-48cb-acdb-3745c70c5a0a admin admin] PATH_INFO: `/v3/projects/e1b465dc739d4a17ab9eb2de456c910b` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:55.876572 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653daea1-602a-48cb-acdb-3745c70c5a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b465dc739d4a17ab9eb2de456c910b)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:55.878707 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653daea1-602a-48cb-acdb-3745c70c5a0a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:56.026490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-653daea1-602a-48cb-acdb-3745c70c5a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b465dc739d4a17ab9eb2de456c910b', 'request_id': 'req-653daea1-602a-48cb-acdb-3745c70c5a0a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:56.033241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-653daea1-602a-48cb-acdb-3745c70c5a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b465dc739d4a17ab9eb2de456c910b', 'request_id': 'req-653daea1-602a-48cb-acdb-3745c70c5a0a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:56.126282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-653daea1-602a-48cb-acdb-3745c70c5a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b465dc739d4a17ab9eb2de456c910b', 'request_id': 'req-653daea1-602a-48cb-acdb-3745c70c5a0a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:56.138111 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-653daea1-602a-48cb-acdb-3745c70c5a0a admin admin] The token cache is being invalidate because project e1b465dc739d4a17ab9eb2de456c910b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:56.138452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-653daea1-602a-48cb-acdb-3745c70c5a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:56.139111 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-653daea1-602a-48cb-acdb-3745c70c5a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:56.143110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1003/2016] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:55 2022] DELETE /identity/v3/projects/e1b465dc739d4a17ab9eb2de456c910b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:56.146152 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd6ac4-25af-4869-8c24-1cfeb5e8dcea service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:56.156482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd6ac4-25af-4869-8c24-1cfeb5e8dcea service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:56.213072 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54be07-2e34-45dc-97ba-bff9fe1cab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:56.213662 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54be07-2e34-45dc-97ba-bff9fe1cab47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:56.213927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54be07-2e34-45dc-97ba-bff9fe1cab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:56.214206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54be07-2e34-45dc-97ba-bff9fe1cab47 admin admin] PATH_INFO: `/v3/users/7dfda6c094d3404caabf8baf74c11052` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:56.215450 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54be07-2e34-45dc-97ba-bff9fe1cab47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dfda6c094d3404caabf8baf74c11052)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:56.217419 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54be07-2e34-45dc-97ba-bff9fe1cab47 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:56.323665 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:56.415555 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9f54be07-2e34-45dc-97ba-bff9fe1cab47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dfda6c094d3404caabf8baf74c11052'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:56.416208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9f54be07-2e34-45dc-97ba-bff9fe1cab47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dfda6c094d3404caabf8baf74c11052'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:56.427990 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9f54be07-2e34-45dc-97ba-bff9fe1cab47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dfda6c094d3404caabf8baf74c11052'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:56.543680 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9f54be07-2e34-45dc-97ba-bff9fe1cab47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dfda6c094d3404caabf8baf74c11052'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:56.544600 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9f54be07-2e34-45dc-97ba-bff9fe1cab47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dfda6c094d3404caabf8baf74c11052'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:56.558458 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1014/2017] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:56 2022] DELETE /identity/v3/users/7dfda6c094d3404caabf8baf74c11052 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:56.744719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:57.191972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653daea1-602a-48cb-acdb-3745c70c5a0a admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:57.194225 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-653daea1-602a-48cb-acdb-3745c70c5a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:57.215053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54be07-2e34-45dc-97ba-bff9fe1cab47 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:57.216864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-9f54be07-2e34-45dc-97ba-bff9fe1cab47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:57.281228 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653daea1-602a-48cb-acdb-3745c70c5a0a admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:57.317745 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54be07-2e34-45dc-97ba-bff9fe1cab47 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:57.323292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebaf384-3ac2-4c0b-93d8-6c54847e2822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:57.324013 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaf384-3ac2-4c0b-93d8-6c54847e2822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:57.324308 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaf384-3ac2-4c0b-93d8-6c54847e2822 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:57.324590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaf384-3ac2-4c0b-93d8-6c54847e2822 admin admin] PATH_INFO: `/v3/projects/7e77b8083afa4443ac75213faeaecb6d` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:57.326051 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebaf384-3ac2-4c0b-93d8-6c54847e2822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e77b8083afa4443ac75213faeaecb6d)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:57.328056 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebaf384-3ac2-4c0b-93d8-6c54847e2822 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:57.338668 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3455a6-7cdd-4c81-8c5f-42733a7772ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:57.342618 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3455a6-7cdd-4c81-8c5f-42733a7772ec service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:57.342618 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3455a6-7cdd-4c81-8c5f-42733a7772ec service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:57.342618 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3455a6-7cdd-4c81-8c5f-42733a7772ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:57.343218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-0a3455a6-7cdd-4c81-8c5f-42733a7772ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:57.409032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3455a6-7cdd-4c81-8c5f-42733a7772ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:57.410639 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3455a6-7cdd-4c81-8c5f-42733a7772ec service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:57.423381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1004/2018] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:57.546450 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-8ebaf384-3ac2-4c0b-93d8-6c54847e2822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e77b8083afa4443ac75213faeaecb6d', 'request_id': 'req-8ebaf384-3ac2-4c0b-93d8-6c54847e2822'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:57.553199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-8ebaf384-3ac2-4c0b-93d8-6c54847e2822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e77b8083afa4443ac75213faeaecb6d', 'request_id': 'req-8ebaf384-3ac2-4c0b-93d8-6c54847e2822'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:57.559277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-8ebaf384-3ac2-4c0b-93d8-6c54847e2822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e77b8083afa4443ac75213faeaecb6d', 'request_id': 'req-8ebaf384-3ac2-4c0b-93d8-6c54847e2822'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:57.703721 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-8ebaf384-3ac2-4c0b-93d8-6c54847e2822 admin admin] The token cache is being invalidate because project 7e77b8083afa4443ac75213faeaecb6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:00:57.704245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-8ebaf384-3ac2-4c0b-93d8-6c54847e2822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:57.704887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-8ebaf384-3ac2-4c0b-93d8-6c54847e2822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:57.706451 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1015/2019] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:57 2022] DELETE /identity/v3/projects/7e77b8083afa4443ac75213faeaecb6d => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:57.712005 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0084685-c93c-436c-930e-d35045ba7729 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:57.712327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0084685-c93c-436c-930e-d35045ba7729 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:57.712562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0084685-c93c-436c-930e-d35045ba7729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:57.733047 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-d0084685-c93c-436c-930e-d35045ba7729 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:57.734284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d0084685-c93c-436c-930e-d35045ba7729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:57.796888 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1005/2020] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:57.804793 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069aa49-c50c-448c-b359-508c090fcd28 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:57.805081 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069aa49-c50c-448c-b359-508c090fcd28 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:57.805358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069aa49-c50c-448c-b359-508c090fcd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:57.826208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-d069aa49-c50c-448c-b359-508c090fcd28 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:57.827621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d069aa49-c50c-448c-b359-508c090fcd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:57.835620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1016/2021] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:57.840727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0084685-c93c-436c-930e-d35045ba7729 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:57.850614 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0084685-c93c-436c-930e-d35045ba7729 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:57.855460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86fcaf-1781-40b2-9090-393fad5c8af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:57.856338 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86fcaf-1781-40b2-9090-393fad5c8af2 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:57.856691 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86fcaf-1781-40b2-9090-393fad5c8af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:57.857034 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86fcaf-1781-40b2-9090-393fad5c8af2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:57.857805 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86fcaf-1781-40b2-9090-393fad5c8af2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:00:57.858115 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86fcaf-1781-40b2-9090-393fad5c8af2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:57.859822 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86fcaf-1781-40b2-9090-393fad5c8af2 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:57.871787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1006/2022] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:00:57.877295 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069aa49-c50c-448c-b359-508c090fcd28 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:57.887966 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069aa49-c50c-448c-b359-508c090fcd28 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:57.892728 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86756c1e-77fc-4775-9b82-a5a19657f8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:57.893612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86756c1e-77fc-4775-9b82-a5a19657f8c2 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:57.893903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86756c1e-77fc-4775-9b82-a5a19657f8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:57.894189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86756c1e-77fc-4775-9b82-a5a19657f8c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:57.896031 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86756c1e-77fc-4775-9b82-a5a19657f8c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:57.896837 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86756c1e-77fc-4775-9b82-a5a19657f8c2 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:58.029937 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1017/2023] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:57 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:58.031160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86fcaf-1781-40b2-9090-393fad5c8af2 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:58.042115 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86fcaf-1781-40b2-9090-393fad5c8af2 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:58.100644 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de79c2-18e6-4ce3-9b9f-3136466c7369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:58.101276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de79c2-18e6-4ce3-9b9f-3136466c7369 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:58.105112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de79c2-18e6-4ce3-9b9f-3136466c7369 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:58.105407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de79c2-18e6-4ce3-9b9f-3136466c7369 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:58.106093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de79c2-18e6-4ce3-9b9f-3136466c7369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:58.108210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de79c2-18e6-4ce3-9b9f-3136466c7369 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:58.240463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1007/2024] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:58 2022] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:00:58.242929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86756c1e-77fc-4775-9b82-a5a19657f8c2 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:58.254253 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86756c1e-77fc-4775-9b82-a5a19657f8c2 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:58.269626 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a55545-cd40-4c97-aa49-73dc2c4d7d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:58.270532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a55545-cd40-4c97-aa49-73dc2c4d7d4c admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:58.270871 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a55545-cd40-4c97-aa49-73dc2c4d7d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:58.271223 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a55545-cd40-4c97-aa49-73dc2c4d7d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:58.272123 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a55545-cd40-4c97-aa49-73dc2c4d7d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:58.274608 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a55545-cd40-4c97-aa49-73dc2c4d7d4c admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:58.287065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1018/2025] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:58.291378 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de79c2-18e6-4ce3-9b9f-3136466c7369 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:58.302720 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de79c2-18e6-4ce3-9b9f-3136466c7369 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:58.310424 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19982efc-0f26-4cc0-b086-53834d5bdb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:58.311333 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19982efc-0f26-4cc0-b086-53834d5bdb0c admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:58.311764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19982efc-0f26-4cc0-b086-53834d5bdb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:58.312235 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19982efc-0f26-4cc0-b086-53834d5bdb0c admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:58.313140 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19982efc-0f26-4cc0-b086-53834d5bdb0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:58.316832 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19982efc-0f26-4cc0-b086-53834d5bdb0c admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:58.335155 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1008/2026] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:00:58.343798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a55545-cd40-4c97-aa49-73dc2c4d7d4c admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:58.360839 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a55545-cd40-4c97-aa49-73dc2c4d7d4c admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:58.365845 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c9a4c-47ab-465d-bbcb-26159c3ff893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:58.366581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c9a4c-47ab-465d-bbcb-26159c3ff893 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:58.366876 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c9a4c-47ab-465d-bbcb-26159c3ff893 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:58.368290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c9a4c-47ab-465d-bbcb-26159c3ff893 admin admin] PATH_INFO: `/v3/projects/4f86828807e345e3964cfdc31ba1755c/users/6bbb8e44b4194aa8a7e1c54fb3c04c8b/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:58.386586 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c9a4c-47ab-465d-bbcb-26159c3ff893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f86828807e345e3964cfdc31ba1755c, user_id=6bbb8e44b4194aa8a7e1c54fb3c04c8b, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:58.391244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c9a4c-47ab-465d-bbcb-26159c3ff893 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:58.505624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1019/2027] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:58 2022] PUT /identity/v3/projects/4f86828807e345e3964cfdc31ba1755c/users/6bbb8e44b4194aa8a7e1c54fb3c04c8b/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:58.524791 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168f7bf-1d2f-4dca-8259-49f70fd7f3f3 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:58.525272 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168f7bf-1d2f-4dca-8259-49f70fd7f3f3 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:58.525613 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168f7bf-1d2f-4dca-8259-49f70fd7f3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:58.564978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-2168f7bf-1d2f-4dca-8259-49f70fd7f3f3 None None] MFA Rules not processed for user `6bbb8e44b4194aa8a7e1c54fb3c04c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:58.566243 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2168f7bf-1d2f-4dca-8259-49f70fd7f3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:58.661068 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1009/2028] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:58.662509 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c9a4c-47ab-465d-bbcb-26159c3ff893 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:58.764071 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168f7bf-1d2f-4dca-8259-49f70fd7f3f3 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:58.766381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2168f7bf-1d2f-4dca-8259-49f70fd7f3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:58.773676 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c9a4c-47ab-465d-bbcb-26159c3ff893 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:58.780217 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5cee9-65a5-4a7c-a256-b47e520b4647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:58.781171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5cee9-65a5-4a7c-a256-b47e520b4647 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:58.781607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5cee9-65a5-4a7c-a256-b47e520b4647 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:58.782137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5cee9-65a5-4a7c-a256-b47e520b4647 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:58.783037 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5cee9-65a5-4a7c-a256-b47e520b4647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:58.784360 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168f7bf-1d2f-4dca-8259-49f70fd7f3f3 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:58.786118 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5cee9-65a5-4a7c-a256-b47e520b4647 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:58.792918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99c5b3-52d2-4fcc-8ad0-97d656a58758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:58.793671 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99c5b3-52d2-4fcc-8ad0-97d656a58758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:58.794034 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99c5b3-52d2-4fcc-8ad0-97d656a58758 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:58.794535 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99c5b3-52d2-4fcc-8ad0-97d656a58758 admin admin] PATH_INFO: `/v3/users/8b3e4a1d6af14afbad4edea82ec51fb6` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:58.800633 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99c5b3-52d2-4fcc-8ad0-97d656a58758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b3e4a1d6af14afbad4edea82ec51fb6)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:58.800633 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99c5b3-52d2-4fcc-8ad0-97d656a58758 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:58.887311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:58.931878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1020/2029] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:00:58 2022] POST /identity/v3/projects => generated 363 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:58.938368 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5cee9-65a5-4a7c-a256-b47e520b4647 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:59.000209 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-8e99c5b3-52d2-4fcc-8ad0-97d656a58758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b3e4a1d6af14afbad4edea82ec51fb6'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:59.008744 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-8e99c5b3-52d2-4fcc-8ad0-97d656a58758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b3e4a1d6af14afbad4edea82ec51fb6'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:59.015889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5cee9-65a5-4a7c-a256-b47e520b4647 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:59.021431 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82209407-dc15-4159-b265-fe0ca6869dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:59.027469 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82209407-dc15-4159-b265-fe0ca6869dff admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:59.027469 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82209407-dc15-4159-b265-fe0ca6869dff admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:59.027469 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82209407-dc15-4159-b265-fe0ca6869dff admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:59.027740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-8e99c5b3-52d2-4fcc-8ad0-97d656a58758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b3e4a1d6af14afbad4edea82ec51fb6'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:59.027865 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82209407-dc15-4159-b265-fe0ca6869dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:59.027988 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-8e99c5b3-52d2-4fcc-8ad0-97d656a58758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b3e4a1d6af14afbad4edea82ec51fb6'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:59.027988 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-8e99c5b3-52d2-4fcc-8ad0-97d656a58758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b3e4a1d6af14afbad4edea82ec51fb6'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:00:59.028140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82209407-dc15-4159-b265-fe0ca6869dff admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:59.161028 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1010/2030] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:00:58 2022] DELETE /identity/v3/users/8b3e4a1d6af14afbad4edea82ec51fb6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:59.166305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1021/2031] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:00:58 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:00:59.166448 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae3159-1e96-43ad-93d9-a25d50fe1355 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:59.166666 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae3159-1e96-43ad-93d9-a25d50fe1355 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:59.166932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae3159-1e96-43ad-93d9-a25d50fe1355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:59.170547 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82209407-dc15-4159-b265-fe0ca6869dff admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:59.173869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-82209407-dc15-4159-b265-fe0ca6869dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:59.197943 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-d8ae3159-1e96-43ad-93d9-a25d50fe1355 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:59.199271 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d8ae3159-1e96-43ad-93d9-a25d50fe1355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:59.202940 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82209407-dc15-4159-b265-fe0ca6869dff admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:59.243326 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:59.270658 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f6c2a-7c7e-451f-9ef0-6fc365d376de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:59.274461 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f6c2a-7c7e-451f-9ef0-6fc365d376de admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:59.274461 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f6c2a-7c7e-451f-9ef0-6fc365d376de admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:59.274461 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f6c2a-7c7e-451f-9ef0-6fc365d376de admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:59.274461 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f6c2a-7c7e-451f-9ef0-6fc365d376de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:59.276287 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f6c2a-7c7e-451f-9ef0-6fc365d376de admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:59.278267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1011/2032] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:59.292814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1022/2033] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:00:59.296050 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae3159-1e96-43ad-93d9-a25d50fe1355 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:59.298006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f6c2a-7c7e-451f-9ef0-6fc365d376de admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:59.299763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-de9f6c2a-7c7e-451f-9ef0-6fc365d376de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:59.306605 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae3159-1e96-43ad-93d9-a25d50fe1355 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:59.312241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb77f56-1fb9-4903-804f-f48f2ba4f7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:59.313138 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb77f56-1fb9-4903-804f-f48f2ba4f7d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:59.313592 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb77f56-1fb9-4903-804f-f48f2ba4f7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:59.314186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb77f56-1fb9-4903-804f-f48f2ba4f7d7 admin admin] PATH_INFO: `/v3/projects/9103e4c1a340451ab081bb15bb987488/users/861095b938d242a2a262e9b3f5e4c5a4/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:59.337325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb77f56-1fb9-4903-804f-f48f2ba4f7d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9103e4c1a340451ab081bb15bb987488, user_id=861095b938d242a2a262e9b3f5e4c5a4, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:59.340237 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb77f56-1fb9-4903-804f-f48f2ba4f7d7 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:59.368101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f6c2a-7c7e-451f-9ef0-6fc365d376de admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:59.372168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340a80b-db2d-4e20-877f-abcedd5c133b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:59.372986 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340a80b-db2d-4e20-877f-abcedd5c133b service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:59.373332 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340a80b-db2d-4e20-877f-abcedd5c133b service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:59.373811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340a80b-db2d-4e20-877f-abcedd5c133b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:59.383533 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340a80b-db2d-4e20-877f-abcedd5c133b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:59.385038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340a80b-db2d-4e20-877f-abcedd5c133b service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:59.396470 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1023/2034] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:00:59.420423 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1012/2035] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:59 2022] PUT /identity/v3/projects/9103e4c1a340451ab081bb15bb987488/users/861095b938d242a2a262e9b3f5e4c5a4/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:59.426917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340a80b-db2d-4e20-877f-abcedd5c133b service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:59.437354 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340a80b-db2d-4e20-877f-abcedd5c133b service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:59.501076 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13eecae-18f6-40dc-affd-c442b339fb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:59.501722 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13eecae-18f6-40dc-affd-c442b339fb88 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:59.502199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13eecae-18f6-40dc-affd-c442b339fb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:59.502435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13eecae-18f6-40dc-affd-c442b339fb88 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:59.503138 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13eecae-18f6-40dc-affd-c442b339fb88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:59.504775 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13eecae-18f6-40dc-affd-c442b339fb88 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:59.515538 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1024/2036] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:00:59.520234 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb77f56-1fb9-4903-804f-f48f2ba4f7d7 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:59.530989 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb77f56-1fb9-4903-804f-f48f2ba4f7d7 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:59.535568 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb95048-da0f-4f30-8ac6-ca37ef3d6e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:59.536236 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb95048-da0f-4f30-8ac6-ca37ef3d6e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:59.536568 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb95048-da0f-4f30-8ac6-ca37ef3d6e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:59.536857 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb95048-da0f-4f30-8ac6-ca37ef3d6e91 admin admin] PATH_INFO: `/v3/projects/9103e4c1a340451ab081bb15bb987488/users/861095b938d242a2a262e9b3f5e4c5a4/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:59.538894 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb95048-da0f-4f30-8ac6-ca37ef3d6e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9103e4c1a340451ab081bb15bb987488, user_id=861095b938d242a2a262e9b3f5e4c5a4, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:59.542296 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb95048-da0f-4f30-8ac6-ca37ef3d6e91 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:59.553336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1013/2037] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:00:59 2022] PUT /identity/v3/projects/9103e4c1a340451ab081bb15bb987488/users/861095b938d242a2a262e9b3f5e4c5a4/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:00:59.563845 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4efb5-3299-4525-ad16-7a1d48e7b330 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:59.564142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4efb5-3299-4525-ad16-7a1d48e7b330 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:59.564429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4efb5-3299-4525-ad16-7a1d48e7b330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:59.597275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-63e4efb5-3299-4525-ad16-7a1d48e7b330 None None] MFA Rules not processed for user `861095b938d242a2a262e9b3f5e4c5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:00:59.598688 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-63e4efb5-3299-4525-ad16-7a1d48e7b330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:59.691779 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1025/2038] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:00:59 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:00:59.702946 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb95048-da0f-4f30-8ac6-ca37ef3d6e91 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:59.705443 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-7eb95048-da0f-4f30-8ac6-ca37ef3d6e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:59.778550 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb95048-da0f-4f30-8ac6-ca37ef3d6e91 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:59.783133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d122ec-9f5e-4ee9-96cf-282a15456a3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:59.783771 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d122ec-9f5e-4ee9-96cf-282a15456a3d service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:59.784052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d122ec-9f5e-4ee9-96cf-282a15456a3d service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:59.784411 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d122ec-9f5e-4ee9-96cf-282a15456a3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:59.797502 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d122ec-9f5e-4ee9-96cf-282a15456a3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:59.797502 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d122ec-9f5e-4ee9-96cf-282a15456a3d service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:00:59.808104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1014/2039] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:00:59 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:00:59.882379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4efb5-3299-4525-ad16-7a1d48e7b330 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:00:59.884621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-63e4efb5-3299-4525-ad16-7a1d48e7b330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:00:59.952534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4efb5-3299-4525-ad16-7a1d48e7b330 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:00:59.957778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd27c4e-a39e-4086-bf23-942a18598b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:00:59.958565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd27c4e-a39e-4086-bf23-942a18598b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:00:59.958951 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd27c4e-a39e-4086-bf23-942a18598b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:00:59.959475 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd27c4e-a39e-4086-bf23-942a18598b16 admin admin] PATH_INFO: `/v3/projects/476bcbb767fc4e6eb5d7ada6ece91a16` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:00:59.961706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd27c4e-a39e-4086-bf23-942a18598b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=476bcbb767fc4e6eb5d7ada6ece91a16)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:00:59.963342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd27c4e-a39e-4086-bf23-942a18598b16 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:00.115667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3fd27c4e-a39e-4086-bf23-942a18598b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '476bcbb767fc4e6eb5d7ada6ece91a16', 'request_id': 'req-3fd27c4e-a39e-4086-bf23-942a18598b16'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:00.128207 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3fd27c4e-a39e-4086-bf23-942a18598b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '476bcbb767fc4e6eb5d7ada6ece91a16', 'request_id': 'req-3fd27c4e-a39e-4086-bf23-942a18598b16'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:00.151244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3fd27c4e-a39e-4086-bf23-942a18598b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '476bcbb767fc4e6eb5d7ada6ece91a16', 'request_id': 'req-3fd27c4e-a39e-4086-bf23-942a18598b16'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:00.196450 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:00.229860 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3fd27c4e-a39e-4086-bf23-942a18598b16 admin admin] The token cache is being invalidate because project 476bcbb767fc4e6eb5d7ada6ece91a16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:01:00.230210 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3fd27c4e-a39e-4086-bf23-942a18598b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:00.230974 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3fd27c4e-a39e-4086-bf23-942a18598b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:00.233007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1026/2040] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:00:59 2022] DELETE /identity/v3/projects/476bcbb767fc4e6eb5d7ada6ece91a16 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:00.236935 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d122ec-9f5e-4ee9-96cf-282a15456a3d service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:00.267447 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d122ec-9f5e-4ee9-96cf-282a15456a3d service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:00.358178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8b31e-eb2e-417c-aaed-28abb4d336c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:00.358979 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8b31e-eb2e-417c-aaed-28abb4d336c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:00.359271 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8b31e-eb2e-417c-aaed-28abb4d336c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:00.359553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8b31e-eb2e-417c-aaed-28abb4d336c8 admin admin] PATH_INFO: `/v3/users/50af4fedabd4493a93f47104a099bd1b` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:00.360786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8b31e-eb2e-417c-aaed-28abb4d336c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50af4fedabd4493a93f47104a099bd1b)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:00.362965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8b31e-eb2e-417c-aaed-28abb4d336c8 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:00.601176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-08c8b31e-eb2e-417c-aaed-28abb4d336c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50af4fedabd4493a93f47104a099bd1b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:00.611290 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-08c8b31e-eb2e-417c-aaed-28abb4d336c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50af4fedabd4493a93f47104a099bd1b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:00.629167 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-08c8b31e-eb2e-417c-aaed-28abb4d336c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50af4fedabd4493a93f47104a099bd1b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:00.635561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-08c8b31e-eb2e-417c-aaed-28abb4d336c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50af4fedabd4493a93f47104a099bd1b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:00.637015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-08c8b31e-eb2e-417c-aaed-28abb4d336c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50af4fedabd4493a93f47104a099bd1b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:00.781186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:00.787981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1015/2041] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:01:00 2022] DELETE /identity/v3/users/50af4fedabd4493a93f47104a099bd1b => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:01.149894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd27c4e-a39e-4086-bf23-942a18598b16 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:01.152254 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3fd27c4e-a39e-4086-bf23-942a18598b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:01.181759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd27c4e-a39e-4086-bf23-942a18598b16 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:01.271195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507ee52-c7f3-447e-a00f-d75e3b6ee6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:01.271670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507ee52-c7f3-447e-a00f-d75e3b6ee6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:01.271961 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507ee52-c7f3-447e-a00f-d75e3b6ee6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:01.272249 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507ee52-c7f3-447e-a00f-d75e3b6ee6c3 admin admin] PATH_INFO: `/v3/users/6bbb8e44b4194aa8a7e1c54fb3c04c8b` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:01.273482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507ee52-c7f3-447e-a00f-d75e3b6ee6c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bbb8e44b4194aa8a7e1c54fb3c04c8b)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:01.275692 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507ee52-c7f3-447e-a00f-d75e3b6ee6c3 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:01.363126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8b31e-eb2e-417c-aaed-28abb4d336c8 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:01.364768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-08c8b31e-eb2e-417c-aaed-28abb4d336c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:01.379018 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8b31e-eb2e-417c-aaed-28abb4d336c8 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:01.383965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea9759-dafa-4cf6-acf0-18bbb16a675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:01.384913 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea9759-dafa-4cf6-acf0-18bbb16a675a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:01.385200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea9759-dafa-4cf6-acf0-18bbb16a675a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:01.385522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea9759-dafa-4cf6-acf0-18bbb16a675a admin admin] PATH_INFO: `/v3/projects/bbd162f2c9b948aa8d760c0835ac191e` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:01.387059 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea9759-dafa-4cf6-acf0-18bbb16a675a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbd162f2c9b948aa8d760c0835ac191e)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:01.390112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea9759-dafa-4cf6-acf0-18bbb16a675a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:01.588228 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c507ee52-c7f3-447e-a00f-d75e3b6ee6c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bbb8e44b4194aa8a7e1c54fb3c04c8b'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:01.588798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-00ea9759-dafa-4cf6-acf0-18bbb16a675a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbd162f2c9b948aa8d760c0835ac191e', 'request_id': 'req-00ea9759-dafa-4cf6-acf0-18bbb16a675a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:01.589042 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c507ee52-c7f3-447e-a00f-d75e3b6ee6c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bbb8e44b4194aa8a7e1c54fb3c04c8b'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:01.596562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-00ea9759-dafa-4cf6-acf0-18bbb16a675a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbd162f2c9b948aa8d760c0835ac191e', 'request_id': 'req-00ea9759-dafa-4cf6-acf0-18bbb16a675a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:01.605865 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c507ee52-c7f3-447e-a00f-d75e3b6ee6c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bbb8e44b4194aa8a7e1c54fb3c04c8b'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:01.681521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-00ea9759-dafa-4cf6-acf0-18bbb16a675a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbd162f2c9b948aa8d760c0835ac191e', 'request_id': 'req-00ea9759-dafa-4cf6-acf0-18bbb16a675a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:01.692496 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-00ea9759-dafa-4cf6-acf0-18bbb16a675a admin admin] The token cache is being invalidate because project bbd162f2c9b948aa8d760c0835ac191e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:01:01.692787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-00ea9759-dafa-4cf6-acf0-18bbb16a675a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:01.693414 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-00ea9759-dafa-4cf6-acf0-18bbb16a675a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:01.696772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1016/2042] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:01:01 2022] DELETE /identity/v3/projects/bbd162f2c9b948aa8d760c0835ac191e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:01:01.698699 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea9759-dafa-4cf6-acf0-18bbb16a675a admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:01.700001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-00ea9759-dafa-4cf6-acf0-18bbb16a675a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:01.764046 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea9759-dafa-4cf6-acf0-18bbb16a675a admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:01.769545 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1a7df-83e4-4a8f-9416-9ca03b3cdade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:01.770196 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1a7df-83e4-4a8f-9416-9ca03b3cdade admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:01.770523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1a7df-83e4-4a8f-9416-9ca03b3cdade admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:01.770802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1a7df-83e4-4a8f-9416-9ca03b3cdade admin admin] PATH_INFO: `/v3/users/435679c4b6a4463e9c8c420981f4e599` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:01.771981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1a7df-83e4-4a8f-9416-9ca03b3cdade admin admin] RBAC: Authorizing `identity:delete_user(user_id=435679c4b6a4463e9c8c420981f4e599)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:01.774470 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1a7df-83e4-4a8f-9416-9ca03b3cdade admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:01.836171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c507ee52-c7f3-447e-a00f-d75e3b6ee6c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bbb8e44b4194aa8a7e1c54fb3c04c8b'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:01.836482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c507ee52-c7f3-447e-a00f-d75e3b6ee6c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bbb8e44b4194aa8a7e1c54fb3c04c8b'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:01.853743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1027/2043] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:01:01 2022] DELETE /identity/v3/users/6bbb8e44b4194aa8a7e1c54fb3c04c8b => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:01.854760 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507ee52-c7f3-447e-a00f-d75e3b6ee6c3 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:01.856173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c507ee52-c7f3-447e-a00f-d75e3b6ee6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:01.921402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507ee52-c7f3-447e-a00f-d75e3b6ee6c3 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:01.925981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5139017-b2eb-45c1-9931-e64476a1d62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:01.926710 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5139017-b2eb-45c1-9931-e64476a1d62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:01.926999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5139017-b2eb-45c1-9931-e64476a1d62c admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:01.927878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5139017-b2eb-45c1-9931-e64476a1d62c admin admin] PATH_INFO: `/v3/users/82ef5a99250c458f8a2b26cfb261410f` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:01.929283 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5139017-b2eb-45c1-9931-e64476a1d62c admin admin] RBAC: Authorizing `identity:delete_user(user_id=82ef5a99250c458f8a2b26cfb261410f)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:01.932022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5139017-b2eb-45c1-9931-e64476a1d62c admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:02.060813 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a1d1a7df-83e4-4a8f-9416-9ca03b3cdade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435679c4b6a4463e9c8c420981f4e599'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:02.068525 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a1d1a7df-83e4-4a8f-9416-9ca03b3cdade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435679c4b6a4463e9c8c420981f4e599'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:02.081857 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a1d1a7df-83e4-4a8f-9416-9ca03b3cdade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435679c4b6a4463e9c8c420981f4e599'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:02.082598 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a1d1a7df-83e4-4a8f-9416-9ca03b3cdade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435679c4b6a4463e9c8c420981f4e599'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:02.083233 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a1d1a7df-83e4-4a8f-9416-9ca03b3cdade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435679c4b6a4463e9c8c420981f4e599'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:02.166818 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1017/2044] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:01:01 2022] DELETE /identity/v3/users/435679c4b6a4463e9c8c420981f4e599 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:01:02.168127 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ca623-5b1d-4531-9cac-9b025432f2eb None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:02.168445 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ca623-5b1d-4531-9cac-9b025432f2eb None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:02.168725 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ca623-5b1d-4531-9cac-9b025432f2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:02.177087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-e5139017-b2eb-45c1-9931-e64476a1d62c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82ef5a99250c458f8a2b26cfb261410f'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:02.178024 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-e5139017-b2eb-45c1-9931-e64476a1d62c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82ef5a99250c458f8a2b26cfb261410f'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:02.188757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-937ca623-5b1d-4531-9cac-9b025432f2eb None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:02.190101 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-937ca623-5b1d-4531-9cac-9b025432f2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:02.191192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-e5139017-b2eb-45c1-9931-e64476a1d62c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82ef5a99250c458f8a2b26cfb261410f'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:02.252661 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1018/2045] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:02.263214 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ca623-5b1d-4531-9cac-9b025432f2eb None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:02.264590 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-937ca623-5b1d-4531-9cac-9b025432f2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:02.303800 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-e5139017-b2eb-45c1-9931-e64476a1d62c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82ef5a99250c458f8a2b26cfb261410f'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:02.304563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-e5139017-b2eb-45c1-9931-e64476a1d62c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82ef5a99250c458f8a2b26cfb261410f'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:02.321474 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1028/2046] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:01:01 2022] DELETE /identity/v3/users/82ef5a99250c458f8a2b26cfb261410f => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:02.324560 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ca623-5b1d-4531-9cac-9b025432f2eb None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:02.379986 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5680b5b-3428-419f-a702-bab27c8cbf65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:02.380708 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5680b5b-3428-419f-a702-bab27c8cbf65 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:02.381310 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5680b5b-3428-419f-a702-bab27c8cbf65 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:02.381310 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5680b5b-3428-419f-a702-bab27c8cbf65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:02.383203 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d5680b5b-3428-419f-a702-bab27c8cbf65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:02.464157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5680b5b-3428-419f-a702-bab27c8cbf65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:02.465756 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5680b5b-3428-419f-a702-bab27c8cbf65 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:02.478441 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1019/2047] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:01:02.680927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5139017-b2eb-45c1-9931-e64476a1d62c admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:02.683910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e5139017-b2eb-45c1-9931-e64476a1d62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:02.699294 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5139017-b2eb-45c1-9931-e64476a1d62c admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:02.704753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a7a9b-cafa-4b0c-a07b-cae5f602c29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:02.705437 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a7a9b-cafa-4b0c-a07b-cae5f602c29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:02.705729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a7a9b-cafa-4b0c-a07b-cae5f602c29f admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:02.706011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a7a9b-cafa-4b0c-a07b-cae5f602c29f admin admin] PATH_INFO: `/v3/projects/5dc79fa79fcf486eae15f60a239adcc4` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:02.707274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a7a9b-cafa-4b0c-a07b-cae5f602c29f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc79fa79fcf486eae15f60a239adcc4)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:02.709526 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a7a9b-cafa-4b0c-a07b-cae5f602c29f admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:02.761634 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:02.772303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5680b5b-3428-419f-a702-bab27c8cbf65 service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:02.774362 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d5680b5b-3428-419f-a702-bab27c8cbf65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:02.786691 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5680b5b-3428-419f-a702-bab27c8cbf65 service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:02.792513 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5099c-6f4f-4e68-a52b-b524b0d4279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:02.793205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5099c-6f4f-4e68-a52b-b524b0d4279d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:02.793717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5099c-6f4f-4e68-a52b-b524b0d4279d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:02.793866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5099c-6f4f-4e68-a52b-b524b0d4279d admin admin] PATH_INFO: `/v3/projects/6529b843e40548e4aefe4f4971269158` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:02.795213 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5099c-6f4f-4e68-a52b-b524b0d4279d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6529b843e40548e4aefe4f4971269158)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:02.797292 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5099c-6f4f-4e68-a52b-b524b0d4279d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:02.858479 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fe9a7a9b-cafa-4b0c-a07b-cae5f602c29f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc79fa79fcf486eae15f60a239adcc4', 'request_id': 'req-fe9a7a9b-cafa-4b0c-a07b-cae5f602c29f'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:02.864970 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fe9a7a9b-cafa-4b0c-a07b-cae5f602c29f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc79fa79fcf486eae15f60a239adcc4', 'request_id': 'req-fe9a7a9b-cafa-4b0c-a07b-cae5f602c29f'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:02.871448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fe9a7a9b-cafa-4b0c-a07b-cae5f602c29f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc79fa79fcf486eae15f60a239adcc4', 'request_id': 'req-fe9a7a9b-cafa-4b0c-a07b-cae5f602c29f'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:02.974052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0fa5099c-6f4f-4e68-a52b-b524b0d4279d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6529b843e40548e4aefe4f4971269158', 'request_id': 'req-0fa5099c-6f4f-4e68-a52b-b524b0d4279d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:02.980915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0fa5099c-6f4f-4e68-a52b-b524b0d4279d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6529b843e40548e4aefe4f4971269158', 'request_id': 'req-0fa5099c-6f4f-4e68-a52b-b524b0d4279d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:03.011472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fe9a7a9b-cafa-4b0c-a07b-cae5f602c29f admin admin] The token cache is being invalidate because project 5dc79fa79fcf486eae15f60a239adcc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:01:03.011472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fe9a7a9b-cafa-4b0c-a07b-cae5f602c29f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:03.011472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fe9a7a9b-cafa-4b0c-a07b-cae5f602c29f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:03.011472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1029/2048] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:01:02 2022] DELETE /identity/v3/projects/5dc79fa79fcf486eae15f60a239adcc4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:01:03.015507 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dafa0-07de-4d4a-839b-01bad71e45b0 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:03.015928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dafa0-07de-4d4a-839b-01bad71e45b0 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:03.016216 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dafa0-07de-4d4a-839b-01bad71e45b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:03.036187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-055dafa0-07de-4d4a-839b-01bad71e45b0 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:03.037422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-055dafa0-07de-4d4a-839b-01bad71e45b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:03.096965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1030/2049] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:01:03.105691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9c2b4-373e-419c-81e5-672be96fd515 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:03.105982 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9c2b4-373e-419c-81e5-672be96fd515 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:03.106369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9c2b4-373e-419c-81e5-672be96fd515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:03.126471 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0fa5099c-6f4f-4e68-a52b-b524b0d4279d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6529b843e40548e4aefe4f4971269158', 'request_id': 'req-0fa5099c-6f4f-4e68-a52b-b524b0d4279d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:03.127198 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-37f9c2b4-373e-419c-81e5-672be96fd515 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:03.128399 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-37f9c2b4-373e-419c-81e5-672be96fd515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:03.136300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1031/2050] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:03.137817 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0fa5099c-6f4f-4e68-a52b-b524b0d4279d admin admin] The token cache is being invalidate because project 6529b843e40548e4aefe4f4971269158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:01:03.138150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0fa5099c-6f4f-4e68-a52b-b524b0d4279d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:03.138850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0fa5099c-6f4f-4e68-a52b-b524b0d4279d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:03.140377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9c2b4-373e-419c-81e5-672be96fd515 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:03.140620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1020/2051] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:01:02 2022] DELETE /identity/v3/projects/6529b843e40548e4aefe4f4971269158 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:01:03.145260 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f91f02-abac-45da-addd-6f6c5539f265 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:03.145557 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f91f02-abac-45da-addd-6f6c5539f265 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:03.145844 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f91f02-abac-45da-addd-6f6c5539f265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:03.149865 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9c2b4-373e-419c-81e5-672be96fd515 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:03.154829 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca1c27-b748-43c0-8970-ff588d96f54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:03.155488 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca1c27-b748-43c0-8970-ff588d96f54a admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:03.155733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca1c27-b748-43c0-8970-ff588d96f54a admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:03.157363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca1c27-b748-43c0-8970-ff588d96f54a admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:03.157363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca1c27-b748-43c0-8970-ff588d96f54a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:01:03.157363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca1c27-b748-43c0-8970-ff588d96f54a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:03.158581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca1c27-b748-43c0-8970-ff588d96f54a admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:03.167714 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-93f91f02-abac-45da-addd-6f6c5539f265 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:03.169056 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-93f91f02-abac-45da-addd-6f6c5539f265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:03.177602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1021/2052] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:01:03.185236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1032/2053] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:01:03.190109 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f25be-f5ab-4f04-b9fd-d0b6e7ec9140 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:03.190109 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f25be-f5ab-4f04-b9fd-d0b6e7ec9140 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:03.190109 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f25be-f5ab-4f04-b9fd-d0b6e7ec9140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:03.191233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca1c27-b748-43c0-8970-ff588d96f54a admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:03.192930 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4aca1c27-b748-43c0-8970-ff588d96f54a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:03.206176 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca1c27-b748-43c0-8970-ff588d96f54a admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:03.211236 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-526f25be-f5ab-4f04-b9fd-d0b6e7ec9140 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:03.211236 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-526f25be-f5ab-4f04-b9fd-d0b6e7ec9140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:03.211666 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0d6e3-034e-4ecd-b906-95eaa1214b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:03.212290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0d6e3-034e-4ecd-b906-95eaa1214b57 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:03.212577 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0d6e3-034e-4ecd-b906-95eaa1214b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:03.212858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0d6e3-034e-4ecd-b906-95eaa1214b57 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:03.213534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0d6e3-034e-4ecd-b906-95eaa1214b57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:03.215612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0d6e3-034e-4ecd-b906-95eaa1214b57 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:03.218693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1022/2054] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:01:03.222776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f25be-f5ab-4f04-b9fd-d0b6e7ec9140 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:03.232501 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f25be-f5ab-4f04-b9fd-d0b6e7ec9140 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:03.237286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8d8d5-d2e8-4cc6-81c3-e3ac57c7f15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:03.237899 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8d8d5-d2e8-4cc6-81c3-e3ac57c7f15a admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:03.238223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8d8d5-d2e8-4cc6-81c3-e3ac57c7f15a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:03.238560 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8d8d5-d2e8-4cc6-81c3-e3ac57c7f15a admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:03.239397 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8d8d5-d2e8-4cc6-81c3-e3ac57c7f15a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:01:03.239704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8d8d5-d2e8-4cc6-81c3-e3ac57c7f15a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:03.241481 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8d8d5-d2e8-4cc6-81c3-e3ac57c7f15a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:03.254747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1023/2055] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:01:03.255593 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8d8d5-d2e8-4cc6-81c3-e3ac57c7f15a admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:03.257341 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-55c8d8d5-d2e8-4cc6-81c3-e3ac57c7f15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:03.270821 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8d8d5-d2e8-4cc6-81c3-e3ac57c7f15a admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:03.275692 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de855f9e-93c4-44c5-a9d2-abcb159b746c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:03.276346 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de855f9e-93c4-44c5-a9d2-abcb159b746c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:03.276635 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de855f9e-93c4-44c5-a9d2-abcb159b746c admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:03.276914 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de855f9e-93c4-44c5-a9d2-abcb159b746c admin admin] PATH_INFO: `/v3/projects/4f86828807e345e3964cfdc31ba1755c` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:03.278084 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de855f9e-93c4-44c5-a9d2-abcb159b746c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f86828807e345e3964cfdc31ba1755c)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:03.280222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de855f9e-93c4-44c5-a9d2-abcb159b746c admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:03.368369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1033/2056] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:01:03 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:03.369148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0d6e3-034e-4ecd-b906-95eaa1214b57 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:03.404175 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-de855f9e-93c4-44c5-a9d2-abcb159b746c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f86828807e345e3964cfdc31ba1755c', 'request_id': 'req-de855f9e-93c4-44c5-a9d2-abcb159b746c'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:03.412780 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-de855f9e-93c4-44c5-a9d2-abcb159b746c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f86828807e345e3964cfdc31ba1755c', 'request_id': 'req-de855f9e-93c4-44c5-a9d2-abcb159b746c'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:03.433897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0d6e3-034e-4ecd-b906-95eaa1214b57 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:03.489349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12208cfc-b694-4bc8-8d98-2aa936147734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:03.490014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12208cfc-b694-4bc8-8d98-2aa936147734 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:03.490347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12208cfc-b694-4bc8-8d98-2aa936147734 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:03.490697 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12208cfc-b694-4bc8-8d98-2aa936147734 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:03.491361 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12208cfc-b694-4bc8-8d98-2aa936147734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:03.493843 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12208cfc-b694-4bc8-8d98-2aa936147734 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:03.509746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-de855f9e-93c4-44c5-a9d2-abcb159b746c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f86828807e345e3964cfdc31ba1755c', 'request_id': 'req-de855f9e-93c4-44c5-a9d2-abcb159b746c'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:03.521490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:03.523141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-de855f9e-93c4-44c5-a9d2-abcb159b746c admin admin] The token cache is being invalidate because project 4f86828807e345e3964cfdc31ba1755c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:01:03.523599 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-de855f9e-93c4-44c5-a9d2-abcb159b746c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:03.524287 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-de855f9e-93c4-44c5-a9d2-abcb159b746c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:03.526113 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1024/2057] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:01:03 2022] DELETE /identity/v3/projects/4f86828807e345e3964cfdc31ba1755c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:03.526914 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de855f9e-93c4-44c5-a9d2-abcb159b746c admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:03.528223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-de855f9e-93c4-44c5-a9d2-abcb159b746c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:03.541363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de855f9e-93c4-44c5-a9d2-abcb159b746c admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:03.546079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8554f-def4-452c-8a94-e433b90a9e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:03.546731 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8554f-def4-452c-8a94-e433b90a9e9a admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:03.547017 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8554f-def4-452c-8a94-e433b90a9e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:03.547293 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8554f-def4-452c-8a94-e433b90a9e9a admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:03.548007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8554f-def4-452c-8a94-e433b90a9e9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:03.549912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8554f-def4-452c-8a94-e433b90a9e9a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:03.609956 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1034/2058] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:01:03 2022] POST /identity/v3/projects => generated 383 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:03.610355 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12208cfc-b694-4bc8-8d98-2aa936147734 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:03.613007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-12208cfc-b694-4bc8-8d98-2aa936147734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:03.641172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1025/2059] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:01:03 2022] POST /identity/v3/users => generated 284 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:03.643397 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8554f-def4-452c-8a94-e433b90a9e9a admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:03.645280 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e0a8554f-def4-452c-8a94-e433b90a9e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:03.657469 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8554f-def4-452c-8a94-e433b90a9e9a admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:03.680822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12208cfc-b694-4bc8-8d98-2aa936147734 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:03.686648 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742c56d-df5e-407e-983d-bf10818972df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:03.687438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742c56d-df5e-407e-983d-bf10818972df admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:03.687726 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742c56d-df5e-407e-983d-bf10818972df admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:03.688365 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742c56d-df5e-407e-983d-bf10818972df admin admin] PATH_INFO: `/v3/users/861095b938d242a2a262e9b3f5e4c5a4` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:03.689227 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742c56d-df5e-407e-983d-bf10818972df admin admin] RBAC: Authorizing `identity:delete_user(user_id=861095b938d242a2a262e9b3f5e4c5a4)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:03.691214 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742c56d-df5e-407e-983d-bf10818972df admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:03.721780 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa4358-4288-48af-90f1-882e28ef9a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:03.722415 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa4358-4288-48af-90f1-882e28ef9a9e admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:03.722727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa4358-4288-48af-90f1-882e28ef9a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:03.723003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa4358-4288-48af-90f1-882e28ef9a9e admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:03.723667 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa4358-4288-48af-90f1-882e28ef9a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:03.725749 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa4358-4288-48af-90f1-882e28ef9a9e admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:03.850449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1026/2060] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:01:03 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:03.851847 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa4358-4288-48af-90f1-882e28ef9a9e admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:03.853442 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-90aa4358-4288-48af-90f1-882e28ef9a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:03.865504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa4358-4288-48af-90f1-882e28ef9a9e admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:03.871183 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aee4c5-89ce-444c-9ebd-3cbe7bb20221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:03.881319 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee4c5-89ce-444c-9ebd-3cbe7bb20221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:03.881319 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee4c5-89ce-444c-9ebd-3cbe7bb20221 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:03.881319 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee4c5-89ce-444c-9ebd-3cbe7bb20221 admin admin] PATH_INFO: `/v3/users/518e3d9b2e584602835a7b26b260c8e7` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:03.881319 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aee4c5-89ce-444c-9ebd-3cbe7bb20221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=518e3d9b2e584602835a7b26b260c8e7)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:03.881319 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aee4c5-89ce-444c-9ebd-3cbe7bb20221 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:03.881783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3742c56d-df5e-407e-983d-bf10818972df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '861095b938d242a2a262e9b3f5e4c5a4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:03.881783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3742c56d-df5e-407e-983d-bf10818972df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '861095b938d242a2a262e9b3f5e4c5a4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:03.889820 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3742c56d-df5e-407e-983d-bf10818972df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '861095b938d242a2a262e9b3f5e4c5a4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:03.963535 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3742c56d-df5e-407e-983d-bf10818972df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '861095b938d242a2a262e9b3f5e4c5a4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:03.964806 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3742c56d-df5e-407e-983d-bf10818972df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '861095b938d242a2a262e9b3f5e4c5a4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:03.979896 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1035/2061] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:01:03 2022] DELETE /identity/v3/users/861095b938d242a2a262e9b3f5e4c5a4 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:03.979896 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742c56d-df5e-407e-983d-bf10818972df admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:03.982618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3742c56d-df5e-407e-983d-bf10818972df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:04.050736 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742c56d-df5e-407e-983d-bf10818972df admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:04.056282 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5799d-9e5a-46b2-b88e-c4dfd47e1c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:04.056918 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5799d-9e5a-46b2-b88e-c4dfd47e1c64 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:04.057209 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5799d-9e5a-46b2-b88e-c4dfd47e1c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:04.057488 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5799d-9e5a-46b2-b88e-c4dfd47e1c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:04.058205 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5799d-9e5a-46b2-b88e-c4dfd47e1c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:04.059915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5799d-9e5a-46b2-b88e-c4dfd47e1c64 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:04.073892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1036/2062] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:04.073892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5799d-9e5a-46b2-b88e-c4dfd47e1c64 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:04.073892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-16c5799d-9e5a-46b2-b88e-c4dfd47e1c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:04.087351 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5799d-9e5a-46b2-b88e-c4dfd47e1c64 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:04.088493 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-87aee4c5-89ce-444c-9ebd-3cbe7bb20221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '518e3d9b2e584602835a7b26b260c8e7'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:04.092193 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf037d3c-85f1-467d-9c46-6571f2023ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:04.092810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf037d3c-85f1-467d-9c46-6571f2023ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:04.093100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf037d3c-85f1-467d-9c46-6571f2023ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:04.093381 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf037d3c-85f1-467d-9c46-6571f2023ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:04.094080 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf037d3c-85f1-467d-9c46-6571f2023ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:04.095455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-87aee4c5-89ce-444c-9ebd-3cbe7bb20221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '518e3d9b2e584602835a7b26b260c8e7'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:04.095721 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf037d3c-85f1-467d-9c46-6571f2023ea9 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:04.107228 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1037/2063] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:04.108083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf037d3c-85f1-467d-9c46-6571f2023ea9 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:04.112646 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-87aee4c5-89ce-444c-9ebd-3cbe7bb20221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '518e3d9b2e584602835a7b26b260c8e7'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:04.113427 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-87aee4c5-89ce-444c-9ebd-3cbe7bb20221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '518e3d9b2e584602835a7b26b260c8e7'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:04.114046 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-87aee4c5-89ce-444c-9ebd-3cbe7bb20221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '518e3d9b2e584602835a7b26b260c8e7'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:04.118855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf037d3c-85f1-467d-9c46-6571f2023ea9 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:04.123740 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0079212-8354-4f28-b811-2408999abbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:04.124344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0079212-8354-4f28-b811-2408999abbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:04.124718 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0079212-8354-4f28-b811-2408999abbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:04.125139 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0079212-8354-4f28-b811-2408999abbe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:04.125855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0079212-8354-4f28-b811-2408999abbe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:04.127530 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0079212-8354-4f28-b811-2408999abbe8 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:04.156060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1038/2064] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:04.156060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0079212-8354-4f28-b811-2408999abbe8 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:04.156060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c0079212-8354-4f28-b811-2408999abbe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:04.156060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0079212-8354-4f28-b811-2408999abbe8 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:04.158681 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd702d0b-a2a0-41fe-baa0-50305c14225f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:04.159290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd702d0b-a2a0-41fe-baa0-50305c14225f admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:04.159577 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd702d0b-a2a0-41fe-baa0-50305c14225f admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:04.159858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd702d0b-a2a0-41fe-baa0-50305c14225f admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:04.160548 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd702d0b-a2a0-41fe-baa0-50305c14225f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:04.162133 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd702d0b-a2a0-41fe-baa0-50305c14225f admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:04.175859 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1039/2065] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:04.175859 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd702d0b-a2a0-41fe-baa0-50305c14225f admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:04.181869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-bd702d0b-a2a0-41fe-baa0-50305c14225f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:04.189938 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd702d0b-a2a0-41fe-baa0-50305c14225f admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:04.194759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fab62-c93e-4537-9cfc-9925907cc68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:04.195467 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fab62-c93e-4537-9cfc-9925907cc68b admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:04.195756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fab62-c93e-4537-9cfc-9925907cc68b admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:04.196044 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fab62-c93e-4537-9cfc-9925907cc68b admin admin] PATH_INFO: `/v3/projects/be86dbb894e641b3a9ed4b3ecb94656a/users/aebb85cedc914c4a837d569ac489ff76/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:04.207907 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1027/2066] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:01:03 2022] DELETE /identity/v3/users/518e3d9b2e584602835a7b26b260c8e7 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:04.212125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aee4c5-89ce-444c-9ebd-3cbe7bb20221 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:04.218982 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fab62-c93e-4537-9cfc-9925907cc68b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be86dbb894e641b3a9ed4b3ecb94656a, user_id=aebb85cedc914c4a837d569ac489ff76, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:04.222965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fab62-c93e-4537-9cfc-9925907cc68b admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:04.284236 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aee4c5-89ce-444c-9ebd-3cbe7bb20221 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:04.289816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a0af9-f0a8-4c52-bb08-58cf28bf3c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:04.290710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a0af9-f0a8-4c52-bb08-58cf28bf3c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:04.291009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a0af9-f0a8-4c52-bb08-58cf28bf3c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:04.291410 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a0af9-f0a8-4c52-bb08-58cf28bf3c5b admin admin] PATH_INFO: `/v3/projects/b20b53372fcf41fbb43b3e494f8c187d/users/d7dbcd204d864ad6914aca2c3594089c/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:04.306471 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a0af9-f0a8-4c52-bb08-58cf28bf3c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20b53372fcf41fbb43b3e494f8c187d, user_id=d7dbcd204d864ad6914aca2c3594089c, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:04.309245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a0af9-f0a8-4c52-bb08-58cf28bf3c5b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:04.321567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1040/2067] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:04 2022] PUT /identity/v3/projects/be86dbb894e641b3a9ed4b3ecb94656a/users/aebb85cedc914c4a837d569ac489ff76/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:04.322799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65c324-ce5c-4e52-b294-eb606d0627cb None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:04.323094 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65c324-ce5c-4e52-b294-eb606d0627cb None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:04.323378 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65c324-ce5c-4e52-b294-eb606d0627cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:04.343533 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-7b65c324-ce5c-4e52-b294-eb606d0627cb None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:04.344770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-7b65c324-ce5c-4e52-b294-eb606d0627cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:04.405741 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1041/2068] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:04.407097 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b18d3f-b934-48c9-baaf-a69d9b5d07b2 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:04.407333 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b18d3f-b934-48c9-baaf-a69d9b5d07b2 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:04.407617 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b18d3f-b934-48c9-baaf-a69d9b5d07b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:04.418210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1028/2069] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:04 2022] PUT /identity/v3/projects/b20b53372fcf41fbb43b3e494f8c187d/users/d7dbcd204d864ad6914aca2c3594089c/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:04.419127 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a0af9-f0a8-4c52-bb08-58cf28bf3c5b admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:04.421245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e94a0af9-f0a8-4c52-bb08-58cf28bf3c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:04.440899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-81b18d3f-b934-48c9-baaf-a69d9b5d07b2 None None] MFA Rules not processed for user `aebb85cedc914c4a837d569ac489ff76`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:04.442136 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-81b18d3f-b934-48c9-baaf-a69d9b5d07b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:04.484242 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a0af9-f0a8-4c52-bb08-58cf28bf3c5b admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:04.488333 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3797893-937f-4014-9acd-113e4c0f6616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:04.489169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3797893-937f-4014-9acd-113e4c0f6616 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:04.489607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3797893-937f-4014-9acd-113e4c0f6616 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:04.489897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3797893-937f-4014-9acd-113e4c0f6616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:04.517801 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1042/2070] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:04.519595 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdccfe6-9fcb-40ea-9d6a-253c454fa337 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:04.520017 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdccfe6-9fcb-40ea-9d6a-253c454fa337 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:04.520421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdccfe6-9fcb-40ea-9d6a-253c454fa337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:04.540085 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-3cdccfe6-9fcb-40ea-9d6a-253c454fa337 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:04.541281 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3cdccfe6-9fcb-40ea-9d6a-253c454fa337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:04.555891 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3797893-937f-4014-9acd-113e4c0f6616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:04.557337 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3797893-937f-4014-9acd-113e4c0f6616 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:04.567812 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1029/2071] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:01:04.568411 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3797893-937f-4014-9acd-113e4c0f6616 service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:04.569829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-a3797893-937f-4014-9acd-113e4c0f6616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:04.583679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3797893-937f-4014-9acd-113e4c0f6616 service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:04.589906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25687893-89fd-4a27-840b-def5143c44c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:04.590596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25687893-89fd-4a27-840b-def5143c44c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:04.590925 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25687893-89fd-4a27-840b-def5143c44c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:04.591210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25687893-89fd-4a27-840b-def5143c44c0 admin admin] PATH_INFO: `/v3/projects/9103e4c1a340451ab081bb15bb987488` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:04.592401 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25687893-89fd-4a27-840b-def5143c44c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9103e4c1a340451ab081bb15bb987488)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:04.594307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25687893-89fd-4a27-840b-def5143c44c0 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:04.608337 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1043/2072] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:04.616801 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdccfe6-9fcb-40ea-9d6a-253c454fa337 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:04.620860 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdccfe6-9fcb-40ea-9d6a-253c454fa337 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:04.626617 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242e846-7e6b-4aa8-a72d-d6ad59f7a68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:04.627271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242e846-7e6b-4aa8-a72d-d6ad59f7a68d admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:04.627550 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242e846-7e6b-4aa8-a72d-d6ad59f7a68d admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:04.627957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242e846-7e6b-4aa8-a72d-d6ad59f7a68d admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:04.628680 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242e846-7e6b-4aa8-a72d-d6ad59f7a68d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:04.631079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242e846-7e6b-4aa8-a72d-d6ad59f7a68d admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:04.832412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1044/2073] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:01:04 2022] POST /identity/v3/projects => generated 365 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:04.832412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242e846-7e6b-4aa8-a72d-d6ad59f7a68d admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:04.833791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-8242e846-7e6b-4aa8-a72d-d6ad59f7a68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:04.846193 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-25687893-89fd-4a27-840b-def5143c44c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9103e4c1a340451ab081bb15bb987488', 'request_id': 'req-25687893-89fd-4a27-840b-def5143c44c0'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:04.855336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-25687893-89fd-4a27-840b-def5143c44c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9103e4c1a340451ab081bb15bb987488', 'request_id': 'req-25687893-89fd-4a27-840b-def5143c44c0'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:04.926408 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242e846-7e6b-4aa8-a72d-d6ad59f7a68d admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:04.933032 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdae32c-6b4a-47c0-8e7c-a1735116951f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:04.934001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdae32c-6b4a-47c0-8e7c-a1735116951f service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:04.934509 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdae32c-6b4a-47c0-8e7c-a1735116951f service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:04.934976 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdae32c-6b4a-47c0-8e7c-a1735116951f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:04.995050 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-25687893-89fd-4a27-840b-def5143c44c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9103e4c1a340451ab081bb15bb987488', 'request_id': 'req-25687893-89fd-4a27-840b-def5143c44c0'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:05.002257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdae32c-6b4a-47c0-8e7c-a1735116951f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:05.004969 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdae32c-6b4a-47c0-8e7c-a1735116951f service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:05.015680 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-25687893-89fd-4a27-840b-def5143c44c0 admin admin] The token cache is being invalidate because project 9103e4c1a340451ab081bb15bb987488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:01:05.015979 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-25687893-89fd-4a27-840b-def5143c44c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:05.016704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-25687893-89fd-4a27-840b-def5143c44c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:05.017672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1045/2074] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:01:05.018303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1030/2075] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:01:04 2022] DELETE /identity/v3/projects/9103e4c1a340451ab081bb15bb987488 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:05.018746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdae32c-6b4a-47c0-8e7c-a1735116951f service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:05.023473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33555eca-83e1-4ceb-9f76-80fe884d2697 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:05.023764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33555eca-83e1-4ceb-9f76-80fe884d2697 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:05.024050 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33555eca-83e1-4ceb-9f76-80fe884d2697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:05.028502 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdae32c-6b4a-47c0-8e7c-a1735116951f service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:05.034568 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a000f-0bdd-4052-bf39-417432b6d84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:05.035375 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a000f-0bdd-4052-bf39-417432b6d84c admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:05.035732 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a000f-0bdd-4052-bf39-417432b6d84c admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:05.036089 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a000f-0bdd-4052-bf39-417432b6d84c admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:05.036841 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a000f-0bdd-4052-bf39-417432b6d84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:05.039227 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a000f-0bdd-4052-bf39-417432b6d84c admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:05.060485 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-33555eca-83e1-4ceb-9f76-80fe884d2697 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:05.061910 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-33555eca-83e1-4ceb-9f76-80fe884d2697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:05.070737 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1031/2076] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:01:05.083123 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0037eb-4362-4010-8d04-2f6aa9cba243 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:05.083123 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0037eb-4362-4010-8d04-2f6aa9cba243 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:05.083123 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0037eb-4362-4010-8d04-2f6aa9cba243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:05.099489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-3d0037eb-4362-4010-8d04-2f6aa9cba243 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:05.100686 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-3d0037eb-4362-4010-8d04-2f6aa9cba243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:05.109293 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1032/2077] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:05.113348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0037eb-4362-4010-8d04-2f6aa9cba243 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:05.122736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0037eb-4362-4010-8d04-2f6aa9cba243 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:05.127449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09427f-dc95-49dc-8529-3b53a6690bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:05.128042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09427f-dc95-49dc-8529-3b53a6690bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:05.128327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09427f-dc95-49dc-8529-3b53a6690bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:05.128606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09427f-dc95-49dc-8529-3b53a6690bd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:05.129296 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09427f-dc95-49dc-8529-3b53a6690bd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:01:05.129605 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09427f-dc95-49dc-8529-3b53a6690bd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:05.131308 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09427f-dc95-49dc-8529-3b53a6690bd1 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:05.142764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1033/2078] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:01:05.146998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09427f-dc95-49dc-8529-3b53a6690bd1 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:05.156357 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09427f-dc95-49dc-8529-3b53a6690bd1 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:05.161489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0a5bf-a031-4836-96a1-b8199ef706d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:05.162241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0a5bf-a031-4836-96a1-b8199ef706d0 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:05.162542 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0a5bf-a031-4836-96a1-b8199ef706d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:05.162820 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0a5bf-a031-4836-96a1-b8199ef706d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:05.164795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0a5bf-a031-4836-96a1-b8199ef706d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:05.166378 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0a5bf-a031-4836-96a1-b8199ef706d0 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:05.171275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1046/2079] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:01:05 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:05.172270 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a000f-0bdd-4052-bf39-417432b6d84c admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:05.175715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a05a000f-0bdd-4052-bf39-417432b6d84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:05.189920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a000f-0bdd-4052-bf39-417432b6d84c admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:05.196609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95acb9-60fb-4870-92b9-f633aed410d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:05.197304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95acb9-60fb-4870-92b9-f633aed410d9 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:05.197751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95acb9-60fb-4870-92b9-f633aed410d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:05.198046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95acb9-60fb-4870-92b9-f633aed410d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:05.204581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95acb9-60fb-4870-92b9-f633aed410d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:05.204581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95acb9-60fb-4870-92b9-f633aed410d9 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:05.212517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1047/2080] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:01:05.213330 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95acb9-60fb-4870-92b9-f633aed410d9 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:05.215260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-da95acb9-60fb-4870-92b9-f633aed410d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:05.229050 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95acb9-60fb-4870-92b9-f633aed410d9 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:05.234662 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb308d2-9c1e-458e-a544-bdacfba0ddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:05.235317 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb308d2-9c1e-458e-a544-bdacfba0ddc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:05.235606 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb308d2-9c1e-458e-a544-bdacfba0ddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:05.235888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb308d2-9c1e-458e-a544-bdacfba0ddc4 admin admin] PATH_INFO: `/v3/projects/e91a389d6a264356904c51a06f0c6764` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:05.237060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb308d2-9c1e-458e-a544-bdacfba0ddc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e91a389d6a264356904c51a06f0c6764)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:05.239043 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb308d2-9c1e-458e-a544-bdacfba0ddc4 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:05.351006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1034/2081] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:01:05 2022] POST /identity/v3/projects => generated 365 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:01:05.352507 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0a5bf-a031-4836-96a1-b8199ef706d0 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:05.407553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:05.415123 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0a5bf-a031-4836-96a1-b8199ef706d0 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:05.427430 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-deb308d2-9c1e-458e-a544-bdacfba0ddc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e91a389d6a264356904c51a06f0c6764', 'request_id': 'req-deb308d2-9c1e-458e-a544-bdacfba0ddc4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:05.435112 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-deb308d2-9c1e-458e-a544-bdacfba0ddc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e91a389d6a264356904c51a06f0c6764', 'request_id': 'req-deb308d2-9c1e-458e-a544-bdacfba0ddc4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:05.441251 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-deb308d2-9c1e-458e-a544-bdacfba0ddc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e91a389d6a264356904c51a06f0c6764', 'request_id': 'req-deb308d2-9c1e-458e-a544-bdacfba0ddc4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:05.478708 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad78441-7ece-4931-8a67-352606f27a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:05.480299 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad78441-7ece-4931-8a67-352606f27a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:05.480299 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad78441-7ece-4931-8a67-352606f27a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:05.480299 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad78441-7ece-4931-8a67-352606f27a47 admin admin] PATH_INFO: `/v3/projects/6ba1b628210a4a0a9204883e5d37bda0/users/2f34b663482143feb0bb7c90547f4a72/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:05.495099 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad78441-7ece-4931-8a67-352606f27a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba1b628210a4a0a9204883e5d37bda0, user_id=2f34b663482143feb0bb7c90547f4a72, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:05.497921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad78441-7ece-4931-8a67-352606f27a47 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:05.554406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-deb308d2-9c1e-458e-a544-bdacfba0ddc4 admin admin] The token cache is being invalidate because project e91a389d6a264356904c51a06f0c6764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:01:05.554730 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-deb308d2-9c1e-458e-a544-bdacfba0ddc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:05.555477 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-deb308d2-9c1e-458e-a544-bdacfba0ddc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:05.557082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1048/2082] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:01:05 2022] DELETE /identity/v3/projects/e91a389d6a264356904c51a06f0c6764 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:05.558037 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb308d2-9c1e-458e-a544-bdacfba0ddc4 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:05.559450 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-deb308d2-9c1e-458e-a544-bdacfba0ddc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:05.574180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb308d2-9c1e-458e-a544-bdacfba0ddc4 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:05.578764 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfba688-446c-48e0-ae85-b7b2388b1780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:05.579396 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfba688-446c-48e0-ae85-b7b2388b1780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:05.579677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfba688-446c-48e0-ae85-b7b2388b1780 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:05.579950 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfba688-446c-48e0-ae85-b7b2388b1780 admin admin] PATH_INFO: `/v3/users/9f76c776592b4db6afcda0a4d56940a3` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:05.581106 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfba688-446c-48e0-ae85-b7b2388b1780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f76c776592b4db6afcda0a4d56940a3)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:05.583081 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfba688-446c-48e0-ae85-b7b2388b1780 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:05.597322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1035/2083] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:05 2022] PUT /identity/v3/projects/6ba1b628210a4a0a9204883e5d37bda0/users/2f34b663482143feb0bb7c90547f4a72/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:05.597322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad78441-7ece-4931-8a67-352606f27a47 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:05.602151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-9ad78441-7ece-4931-8a67-352606f27a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:05.665130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad78441-7ece-4931-8a67-352606f27a47 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:05.670244 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c8709-599a-4f65-bb6a-612400a4d157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:05.671005 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c8709-599a-4f65-bb6a-612400a4d157 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:05.671400 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c8709-599a-4f65-bb6a-612400a4d157 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:05.671688 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c8709-599a-4f65-bb6a-612400a4d157 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:05.672356 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c8709-599a-4f65-bb6a-612400a4d157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:05.674283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c8709-599a-4f65-bb6a-612400a4d157 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:05.888165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1036/2084] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:01:05 2022] POST /identity/v3/users => generated 283 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:05.889177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c8709-599a-4f65-bb6a-612400a4d157 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:05.891123 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-c49c8709-599a-4f65-bb6a-612400a4d157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:05.905093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c8709-599a-4f65-bb6a-612400a4d157 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:05.909985 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0c959-910c-4901-a109-6aac3e447f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:05.910662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0c959-910c-4901-a109-6aac3e447f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:05.910934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0c959-910c-4901-a109-6aac3e447f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:05.911210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0c959-910c-4901-a109-6aac3e447f2b admin admin] PATH_INFO: `/v3/users/d4981f9cdbd74039bef8fa22ef2fe243` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:05.912365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0c959-910c-4901-a109-6aac3e447f2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4981f9cdbd74039bef8fa22ef2fe243)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:05.914420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0c959-910c-4901-a109-6aac3e447f2b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:06.042632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-ccfba688-446c-48e0-ae85-b7b2388b1780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f76c776592b4db6afcda0a4d56940a3'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:06.043300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-ccfba688-446c-48e0-ae85-b7b2388b1780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f76c776592b4db6afcda0a4d56940a3'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:06.055399 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-ccfba688-446c-48e0-ae85-b7b2388b1780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f76c776592b4db6afcda0a4d56940a3'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:06.065619 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:06.137975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-ccfba688-446c-48e0-ae85-b7b2388b1780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f76c776592b4db6afcda0a4d56940a3'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:06.138680 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-ccfba688-446c-48e0-ae85-b7b2388b1780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f76c776592b4db6afcda0a4d56940a3'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:06.152602 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1049/2085] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:01:05 2022] DELETE /identity/v3/users/9f76c776592b4db6afcda0a4d56940a3 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:06.153741 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfba688-446c-48e0-ae85-b7b2388b1780 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:06.155130 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ccfba688-446c-48e0-ae85-b7b2388b1780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:06.183983 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3db0c959-910c-4901-a109-6aac3e447f2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4981f9cdbd74039bef8fa22ef2fe243'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:06.193368 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3db0c959-910c-4901-a109-6aac3e447f2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4981f9cdbd74039bef8fa22ef2fe243'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:06.206789 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3db0c959-910c-4901-a109-6aac3e447f2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4981f9cdbd74039bef8fa22ef2fe243'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:06.207606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3db0c959-910c-4901-a109-6aac3e447f2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4981f9cdbd74039bef8fa22ef2fe243'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:06.208220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3db0c959-910c-4901-a109-6aac3e447f2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4981f9cdbd74039bef8fa22ef2fe243'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:06.232477 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfba688-446c-48e0-ae85-b7b2388b1780 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:06.238126 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9d1fd-9b76-40e9-a074-e06f6daea967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:06.238804 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9d1fd-9b76-40e9-a074-e06f6daea967 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:06.239087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9d1fd-9b76-40e9-a074-e06f6daea967 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:06.239360 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9d1fd-9b76-40e9-a074-e06f6daea967 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:06.240163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9d1fd-9b76-40e9-a074-e06f6daea967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:06.241799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9d1fd-9b76-40e9-a074-e06f6daea967 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:06.256916 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1050/2086] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:06.256916 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9d1fd-9b76-40e9-a074-e06f6daea967 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:06.256916 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c6b9d1fd-9b76-40e9-a074-e06f6daea967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:06.270307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9d1fd-9b76-40e9-a074-e06f6daea967 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:06.275114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb327493-cc07-4e60-9aaf-af6beb0b1642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:06.275790 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb327493-cc07-4e60-9aaf-af6beb0b1642 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:06.276107 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb327493-cc07-4e60-9aaf-af6beb0b1642 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:06.276386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb327493-cc07-4e60-9aaf-af6beb0b1642 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:06.277080 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb327493-cc07-4e60-9aaf-af6beb0b1642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:06.278744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb327493-cc07-4e60-9aaf-af6beb0b1642 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:06.289221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1051/2087] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:06.290441 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e37610-c4fd-47ca-b3e5-4255b57cb33b None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:06.290727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e37610-c4fd-47ca-b3e5-4255b57cb33b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:06.291002 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e37610-c4fd-47ca-b3e5-4255b57cb33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:06.310612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-96e37610-c4fd-47ca-b3e5-4255b57cb33b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:06.311775 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-96e37610-c4fd-47ca-b3e5-4255b57cb33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:06.323358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1052/2088] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:06.324233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e37610-c4fd-47ca-b3e5-4255b57cb33b None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:06.330704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-96e37610-c4fd-47ca-b3e5-4255b57cb33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:06.332182 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1037/2089] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:01:05 2022] DELETE /identity/v3/users/d4981f9cdbd74039bef8fa22ef2fe243 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:06.333381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0c959-910c-4901-a109-6aac3e447f2b admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:06.356879 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e37610-c4fd-47ca-b3e5-4255b57cb33b None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:06.407489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0c959-910c-4901-a109-6aac3e447f2b admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:06.414912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaaba8-67fc-42fe-a3b0-192d31b6e000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:06.415546 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaaba8-67fc-42fe-a3b0-192d31b6e000 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:06.415852 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaaba8-67fc-42fe-a3b0-192d31b6e000 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:06.416134 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaaba8-67fc-42fe-a3b0-192d31b6e000 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:06.417138 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbaaba8-67fc-42fe-a3b0-192d31b6e000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:06.419150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbaaba8-67fc-42fe-a3b0-192d31b6e000 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:06.427050 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f4d04-4238-414e-add9-ef65e6e336c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:06.428055 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f4d04-4238-414e-add9-ef65e6e336c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:06.428502 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f4d04-4238-414e-add9-ef65e6e336c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:06.428940 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f4d04-4238-414e-add9-ef65e6e336c5 admin admin] PATH_INFO: `/v3/projects/6ba1b628210a4a0a9204883e5d37bda0/users/2f34b663482143feb0bb7c90547f4a72/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:06.434579 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1038/2090] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:06.434754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f4d04-4238-414e-add9-ef65e6e336c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba1b628210a4a0a9204883e5d37bda0, user_id=2f34b663482143feb0bb7c90547f4a72, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:06.435809 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaaba8-67fc-42fe-a3b0-192d31b6e000 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:06.436139 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f4d04-4238-414e-add9-ef65e6e336c5 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:06.438058 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-9fbaaba8-67fc-42fe-a3b0-192d31b6e000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:06.450600 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1053/2091] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:06 2022] PUT /identity/v3/projects/6ba1b628210a4a0a9204883e5d37bda0/users/2f34b663482143feb0bb7c90547f4a72/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:06.451994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f4d04-4238-414e-add9-ef65e6e336c5 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:06.519036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaaba8-67fc-42fe-a3b0-192d31b6e000 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:06.523458 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f4d04-4238-414e-add9-ef65e6e336c5 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:06.529493 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f961a9-b7d4-4827-963d-9038b63dfdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:06.530238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f961a9-b7d4-4827-963d-9038b63dfdf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:06.530498 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f961a9-b7d4-4827-963d-9038b63dfdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:06.530785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f961a9-b7d4-4827-963d-9038b63dfdf3 admin admin] PATH_INFO: `/v3/projects/cb7d6b912e2e4a328e54474ddad30938/users/3717dcd321e24127acc464d69f9088c4/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:06.547374 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f961a9-b7d4-4827-963d-9038b63dfdf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb7d6b912e2e4a328e54474ddad30938, user_id=3717dcd321e24127acc464d69f9088c4, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:06.550088 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f961a9-b7d4-4827-963d-9038b63dfdf3 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:06.570068 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e947dd-e1c6-4192-bebd-e3541fb23779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:06.571205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e947dd-e1c6-4192-bebd-e3541fb23779 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:06.571494 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e947dd-e1c6-4192-bebd-e3541fb23779 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:06.571799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e947dd-e1c6-4192-bebd-e3541fb23779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:06.581576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e947dd-e1c6-4192-bebd-e3541fb23779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:06.583051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e947dd-e1c6-4192-bebd-e3541fb23779 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:06.593844 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1039/2092] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:01:06.595397 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d27bb-ee38-46db-b50d-683b64619f9b None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:06.596776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d27bb-ee38-46db-b50d-683b64619f9b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:06.596776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d27bb-ee38-46db-b50d-683b64619f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:06.627100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-d60d27bb-ee38-46db-b50d-683b64619f9b None None] MFA Rules not processed for user `2f34b663482143feb0bb7c90547f4a72`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:06.632245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d60d27bb-ee38-46db-b50d-683b64619f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:06.641028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1054/2093] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:06 2022] PUT /identity/v3/projects/cb7d6b912e2e4a328e54474ddad30938/users/3717dcd321e24127acc464d69f9088c4/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:06.642980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34319e-4e19-4008-9dcf-e9566d66ddac None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:06.643279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34319e-4e19-4008-9dcf-e9566d66ddac None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:06.643820 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34319e-4e19-4008-9dcf-e9566d66ddac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:06.682747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-5a34319e-4e19-4008-9dcf-e9566d66ddac None None] MFA Rules not processed for user `3717dcd321e24127acc464d69f9088c4`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:06.684082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5a34319e-4e19-4008-9dcf-e9566d66ddac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:06.746059 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1040/2094] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:06.758961 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d27bb-ee38-46db-b50d-683b64619f9b None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:06.760702 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d60d27bb-ee38-46db-b50d-683b64619f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:06.778708 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1055/2095] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:06.783387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34319e-4e19-4008-9dcf-e9566d66ddac None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:06.831990 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d27bb-ee38-46db-b50d-683b64619f9b None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:06.835843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9b658-f63f-4f75-b1f3-4e3c87430a1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:06.836489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9b658-f63f-4f75-b1f3-4e3c87430a1f service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:06.836756 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9b658-f63f-4f75-b1f3-4e3c87430a1f service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:06.837143 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9b658-f63f-4f75-b1f3-4e3c87430a1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:06.854895 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9b658-f63f-4f75-b1f3-4e3c87430a1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:06.856453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9b658-f63f-4f75-b1f3-4e3c87430a1f service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:06.865570 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34319e-4e19-4008-9dcf-e9566d66ddac None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:06.866922 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1041/2096] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:01:06.877064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d095433-b766-4afe-9b38-6fb091bf7ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:06.877709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d095433-b766-4afe-9b38-6fb091bf7ebc admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:06.877994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d095433-b766-4afe-9b38-6fb091bf7ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:06.878275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d095433-b766-4afe-9b38-6fb091bf7ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:06.879029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d095433-b766-4afe-9b38-6fb091bf7ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:06.880957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d095433-b766-4afe-9b38-6fb091bf7ebc admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:06.911040 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9b658-f63f-4f75-b1f3-4e3c87430a1f service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:06.912612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-53d9b658-f63f-4f75-b1f3-4e3c87430a1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:06.928160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9b658-f63f-4f75-b1f3-4e3c87430a1f service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:06.934888 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ba431-666c-4291-8455-66586b2676eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:06.940690 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ba431-666c-4291-8455-66586b2676eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:06.940690 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ba431-666c-4291-8455-66586b2676eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:06.940690 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ba431-666c-4291-8455-66586b2676eb admin admin] PATH_INFO: `/v3/projects/a58968ad4b2a46f18beb42511b500106` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:06.940690 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ba431-666c-4291-8455-66586b2676eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58968ad4b2a46f18beb42511b500106)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:06.940690 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ba431-666c-4291-8455-66586b2676eb admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:07.081202 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1056/2097] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:01:06 2022] POST /identity/v3/projects => generated 365 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:07.082075 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d095433-b766-4afe-9b38-6fb091bf7ebc admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:07.103584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2d6ba431-666c-4291-8455-66586b2676eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58968ad4b2a46f18beb42511b500106', 'request_id': 'req-2d6ba431-666c-4291-8455-66586b2676eb'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:07.111064 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2d6ba431-666c-4291-8455-66586b2676eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58968ad4b2a46f18beb42511b500106', 'request_id': 'req-2d6ba431-666c-4291-8455-66586b2676eb'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:07.175310 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d095433-b766-4afe-9b38-6fb091bf7ebc admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:07.178763 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2d6ba431-666c-4291-8455-66586b2676eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58968ad4b2a46f18beb42511b500106', 'request_id': 'req-2d6ba431-666c-4291-8455-66586b2676eb'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:07.201704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2d6ba431-666c-4291-8455-66586b2676eb admin admin] The token cache is being invalidate because project a58968ad4b2a46f18beb42511b500106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:01:07.202003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2d6ba431-666c-4291-8455-66586b2676eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:07.203062 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2d6ba431-666c-4291-8455-66586b2676eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:07.204518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1042/2098] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:01:06 2022] DELETE /identity/v3/projects/a58968ad4b2a46f18beb42511b500106 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:07.206911 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ba431-666c-4291-8455-66586b2676eb admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:07.215119 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2d6ba431-666c-4291-8455-66586b2676eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:07.241219 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ef219-a88e-449d-9457-42414c4f729e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:07.242779 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ef219-a88e-449d-9457-42414c4f729e admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:07.243071 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ef219-a88e-449d-9457-42414c4f729e admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:07.243351 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ef219-a88e-449d-9457-42414c4f729e admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:07.244021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ef219-a88e-449d-9457-42414c4f729e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:07.246292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ef219-a88e-449d-9457-42414c4f729e admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:07.286349 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ba431-666c-4291-8455-66586b2676eb admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:07.291517 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edd717-ddac-42c7-80be-0f487bba13d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:07.292252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edd717-ddac-42c7-80be-0f487bba13d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:07.292536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edd717-ddac-42c7-80be-0f487bba13d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:07.292814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edd717-ddac-42c7-80be-0f487bba13d9 admin admin] PATH_INFO: `/v3/projects/b4dd36bf44394e17aaa1246b050ae07d` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:07.294684 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4edd717-ddac-42c7-80be-0f487bba13d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4dd36bf44394e17aaa1246b050ae07d)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:07.296651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4edd717-ddac-42c7-80be-0f487bba13d9 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:07.387142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1057/2099] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:01:07 2022] POST /identity/v3/users => generated 289 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:07.392313 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b6284-42bc-4fea-bf43-b8fa91e21ff6 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:07.392673 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b6284-42bc-4fea-bf43-b8fa91e21ff6 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:07.393030 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b6284-42bc-4fea-bf43-b8fa91e21ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:07.436138 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a4edd717-ddac-42c7-80be-0f487bba13d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4dd36bf44394e17aaa1246b050ae07d', 'request_id': 'req-a4edd717-ddac-42c7-80be-0f487bba13d9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:07.442318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a4edd717-ddac-42c7-80be-0f487bba13d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4dd36bf44394e17aaa1246b050ae07d', 'request_id': 'req-a4edd717-ddac-42c7-80be-0f487bba13d9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:07.443552 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-122b6284-42bc-4fea-bf43-b8fa91e21ff6 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:07.445260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-122b6284-42bc-4fea-bf43-b8fa91e21ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:07.514238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1058/2100] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:07.515584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b6284-42bc-4fea-bf43-b8fa91e21ff6 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:07.519735 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-122b6284-42bc-4fea-bf43-b8fa91e21ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:07.526456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a4edd717-ddac-42c7-80be-0f487bba13d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4dd36bf44394e17aaa1246b050ae07d', 'request_id': 'req-a4edd717-ddac-42c7-80be-0f487bba13d9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:07.543954 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a4edd717-ddac-42c7-80be-0f487bba13d9 admin admin] The token cache is being invalidate because project b4dd36bf44394e17aaa1246b050ae07d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:01:07.544536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a4edd717-ddac-42c7-80be-0f487bba13d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:07.549348 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a4edd717-ddac-42c7-80be-0f487bba13d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:07.552487 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1043/2101] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:01:07 2022] DELETE /identity/v3/projects/b4dd36bf44394e17aaa1246b050ae07d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:07.556561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edd717-ddac-42c7-80be-0f487bba13d9 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:07.558781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-a4edd717-ddac-42c7-80be-0f487bba13d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:07.590202 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edd717-ddac-42c7-80be-0f487bba13d9 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:07.596817 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f9155-abca-418c-9c64-75292fcdb8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:07.597638 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f9155-abca-418c-9c64-75292fcdb8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:07.598091 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f9155-abca-418c-9c64-75292fcdb8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:07.598674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f9155-abca-418c-9c64-75292fcdb8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:07.600277 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f9155-abca-418c-9c64-75292fcdb8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:07.603121 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f9155-abca-418c-9c64-75292fcdb8c7 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:07.610046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b6284-42bc-4fea-bf43-b8fa91e21ff6 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:07.616683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3faf9f-d7e6-41e2-b855-50af5338f2f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:07.616683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3faf9f-d7e6-41e2-b855-50af5338f2f2 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:07.616683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3faf9f-d7e6-41e2-b855-50af5338f2f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:07.616683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3faf9f-d7e6-41e2-b855-50af5338f2f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:07.618428 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1044/2102] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:07.620200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06745a-ef85-4f31-a3a2-73ed5f37d3f4 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:07.620496 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06745a-ef85-4f31-a3a2-73ed5f37d3f4 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:07.620774 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06745a-ef85-4f31-a3a2-73ed5f37d3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:07.633274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-fc3faf9f-d7e6-41e2-b855-50af5338f2f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:07.644274 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-2b06745a-ef85-4f31-a3a2-73ed5f37d3f4 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:07.645995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2b06745a-ef85-4f31-a3a2-73ed5f37d3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:07.654861 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1045/2103] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:07.658992 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06745a-ef85-4f31-a3a2-73ed5f37d3f4 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:07.660374 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2b06745a-ef85-4f31-a3a2-73ed5f37d3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:07.673461 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06745a-ef85-4f31-a3a2-73ed5f37d3f4 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:07.678267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253831a-b323-4ea6-b4c0-4eadbfc1afba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:07.679061 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253831a-b323-4ea6-b4c0-4eadbfc1afba admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:07.679250 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253831a-b323-4ea6-b4c0-4eadbfc1afba admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:07.680065 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253831a-b323-4ea6-b4c0-4eadbfc1afba admin admin] PATH_INFO: `/v3/users/59589d731d174c24a91828ae6933bc1a` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:07.681735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253831a-b323-4ea6-b4c0-4eadbfc1afba admin admin] RBAC: Authorizing `identity:delete_user(user_id=59589d731d174c24a91828ae6933bc1a)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:07.683740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253831a-b323-4ea6-b4c0-4eadbfc1afba admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:07.739984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3faf9f-d7e6-41e2-b855-50af5338f2f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:07.741592 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3faf9f-d7e6-41e2-b855-50af5338f2f2 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:07.751578 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1059/2104] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:01:07.752584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3faf9f-d7e6-41e2-b855-50af5338f2f2 service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:07.764734 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3faf9f-d7e6-41e2-b855-50af5338f2f2 service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:07.777388 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af9f92-0617-4487-88a8-3e702d58c509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:07.777388 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af9f92-0617-4487-88a8-3e702d58c509 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:07.777388 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af9f92-0617-4487-88a8-3e702d58c509 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:07.777388 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af9f92-0617-4487-88a8-3e702d58c509 admin admin] PATH_INFO: `/v3/projects/5d10b704b9bd40f2b24fb8d82ae306e6/users/48fe591ca0aa4554852e986aec2388b6/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:07.792664 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af9f92-0617-4487-88a8-3e702d58c509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d10b704b9bd40f2b24fb8d82ae306e6, user_id=48fe591ca0aa4554852e986aec2388b6, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:07.795612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af9f92-0617-4487-88a8-3e702d58c509 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:07.900185 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1060/2105] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:07 2022] PUT /identity/v3/projects/5d10b704b9bd40f2b24fb8d82ae306e6/users/48fe591ca0aa4554852e986aec2388b6/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:07.902725 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af9f92-0617-4487-88a8-3e702d58c509 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:07.983615 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-4253831a-b323-4ea6-b4c0-4eadbfc1afba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59589d731d174c24a91828ae6933bc1a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:08.002229 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-4253831a-b323-4ea6-b4c0-4eadbfc1afba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59589d731d174c24a91828ae6933bc1a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:08.012039 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af9f92-0617-4487-88a8-3e702d58c509 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:08.017578 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae1f0a-cc13-4a95-b632-56136b187065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:08.018294 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1f0a-cc13-4a95-b632-56136b187065 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:08.018739 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-4253831a-b323-4ea6-b4c0-4eadbfc1afba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59589d731d174c24a91828ae6933bc1a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:08.019584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1f0a-cc13-4a95-b632-56136b187065 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:08.019584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1f0a-cc13-4a95-b632-56136b187065 admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:08.020050 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-4253831a-b323-4ea6-b4c0-4eadbfc1afba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59589d731d174c24a91828ae6933bc1a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:08.020557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae1f0a-cc13-4a95-b632-56136b187065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:01:08.020974 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-4253831a-b323-4ea6-b4c0-4eadbfc1afba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59589d731d174c24a91828ae6933bc1a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:08.021105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae1f0a-cc13-4a95-b632-56136b187065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:08.023102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae1f0a-cc13-4a95-b632-56136b187065 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:08.036778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1061/2106] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:01:08.037744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae1f0a-cc13-4a95-b632-56136b187065 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:08.040360 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-41ae1f0a-cc13-4a95-b632-56136b187065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:08.053368 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae1f0a-cc13-4a95-b632-56136b187065 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:08.058284 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:08.060312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2a755-449c-474a-957c-77d2a6ef0f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:08.060947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2a755-449c-474a-957c-77d2a6ef0f23 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:08.066576 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2a755-449c-474a-957c-77d2a6ef0f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:08.066576 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2a755-449c-474a-957c-77d2a6ef0f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:08.066576 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2a755-449c-474a-957c-77d2a6ef0f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:08.066576 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2a755-449c-474a-957c-77d2a6ef0f23 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:08.076909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1062/2107] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:08.077487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2a755-449c-474a-957c-77d2a6ef0f23 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:08.079216 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-27e2a755-449c-474a-957c-77d2a6ef0f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:08.092686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2a755-449c-474a-957c-77d2a6ef0f23 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:08.099846 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00940d-ff74-4695-8249-fbd57c7979dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:08.100007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1046/2108] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:01:07 2022] DELETE /identity/v3/users/59589d731d174c24a91828ae6933bc1a => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:08.100097 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00940d-ff74-4695-8249-fbd57c7979dd admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:08.100172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253831a-b323-4ea6-b4c0-4eadbfc1afba admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:08.100243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00940d-ff74-4695-8249-fbd57c7979dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:08.100243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00940d-ff74-4695-8249-fbd57c7979dd admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:08.100243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00940d-ff74-4695-8249-fbd57c7979dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:08.101547 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00940d-ff74-4695-8249-fbd57c7979dd admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:08.167442 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253831a-b323-4ea6-b4c0-4eadbfc1afba admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:08.172560 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3aca46-bb6c-4765-b89f-eaef90711fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:08.173263 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3aca46-bb6c-4765-b89f-eaef90711fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:08.173557 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3aca46-bb6c-4765-b89f-eaef90711fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:08.173839 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3aca46-bb6c-4765-b89f-eaef90711fbd admin admin] PATH_INFO: `/v3/projects/5d10b704b9bd40f2b24fb8d82ae306e6/users/48fe591ca0aa4554852e986aec2388b6/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:08.175867 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3aca46-bb6c-4765-b89f-eaef90711fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d10b704b9bd40f2b24fb8d82ae306e6, user_id=48fe591ca0aa4554852e986aec2388b6, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:08.178562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3aca46-bb6c-4765-b89f-eaef90711fbd admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:08.189216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1047/2109] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:08 2022] PUT /identity/v3/projects/5d10b704b9bd40f2b24fb8d82ae306e6/users/48fe591ca0aa4554852e986aec2388b6/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:08.200224 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27145c9-699f-4c36-a5ac-dfc00c2b3a5e None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:08.200518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27145c9-699f-4c36-a5ac-dfc00c2b3a5e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:08.200797 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27145c9-699f-4c36-a5ac-dfc00c2b3a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:08.224526 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1063/2110] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:01:08 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:08.224758 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00940d-ff74-4695-8249-fbd57c7979dd admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:08.251771 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-f27145c9-699f-4c36-a5ac-dfc00c2b3a5e None None] MFA Rules not processed for user `48fe591ca0aa4554852e986aec2388b6`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:08.254570 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f27145c9-699f-4c36-a5ac-dfc00c2b3a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:08.305396 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00940d-ff74-4695-8249-fbd57c7979dd admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:08.311861 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b146d1-3f73-41b3-91a0-209b83a3cba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:08.312586 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b146d1-3f73-41b3-91a0-209b83a3cba6 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:08.312933 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b146d1-3f73-41b3-91a0-209b83a3cba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:08.313677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b146d1-3f73-41b3-91a0-209b83a3cba6 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:08.315078 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b146d1-3f73-41b3-91a0-209b83a3cba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:08.317585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b146d1-3f73-41b3-91a0-209b83a3cba6 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:08.350414 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1048/2111] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:08 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:01:08.364697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27145c9-699f-4c36-a5ac-dfc00c2b3a5e None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:08.366359 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f27145c9-699f-4c36-a5ac-dfc00c2b3a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:08.403607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1064/2112] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:01:08 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:08.407963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b146d1-3f73-41b3-91a0-209b83a3cba6 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:08.426757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b146d1-3f73-41b3-91a0-209b83a3cba6 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:08.448475 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27145c9-699f-4c36-a5ac-dfc00c2b3a5e None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:08.451573 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d721b7e-08c3-4c94-9b43-4b25393c9415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:08.452543 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d721b7e-08c3-4c94-9b43-4b25393c9415 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:08.452746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5952342-ef7f-4066-a76a-d4f4bda2e2c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:08.452860 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d721b7e-08c3-4c94-9b43-4b25393c9415 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:08.453101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d721b7e-08c3-4c94-9b43-4b25393c9415 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:08.453603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5952342-ef7f-4066-a76a-d4f4bda2e2c2 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:08.453864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d721b7e-08c3-4c94-9b43-4b25393c9415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:08.453962 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5952342-ef7f-4066-a76a-d4f4bda2e2c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:08.454151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5952342-ef7f-4066-a76a-d4f4bda2e2c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:08.456777 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d721b7e-08c3-4c94-9b43-4b25393c9415 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:08.458904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:08.473172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5952342-ef7f-4066-a76a-d4f4bda2e2c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:08.474951 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5952342-ef7f-4066-a76a-d4f4bda2e2c2 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:08.479895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1065/2113] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:08.483834 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d721b7e-08c3-4c94-9b43-4b25393c9415 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:08.497835 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d721b7e-08c3-4c94-9b43-4b25393c9415 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:08.503891 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1049/2114] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:01:08.505246 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca10e8b-b087-4f86-a10e-c5786dcc356e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:08.505879 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca10e8b-b087-4f86-a10e-c5786dcc356e admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:08.506161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca10e8b-b087-4f86-a10e-c5786dcc356e admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:08.506455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca10e8b-b087-4f86-a10e-c5786dcc356e admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:08.507160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca10e8b-b087-4f86-a10e-c5786dcc356e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:08.509326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca10e8b-b087-4f86-a10e-c5786dcc356e admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:08.536925 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1066/2115] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:01:08.537149 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5952342-ef7f-4066-a76a-d4f4bda2e2c2 service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:08.545667 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5952342-ef7f-4066-a76a-d4f4bda2e2c2 service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:08.614767 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b20e56-2f1a-47dc-93ae-842ffb1e48be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:08.615473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b20e56-2f1a-47dc-93ae-842ffb1e48be admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:08.615860 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b20e56-2f1a-47dc-93ae-842ffb1e48be admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:08.618267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b20e56-2f1a-47dc-93ae-842ffb1e48be admin admin] PATH_INFO: `/v3/projects/62c3283896154dc7b12f4876f1d057a3/users/3be1096e76c6411fa4ab9ab5bfa13f6a/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:08.688777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b20e56-2f1a-47dc-93ae-842ffb1e48be admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c3283896154dc7b12f4876f1d057a3, user_id=3be1096e76c6411fa4ab9ab5bfa13f6a, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:08.691405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b20e56-2f1a-47dc-93ae-842ffb1e48be admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:08.813272 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca10e8b-b087-4f86-a10e-c5786dcc356e admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:08.829333 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca10e8b-b087-4f86-a10e-c5786dcc356e admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:08.833915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1140143-3f84-45af-9fe1-0c7f08c455e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:08.834906 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1140143-3f84-45af-9fe1-0c7f08c455e5 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:08.835264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1140143-3f84-45af-9fe1-0c7f08c455e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:08.835611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1140143-3f84-45af-9fe1-0c7f08c455e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:08.840570 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-b1140143-3f84-45af-9fe1-0c7f08c455e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:08.879561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1050/2116] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:08 2022] PUT /identity/v3/projects/62c3283896154dc7b12f4876f1d057a3/users/3be1096e76c6411fa4ab9ab5bfa13f6a/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:08.881322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b20e56-2f1a-47dc-93ae-842ffb1e48be admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:08.894799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-88b20e56-2f1a-47dc-93ae-842ffb1e48be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:08.959475 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1140143-3f84-45af-9fe1-0c7f08c455e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:08.961051 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1140143-3f84-45af-9fe1-0c7f08c455e5 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:08.974015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1067/2117] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:01:08.975534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b933cb3-5ad8-46f4-99fc-aea86f91e064 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:08.975972 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b933cb3-5ad8-46f4-99fc-aea86f91e064 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:08.976891 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b933cb3-5ad8-46f4-99fc-aea86f91e064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:09.056755 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-0b933cb3-5ad8-46f4-99fc-aea86f91e064 None None] MFA Rules not processed for user `3be1096e76c6411fa4ab9ab5bfa13f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:09.058185 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0b933cb3-5ad8-46f4-99fc-aea86f91e064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:09.074781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b20e56-2f1a-47dc-93ae-842ffb1e48be admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:09.083463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d73de-a17f-43b2-9774-8a94ca283dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:09.084588 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d73de-a17f-43b2-9774-8a94ca283dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:09.084880 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d73de-a17f-43b2-9774-8a94ca283dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:09.085166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d73de-a17f-43b2-9774-8a94ca283dcc admin admin] PATH_INFO: `/v3/projects/8ee30d4719a54d25822e9804b13a169c` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:09.089390 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d73de-a17f-43b2-9774-8a94ca283dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee30d4719a54d25822e9804b13a169c)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:09.089390 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d73de-a17f-43b2-9774-8a94ca283dcc admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:09.170982 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1068/2118] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:09.175624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b933cb3-5ad8-46f4-99fc-aea86f91e064 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:09.190056 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b933cb3-5ad8-46f4-99fc-aea86f91e064 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:09.196051 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c76400-8db8-4503-bc23-b5014c1592a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:09.196690 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c76400-8db8-4503-bc23-b5014c1592a0 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:09.196977 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c76400-8db8-4503-bc23-b5014c1592a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:09.197254 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c76400-8db8-4503-bc23-b5014c1592a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:09.197932 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c76400-8db8-4503-bc23-b5014c1592a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:09.200013 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c76400-8db8-4503-bc23-b5014c1592a0 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:09.262730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f25d73de-a17f-43b2-9774-8a94ca283dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee30d4719a54d25822e9804b13a169c', 'request_id': 'req-f25d73de-a17f-43b2-9774-8a94ca283dcc'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:09.270429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f25d73de-a17f-43b2-9774-8a94ca283dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee30d4719a54d25822e9804b13a169c', 'request_id': 'req-f25d73de-a17f-43b2-9774-8a94ca283dcc'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:09.332583 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1069/2119] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:01:09 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:01:09.337395 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c76400-8db8-4503-bc23-b5014c1592a0 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:09.404119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c76400-8db8-4503-bc23-b5014c1592a0 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:09.408717 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb50e1c-d05b-4572-b383-321bdb2b4080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:09.409340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb50e1c-d05b-4572-b383-321bdb2b4080 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:09.409753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb50e1c-d05b-4572-b383-321bdb2b4080 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:09.410033 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb50e1c-d05b-4572-b383-321bdb2b4080 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:09.410882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb50e1c-d05b-4572-b383-321bdb2b4080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:09.412810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb50e1c-d05b-4572-b383-321bdb2b4080 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:09.440439 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f25d73de-a17f-43b2-9774-8a94ca283dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee30d4719a54d25822e9804b13a169c', 'request_id': 'req-f25d73de-a17f-43b2-9774-8a94ca283dcc'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:09.451506 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f25d73de-a17f-43b2-9774-8a94ca283dcc admin admin] The token cache is being invalidate because project 8ee30d4719a54d25822e9804b13a169c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:01:09.451862 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f25d73de-a17f-43b2-9774-8a94ca283dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:09.452514 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f25d73de-a17f-43b2-9774-8a94ca283dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:09.454116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1051/2120] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:01:08 2022] DELETE /identity/v3/projects/8ee30d4719a54d25822e9804b13a169c => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:09.459822 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4f2b6-7968-49ea-ac66-c751b320b4a5 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:09.460189 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4f2b6-7968-49ea-ac66-c751b320b4a5 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:09.460535 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4f2b6-7968-49ea-ac66-c751b320b4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:09.481253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-7da4f2b6-7968-49ea-ac66-c751b320b4a5 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:09.482605 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-7da4f2b6-7968-49ea-ac66-c751b320b4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:09.490703 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1052/2121] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:01:09.510884 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0672ee7-2107-4a97-a490-e24f5b9a59a2 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:09.511365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0672ee7-2107-4a97-a490-e24f5b9a59a2 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:09.511734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0672ee7-2107-4a97-a490-e24f5b9a59a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:09.537631 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-a0672ee7-2107-4a97-a490-e24f5b9a59a2 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:09.540966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-a0672ee7-2107-4a97-a490-e24f5b9a59a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:09.551804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1053/2122] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:09.557809 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0672ee7-2107-4a97-a490-e24f5b9a59a2 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:09.568861 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0672ee7-2107-4a97-a490-e24f5b9a59a2 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:09.581445 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4d5af-6801-46ed-a3e1-cc3929e67da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:09.581445 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4d5af-6801-46ed-a3e1-cc3929e67da1 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:09.581445 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4d5af-6801-46ed-a3e1-cc3929e67da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:09.581445 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4d5af-6801-46ed-a3e1-cc3929e67da1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:09.583777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4d5af-6801-46ed-a3e1-cc3929e67da1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:01:09.583777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4d5af-6801-46ed-a3e1-cc3929e67da1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:09.594349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1070/2123] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:01:09 2022] POST /identity/v3/users => generated 298 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:09.596997 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb50e1c-d05b-4572-b383-321bdb2b4080 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:09.598827 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-8cb50e1c-d05b-4572-b383-321bdb2b4080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:09.604432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4d5af-6801-46ed-a3e1-cc3929e67da1 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:09.618340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb50e1c-d05b-4572-b383-321bdb2b4080 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:09.634727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1054/2124] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:01:09.637025 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657aabd-521f-4be8-bdf8-f130651dfbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:09.642891 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657aabd-521f-4be8-bdf8-f130651dfbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:09.642891 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657aabd-521f-4be8-bdf8-f130651dfbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:09.642891 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657aabd-521f-4be8-bdf8-f130651dfbe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:09.642891 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657aabd-521f-4be8-bdf8-f130651dfbe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:09.643313 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4d5af-6801-46ed-a3e1-cc3929e67da1 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:09.643405 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657aabd-521f-4be8-bdf8-f130651dfbe0 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:09.667011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4d5af-6801-46ed-a3e1-cc3929e67da1 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:09.668194 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26115df-c83c-4edd-8974-f7d190a6dd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:09.668971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26115df-c83c-4edd-8974-f7d190a6dd18 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:09.669319 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26115df-c83c-4edd-8974-f7d190a6dd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:09.669787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26115df-c83c-4edd-8974-f7d190a6dd18 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:09.670765 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26115df-c83c-4edd-8974-f7d190a6dd18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:09.673696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26115df-c83c-4edd-8974-f7d190a6dd18 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:09.690733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1071/2125] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:09.702608 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657aabd-521f-4be8-bdf8-f130651dfbe0 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:09.712334 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657aabd-521f-4be8-bdf8-f130651dfbe0 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:09.717667 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609aa0c-155e-4a97-95f2-6de6fc3d3c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:09.718437 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609aa0c-155e-4a97-95f2-6de6fc3d3c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:09.718883 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609aa0c-155e-4a97-95f2-6de6fc3d3c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:09.719837 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609aa0c-155e-4a97-95f2-6de6fc3d3c9b admin admin] PATH_INFO: `/v3/projects/a928f2b88dac4eb6b1db895ed4969ad8/users/a40b07a848de4093bf0990d0d798ede1/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:09.737120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609aa0c-155e-4a97-95f2-6de6fc3d3c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a928f2b88dac4eb6b1db895ed4969ad8, user_id=a40b07a848de4093bf0990d0d798ede1, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:09.739920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609aa0c-155e-4a97-95f2-6de6fc3d3c9b admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:09.847942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1055/2126] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:01:09 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:09.853163 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26115df-c83c-4edd-8974-f7d190a6dd18 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:09.878271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1072/2127] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:09 2022] PUT /identity/v3/projects/a928f2b88dac4eb6b1db895ed4969ad8/users/a40b07a848de4093bf0990d0d798ede1/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:09.883189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609aa0c-155e-4a97-95f2-6de6fc3d3c9b admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:09.933411 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26115df-c83c-4edd-8974-f7d190a6dd18 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:09.974056 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609aa0c-155e-4a97-95f2-6de6fc3d3c9b admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:09.980262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b3648-18d9-4018-98e8-dbcfbca8913c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:09.980975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b3648-18d9-4018-98e8-dbcfbca8913c admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:09.981264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b3648-18d9-4018-98e8-dbcfbca8913c admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:09.981543 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b3648-18d9-4018-98e8-dbcfbca8913c admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:09.982260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b3648-18d9-4018-98e8-dbcfbca8913c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:09.984022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b3648-18d9-4018-98e8-dbcfbca8913c admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:09.996233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1073/2128] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:10.000833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b3648-18d9-4018-98e8-dbcfbca8913c admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:10.012901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b3648-18d9-4018-98e8-dbcfbca8913c admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:10.018184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009e19e-8559-4453-a3d1-60fedf5c12ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:10.019826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009e19e-8559-4453-a3d1-60fedf5c12ba admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:10.020189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009e19e-8559-4453-a3d1-60fedf5c12ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:10.020545 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009e19e-8559-4453-a3d1-60fedf5c12ba admin admin] PATH_INFO: `/v3/projects/a928f2b88dac4eb6b1db895ed4969ad8/users/a40b07a848de4093bf0990d0d798ede1/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:10.022720 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009e19e-8559-4453-a3d1-60fedf5c12ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a928f2b88dac4eb6b1db895ed4969ad8, user_id=a40b07a848de4093bf0990d0d798ede1, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:10.025480 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009e19e-8559-4453-a3d1-60fedf5c12ba admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:10.050033 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1074/2129] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:09 2022] PUT /identity/v3/projects/a928f2b88dac4eb6b1db895ed4969ad8/users/a40b07a848de4093bf0990d0d798ede1/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:10.052269 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5d144-2836-4970-9e07-17aa7626c9cc None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:10.052627 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5d144-2836-4970-9e07-17aa7626c9cc None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:10.052915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5d144-2836-4970-9e07-17aa7626c9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:10.062133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f237fb-7eb7-4789-890f-84dbbc2262da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:10.062974 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f237fb-7eb7-4789-890f-84dbbc2262da admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:10.063101 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f237fb-7eb7-4789-890f-84dbbc2262da admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:10.067929 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f237fb-7eb7-4789-890f-84dbbc2262da admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:10.068777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f237fb-7eb7-4789-890f-84dbbc2262da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:10.071706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f237fb-7eb7-4789-890f-84dbbc2262da admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:10.099498 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-5fd5d144-2836-4970-9e07-17aa7626c9cc None None] MFA Rules not processed for user `a40b07a848de4093bf0990d0d798ede1`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:10.100903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5fd5d144-2836-4970-9e07-17aa7626c9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:10.174205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1056/2130] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:01:09 2022] POST /identity/v3/users => generated 290 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:10.176244 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f237fb-7eb7-4789-890f-84dbbc2262da admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:10.192152 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f237fb-7eb7-4789-890f-84dbbc2262da admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:10.202456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1075/2131] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:10.214074 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5d144-2836-4970-9e07-17aa7626c9cc None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:10.215803 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5fd5d144-2836-4970-9e07-17aa7626c9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:10.272462 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618a77c-b17e-4726-ab33-89ee45e4fbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:10.273326 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618a77c-b17e-4726-ab33-89ee45e4fbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:10.274718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618a77c-b17e-4726-ab33-89ee45e4fbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:10.275171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618a77c-b17e-4726-ab33-89ee45e4fbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:10.276450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618a77c-b17e-4726-ab33-89ee45e4fbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:10.278047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5d144-2836-4970-9e07-17aa7626c9cc None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:10.278610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618a77c-b17e-4726-ab33-89ee45e4fbb7 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:10.282958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629dbedb-5f5d-4e5d-a929-e3ae4e2dedac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:10.283593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629dbedb-5f5d-4e5d-a929-e3ae4e2dedac service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:10.283904 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629dbedb-5f5d-4e5d-a929-e3ae4e2dedac service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:10.291270 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629dbedb-5f5d-4e5d-a929-e3ae4e2dedac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:10.292760 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1057/2132] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:10.294130 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629dbedb-5f5d-4e5d-a929-e3ae4e2dedac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:10.295820 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629dbedb-5f5d-4e5d-a929-e3ae4e2dedac service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:10.296984 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618a77c-b17e-4726-ab33-89ee45e4fbb7 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:10.310352 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1076/2133] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:01:10.310991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618a77c-b17e-4726-ab33-89ee45e4fbb7 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:10.319903 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b061f2-f1f2-4053-8b7b-5e206b7098b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:10.319903 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b061f2-f1f2-4053-8b7b-5e206b7098b1 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:10.319903 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b061f2-f1f2-4053-8b7b-5e206b7098b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:10.319903 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b061f2-f1f2-4053-8b7b-5e206b7098b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:10.321322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b061f2-f1f2-4053-8b7b-5e206b7098b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:10.323342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b061f2-f1f2-4053-8b7b-5e206b7098b1 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:10.345002 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629dbedb-5f5d-4e5d-a929-e3ae4e2dedac service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:10.345588 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1058/2134] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:10.360077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629dbedb-5f5d-4e5d-a929-e3ae4e2dedac service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:10.365012 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5e885-4e63-460c-9763-ec4a9de570b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:10.365687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5e885-4e63-460c-9763-ec4a9de570b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:10.366724 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5e885-4e63-460c-9763-ec4a9de570b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:10.366724 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5e885-4e63-460c-9763-ec4a9de570b7 admin admin] PATH_INFO: `/v3/projects/61a61a49f1674f3f8c86b879e5a15d12/users/b537d1da4fc34421a2c2c97f06517e35/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:10.382946 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5e885-4e63-460c-9763-ec4a9de570b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a61a49f1674f3f8c86b879e5a15d12, user_id=b537d1da4fc34421a2c2c97f06517e35, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:10.385852 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5e885-4e63-460c-9763-ec4a9de570b7 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:10.466667 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b061f2-f1f2-4053-8b7b-5e206b7098b1 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:10.481536 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1077/2135] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:10 2022] PUT /identity/v3/projects/61a61a49f1674f3f8c86b879e5a15d12/users/b537d1da4fc34421a2c2c97f06517e35/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:10.483391 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b061f2-f1f2-4053-8b7b-5e206b7098b1 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:10.486296 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acac5b-3b76-485c-b5b9-70b3d630c4bb None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:10.486745 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acac5b-3b76-485c-b5b9-70b3d630c4bb None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:10.487095 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acac5b-3b76-485c-b5b9-70b3d630c4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:10.507258 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-56acac5b-3b76-485c-b5b9-70b3d630c4bb None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:10.508682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-56acac5b-3b76-485c-b5b9-70b3d630c4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:10.561367 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dc591-74d1-442c-8167-903dac79ac94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:10.563402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dc591-74d1-442c-8167-903dac79ac94 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:10.563713 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dc591-74d1-442c-8167-903dac79ac94 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:10.564051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dc591-74d1-442c-8167-903dac79ac94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:10.566801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b67dc591-74d1-442c-8167-903dac79ac94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:10.582853 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1078/2136] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:01:10.594867 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acac5b-3b76-485c-b5b9-70b3d630c4bb None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:10.598752 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-56acac5b-3b76-485c-b5b9-70b3d630c4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:10.661194 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67dc591-74d1-442c-8167-903dac79ac94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:10.662995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67dc591-74d1-442c-8167-903dac79ac94 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:10.678305 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1059/2137] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:01:10.726318 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acac5b-3b76-485c-b5b9-70b3d630c4bb None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:10.739025 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:10.740756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f0d9d-85fc-48aa-aefc-ffe5e9d27bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:10.741412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f0d9d-85fc-48aa-aefc-ffe5e9d27bad service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:10.741701 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f0d9d-85fc-48aa-aefc-ffe5e9d27bad service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:10.742072 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f0d9d-85fc-48aa-aefc-ffe5e9d27bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:10.803271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f0d9d-85fc-48aa-aefc-ffe5e9d27bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:10.805810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f0d9d-85fc-48aa-aefc-ffe5e9d27bad service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:10.834560 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1079/2138] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:01:11.379759 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:11.997057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dc591-74d1-442c-8167-903dac79ac94 service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:12.017110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dc591-74d1-442c-8167-903dac79ac94 service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:12.029279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91b12e-64d5-4655-b378-c487cafc5c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:12.030511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91b12e-64d5-4655-b378-c487cafc5c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:12.031310 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91b12e-64d5-4655-b378-c487cafc5c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:12.031836 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91b12e-64d5-4655-b378-c487cafc5c9b admin admin] PATH_INFO: `/v3/users/3be1096e76c6411fa4ab9ab5bfa13f6a` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:12.033485 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91b12e-64d5-4655-b378-c487cafc5c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3be1096e76c6411fa4ab9ab5bfa13f6a)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:12.035744 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91b12e-64d5-4655-b378-c487cafc5c9b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:12.269394 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf299f-cbc1-4121-ba31-3fa72c49cb23 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:12.270248 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf299f-cbc1-4121-ba31-3fa72c49cb23 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:12.270734 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf299f-cbc1-4121-ba31-3fa72c49cb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:12.301472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-9dbf299f-cbc1-4121-ba31-3fa72c49cb23 None None] MFA Rules not processed for user `d7dbcd204d864ad6914aca2c3594089c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:12.302784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-9dbf299f-cbc1-4121-ba31-3fa72c49cb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:12.391758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-fe91b12e-64d5-4655-b378-c487cafc5c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3be1096e76c6411fa4ab9ab5bfa13f6a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:12.396578 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1080/2139] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:01:12.411307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-fe91b12e-64d5-4655-b378-c487cafc5c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3be1096e76c6411fa4ab9ab5bfa13f6a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:12.411957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf299f-cbc1-4121-ba31-3fa72c49cb23 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:12.413628 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-9dbf299f-cbc1-4121-ba31-3fa72c49cb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:12.425967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-fe91b12e-64d5-4655-b378-c487cafc5c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3be1096e76c6411fa4ab9ab5bfa13f6a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:12.426801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-fe91b12e-64d5-4655-b378-c487cafc5c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3be1096e76c6411fa4ab9ab5bfa13f6a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:12.439335 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-fe91b12e-64d5-4655-b378-c487cafc5c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3be1096e76c6411fa4ab9ab5bfa13f6a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:12.494924 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf299f-cbc1-4121-ba31-3fa72c49cb23 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:12.500527 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998a30b-d4aa-48c5-a08c-4b4518bcfd99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:12.513609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998a30b-d4aa-48c5-a08c-4b4518bcfd99 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:12.513609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998a30b-d4aa-48c5-a08c-4b4518bcfd99 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:12.513609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998a30b-d4aa-48c5-a08c-4b4518bcfd99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:12.513609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2998a30b-d4aa-48c5-a08c-4b4518bcfd99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:12.514715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998a30b-d4aa-48c5-a08c-4b4518bcfd99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:12.516384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998a30b-d4aa-48c5-a08c-4b4518bcfd99 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:12.525518 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1081/2140] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:01:12.665558 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1060/2141] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:01:11 2022] DELETE /identity/v3/users/3be1096e76c6411fa4ab9ab5bfa13f6a => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:12.670122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b8a6a-1228-4d8e-a813-7e21867c0a46 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:12.670703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b8a6a-1228-4d8e-a813-7e21867c0a46 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:12.671173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b8a6a-1228-4d8e-a813-7e21867c0a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:12.699544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-4e5b8a6a-1228-4d8e-a813-7e21867c0a46 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:12.700752 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4e5b8a6a-1228-4d8e-a813-7e21867c0a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:12.785713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1082/2142] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:12.799911 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91b12e-64d5-4655-b378-c487cafc5c9b admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:12.801380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-fe91b12e-64d5-4655-b378-c487cafc5c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:12.899105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91b12e-64d5-4655-b378-c487cafc5c9b admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:12.905052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbedd22-b1aa-4ff0-a7d6-2253c796dfc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:12.905996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbedd22-b1aa-4ff0-a7d6-2253c796dfc1 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:12.906608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbedd22-b1aa-4ff0-a7d6-2253c796dfc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:12.907073 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbedd22-b1aa-4ff0-a7d6-2253c796dfc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:12.923141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbedd22-b1aa-4ff0-a7d6-2253c796dfc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:12.924854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbedd22-b1aa-4ff0-a7d6-2253c796dfc1 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:12.946934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1061/2143] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:01:12.999610 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa648b0b-5bef-4e7c-8e17-eaf025299fcf None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:13.000326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa648b0b-5bef-4e7c-8e17-eaf025299fcf None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:13.000326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa648b0b-5bef-4e7c-8e17-eaf025299fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:13.037255 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-fa648b0b-5bef-4e7c-8e17-eaf025299fcf None None] MFA Rules not processed for user `b537d1da4fc34421a2c2c97f06517e35`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:13.038573 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-fa648b0b-5bef-4e7c-8e17-eaf025299fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:13.129382 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1083/2144] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:13.141939 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbedd22-b1aa-4ff0-a7d6-2253c796dfc1 service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:13.143590 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ebbedd22-b1aa-4ff0-a7d6-2253c796dfc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:13.315411 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbedd22-b1aa-4ff0-a7d6-2253c796dfc1 service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:13.320005 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9e0ae-695a-40d2-bffb-daf809d0f9eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:13.321111 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9e0ae-695a-40d2-bffb-daf809d0f9eb service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:13.321423 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9e0ae-695a-40d2-bffb-daf809d0f9eb service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:13.321835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9e0ae-695a-40d2-bffb-daf809d0f9eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:13.335093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9e0ae-695a-40d2-bffb-daf809d0f9eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:13.337733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9e0ae-695a-40d2-bffb-daf809d0f9eb service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:13.349486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1062/2145] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:01:13.384254 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:13.505081 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa648b0b-5bef-4e7c-8e17-eaf025299fcf None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:13.506797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-fa648b0b-5bef-4e7c-8e17-eaf025299fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:13.537023 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa648b0b-5bef-4e7c-8e17-eaf025299fcf None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:13.537023 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6663acf-63ee-40ae-9cdb-6600295092dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:13.537023 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6663acf-63ee-40ae-9cdb-6600295092dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:13.537023 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6663acf-63ee-40ae-9cdb-6600295092dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:13.537393 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6663acf-63ee-40ae-9cdb-6600295092dc admin admin] PATH_INFO: `/v3/projects/62c3283896154dc7b12f4876f1d057a3` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:13.538288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6663acf-63ee-40ae-9cdb-6600295092dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c3283896154dc7b12f4876f1d057a3)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:13.540849 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6663acf-63ee-40ae-9cdb-6600295092dc admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:13.779888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-f6663acf-63ee-40ae-9cdb-6600295092dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c3283896154dc7b12f4876f1d057a3', 'request_id': 'req-f6663acf-63ee-40ae-9cdb-6600295092dc'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:13.786264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-f6663acf-63ee-40ae-9cdb-6600295092dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c3283896154dc7b12f4876f1d057a3', 'request_id': 'req-f6663acf-63ee-40ae-9cdb-6600295092dc'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:13.791987 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-f6663acf-63ee-40ae-9cdb-6600295092dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c3283896154dc7b12f4876f1d057a3', 'request_id': 'req-f6663acf-63ee-40ae-9cdb-6600295092dc'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:13.904869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-f6663acf-63ee-40ae-9cdb-6600295092dc admin admin] The token cache is being invalidate because project 62c3283896154dc7b12f4876f1d057a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:01:13.905708 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-f6663acf-63ee-40ae-9cdb-6600295092dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:13.906262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-f6663acf-63ee-40ae-9cdb-6600295092dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:13.909113 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1084/2146] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:01:13 2022] DELETE /identity/v3/projects/62c3283896154dc7b12f4876f1d057a3 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:13.913490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9e0ae-695a-40d2-bffb-daf809d0f9eb service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:13.926658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:13.946928 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9e0ae-695a-40d2-bffb-daf809d0f9eb service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:13.967521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6663acf-63ee-40ae-9cdb-6600295092dc admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:13.969009 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-f6663acf-63ee-40ae-9cdb-6600295092dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:14.060084 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6b1e2-3ea2-4955-8a59-4d5d8051f4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:14.061503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6b1e2-3ea2-4955-8a59-4d5d8051f4f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:14.061503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6b1e2-3ea2-4955-8a59-4d5d8051f4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:14.061503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6b1e2-3ea2-4955-8a59-4d5d8051f4f1 admin admin] PATH_INFO: `/v3/users/a40b07a848de4093bf0990d0d798ede1` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:14.062778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6b1e2-3ea2-4955-8a59-4d5d8051f4f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a40b07a848de4093bf0990d0d798ede1)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:14.064814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6b1e2-3ea2-4955-8a59-4d5d8051f4f1 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:14.099938 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6663acf-63ee-40ae-9cdb-6600295092dc admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:14.116928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc38691-5b8d-418d-99af-9012a2ed6bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:14.118195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc38691-5b8d-418d-99af-9012a2ed6bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:14.118504 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc38691-5b8d-418d-99af-9012a2ed6bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:14.118931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc38691-5b8d-418d-99af-9012a2ed6bfc admin admin] PATH_INFO: `/v3/users/3717dcd321e24127acc464d69f9088c4` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:14.127901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc38691-5b8d-418d-99af-9012a2ed6bfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3717dcd321e24127acc464d69f9088c4)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:14.127901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc38691-5b8d-418d-99af-9012a2ed6bfc admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:14.363715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a2c6b1e2-3ea2-4955-8a59-4d5d8051f4f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a40b07a848de4093bf0990d0d798ede1'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:14.372510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a2c6b1e2-3ea2-4955-8a59-4d5d8051f4f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a40b07a848de4093bf0990d0d798ede1'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:14.388005 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a2c6b1e2-3ea2-4955-8a59-4d5d8051f4f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a40b07a848de4093bf0990d0d798ede1'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:14.388779 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a2c6b1e2-3ea2-4955-8a59-4d5d8051f4f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a40b07a848de4093bf0990d0d798ede1'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:14.389387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a2c6b1e2-3ea2-4955-8a59-4d5d8051f4f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a40b07a848de4093bf0990d0d798ede1'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:14.459287 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7fc38691-5b8d-418d-99af-9012a2ed6bfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3717dcd321e24127acc464d69f9088c4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:14.460104 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7fc38691-5b8d-418d-99af-9012a2ed6bfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3717dcd321e24127acc464d69f9088c4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:14.486224 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1063/2147] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:01:13 2022] DELETE /identity/v3/users/a40b07a848de4093bf0990d0d798ede1 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:14.486962 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7fc38691-5b8d-418d-99af-9012a2ed6bfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3717dcd321e24127acc464d69f9088c4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:14.630599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7fc38691-5b8d-418d-99af-9012a2ed6bfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3717dcd321e24127acc464d69f9088c4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:14.631635 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7fc38691-5b8d-418d-99af-9012a2ed6bfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3717dcd321e24127acc464d69f9088c4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:14.655070 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1085/2148] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:01:13 2022] DELETE /identity/v3/users/3717dcd321e24127acc464d69f9088c4 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:14.659725 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4045ebe-9d8d-4d77-bcf3-c6fe386aaaab None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:14.660043 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4045ebe-9d8d-4d77-bcf3-c6fe386aaaab None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:14.660324 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4045ebe-9d8d-4d77-bcf3-c6fe386aaaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:14.684082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-d4045ebe-9d8d-4d77-bcf3-c6fe386aaaab None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:14.685827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d4045ebe-9d8d-4d77-bcf3-c6fe386aaaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:14.760530 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1064/2149] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:14.772601 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc38691-5b8d-418d-99af-9012a2ed6bfc admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:14.774955 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-7fc38691-5b8d-418d-99af-9012a2ed6bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:14.916796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc38691-5b8d-418d-99af-9012a2ed6bfc admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:14.929420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c394a-410b-4171-a00d-7d17be8cc8cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:14.929420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c394a-410b-4171-a00d-7d17be8cc8cf service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:14.929420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c394a-410b-4171-a00d-7d17be8cc8cf service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:14.929420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c394a-410b-4171-a00d-7d17be8cc8cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:14.949850 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c394a-410b-4171-a00d-7d17be8cc8cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:14.952917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c394a-410b-4171-a00d-7d17be8cc8cf service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:14.967837 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1086/2150] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:01:15.374011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4045ebe-9d8d-4d77-bcf3-c6fe386aaaab None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:15.376670 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d4045ebe-9d8d-4d77-bcf3-c6fe386aaaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:15.407007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4045ebe-9d8d-4d77-bcf3-c6fe386aaaab None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:15.426076 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31a4d0-06f9-4c54-9aec-80c83237f170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:15.426766 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31a4d0-06f9-4c54-9aec-80c83237f170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:15.427051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31a4d0-06f9-4c54-9aec-80c83237f170 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:15.427326 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31a4d0-06f9-4c54-9aec-80c83237f170 admin admin] PATH_INFO: `/v3/projects/a928f2b88dac4eb6b1db895ed4969ad8` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:15.428520 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31a4d0-06f9-4c54-9aec-80c83237f170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a928f2b88dac4eb6b1db895ed4969ad8)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:15.433017 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31a4d0-06f9-4c54-9aec-80c83237f170 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:15.641277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:15.680478 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ef31a4d0-06f9-4c54-9aec-80c83237f170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a928f2b88dac4eb6b1db895ed4969ad8', 'request_id': 'req-ef31a4d0-06f9-4c54-9aec-80c83237f170'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:15.689577 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ef31a4d0-06f9-4c54-9aec-80c83237f170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a928f2b88dac4eb6b1db895ed4969ad8', 'request_id': 'req-ef31a4d0-06f9-4c54-9aec-80c83237f170'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:15.838474 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c394a-410b-4171-a00d-7d17be8cc8cf service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:15.839966 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-019c394a-410b-4171-a00d-7d17be8cc8cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:15.870381 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c394a-410b-4171-a00d-7d17be8cc8cf service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:15.897470 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ef31a4d0-06f9-4c54-9aec-80c83237f170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a928f2b88dac4eb6b1db895ed4969ad8', 'request_id': 'req-ef31a4d0-06f9-4c54-9aec-80c83237f170'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:15.912411 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ef31a4d0-06f9-4c54-9aec-80c83237f170 admin admin] The token cache is being invalidate because project a928f2b88dac4eb6b1db895ed4969ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:01:15.912706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ef31a4d0-06f9-4c54-9aec-80c83237f170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:15.914078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ef31a4d0-06f9-4c54-9aec-80c83237f170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:15.917062 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1065/2151] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:01:15 2022] DELETE /identity/v3/projects/a928f2b88dac4eb6b1db895ed4969ad8 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:15.923980 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bae8bc-6f06-4aed-9b41-6d67ce53aeaa None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:15.924365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bae8bc-6f06-4aed-9b41-6d67ce53aeaa None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:15.924929 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bae8bc-6f06-4aed-9b41-6d67ce53aeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:15.956226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-48bae8bc-6f06-4aed-9b41-6d67ce53aeaa None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:15.957752 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db977c8-7fb1-43f2-aa29-c10cedeb93f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:15.958451 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db977c8-7fb1-43f2-aa29-c10cedeb93f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:15.958952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-48bae8bc-6f06-4aed-9b41-6d67ce53aeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:15.959256 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db977c8-7fb1-43f2-aa29-c10cedeb93f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:15.959552 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db977c8-7fb1-43f2-aa29-c10cedeb93f1 admin admin] PATH_INFO: `/v3/projects/cb7d6b912e2e4a328e54474ddad30938` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:15.960880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db977c8-7fb1-43f2-aa29-c10cedeb93f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb7d6b912e2e4a328e54474ddad30938)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:15.963794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db977c8-7fb1-43f2-aa29-c10cedeb93f1 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:15.978432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1066/2152] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:15.980185 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a255b29-e50f-4be7-a2d5-d2c45ca99b79 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:15.981922 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a255b29-e50f-4be7-a2d5-d2c45ca99b79 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:15.981922 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a255b29-e50f-4be7-a2d5-d2c45ca99b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:16.003393 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-7a255b29-e50f-4be7-a2d5-d2c45ca99b79 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:16.004739 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-7a255b29-e50f-4be7-a2d5-d2c45ca99b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:16.013791 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1067/2153] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:16.018085 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a255b29-e50f-4be7-a2d5-d2c45ca99b79 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:16.028195 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a255b29-e50f-4be7-a2d5-d2c45ca99b79 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:16.032808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df47b56-317a-4e80-8313-8a4d23bf2fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:16.033481 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df47b56-317a-4e80-8313-8a4d23bf2fcc admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:16.033769 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df47b56-317a-4e80-8313-8a4d23bf2fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:16.034056 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df47b56-317a-4e80-8313-8a4d23bf2fcc admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:16.034833 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df47b56-317a-4e80-8313-8a4d23bf2fcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:01:16.035147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df47b56-317a-4e80-8313-8a4d23bf2fcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:16.036828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df47b56-317a-4e80-8313-8a4d23bf2fcc admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:16.051365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1068/2154] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:01:16.065390 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df47b56-317a-4e80-8313-8a4d23bf2fcc admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:16.075736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df47b56-317a-4e80-8313-8a4d23bf2fcc admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:16.080613 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd9567-c805-4a01-b5b6-f40c595aeed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:16.081182 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd9567-c805-4a01-b5b6-f40c595aeed4 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:16.081470 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd9567-c805-4a01-b5b6-f40c595aeed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:16.081752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd9567-c805-4a01-b5b6-f40c595aeed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:16.082470 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd9567-c805-4a01-b5b6-f40c595aeed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:16.084510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd9567-c805-4a01-b5b6-f40c595aeed4 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:16.116387 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:16.136177 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-0db977c8-7fb1-43f2-aa29-c10cedeb93f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb7d6b912e2e4a328e54474ddad30938', 'request_id': 'req-0db977c8-7fb1-43f2-aa29-c10cedeb93f1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:16.143576 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-0db977c8-7fb1-43f2-aa29-c10cedeb93f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb7d6b912e2e4a328e54474ddad30938', 'request_id': 'req-0db977c8-7fb1-43f2-aa29-c10cedeb93f1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:16.150819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-0db977c8-7fb1-43f2-aa29-c10cedeb93f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb7d6b912e2e4a328e54474ddad30938', 'request_id': 'req-0db977c8-7fb1-43f2-aa29-c10cedeb93f1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:16.192589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1069/2155] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:01:16 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:01:16.196746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd9567-c805-4a01-b5b6-f40c595aeed4 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:16.266714 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-0db977c8-7fb1-43f2-aa29-c10cedeb93f1 admin admin] The token cache is being invalidate because project cb7d6b912e2e4a328e54474ddad30938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:01:16.267302 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-0db977c8-7fb1-43f2-aa29-c10cedeb93f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:16.268314 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-0db977c8-7fb1-43f2-aa29-c10cedeb93f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:16.270785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1087/2156] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:01:15 2022] DELETE /identity/v3/projects/cb7d6b912e2e4a328e54474ddad30938 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:16.274355 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db977c8-7fb1-43f2-aa29-c10cedeb93f1 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:16.276175 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0db977c8-7fb1-43f2-aa29-c10cedeb93f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:16.291231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd9567-c805-4a01-b5b6-f40c595aeed4 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:16.299416 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87ef5e-ffbe-4afd-a25d-93ae9a64d33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:16.300303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87ef5e-ffbe-4afd-a25d-93ae9a64d33d admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:16.300774 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87ef5e-ffbe-4afd-a25d-93ae9a64d33d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:16.301186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87ef5e-ffbe-4afd-a25d-93ae9a64d33d admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:16.302050 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87ef5e-ffbe-4afd-a25d-93ae9a64d33d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:16.305303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87ef5e-ffbe-4afd-a25d-93ae9a64d33d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:16.347868 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db977c8-7fb1-43f2-aa29-c10cedeb93f1 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:16.353691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb5771-e0bf-4fd2-b2da-994b95de3e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:16.354470 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb5771-e0bf-4fd2-b2da-994b95de3e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:16.355538 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb5771-e0bf-4fd2-b2da-994b95de3e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:16.355901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb5771-e0bf-4fd2-b2da-994b95de3e97 admin admin] PATH_INFO: `/v3/users/48fe591ca0aa4554852e986aec2388b6` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:16.357402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb5771-e0bf-4fd2-b2da-994b95de3e97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48fe591ca0aa4554852e986aec2388b6)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:16.359747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb5771-e0bf-4fd2-b2da-994b95de3e97 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:16.402568 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1070/2157] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:01:16 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:01:16.403919 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b6049-f850-475a-9e91-ca261a66292d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:16.404207 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b6049-f850-475a-9e91-ca261a66292d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:16.404484 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b6049-f850-475a-9e91-ca261a66292d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:16.427558 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-ee8b6049-f850-475a-9e91-ca261a66292d None None] MFA Rules not processed for user `d7dbcd204d864ad6914aca2c3594089c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:16.435777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ee8b6049-f850-475a-9e91-ca261a66292d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:16.508672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1071/2158] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:16.509646 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b6049-f850-475a-9e91-ca261a66292d None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:16.511086 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ee8b6049-f850-475a-9e91-ca261a66292d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:16.527464 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b6049-f850-475a-9e91-ca261a66292d None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:16.533756 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4e91a-7827-48b0-b05c-66574af04e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:16.534683 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4e91a-7827-48b0-b05c-66574af04e9b admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:16.536178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4e91a-7827-48b0-b05c-66574af04e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:16.536178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4e91a-7827-48b0-b05c-66574af04e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:16.536178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4e91a-7827-48b0-b05c-66574af04e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:16.538029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4e91a-7827-48b0-b05c-66574af04e9b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:16.553526 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1072/2159] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:16.555251 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286f47d-0ac3-417d-be17-415ab82776f7 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:16.555715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286f47d-0ac3-417d-be17-415ab82776f7 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:16.556193 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286f47d-0ac3-417d-be17-415ab82776f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:16.591733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-a286f47d-0ac3-417d-be17-415ab82776f7 None None] MFA Rules not processed for user `b537d1da4fc34421a2c2c97f06517e35`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:16.594167 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-a286f47d-0ac3-417d-be17-415ab82776f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:16.634753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-90eb5771-e0bf-4fd2-b2da-994b95de3e97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48fe591ca0aa4554852e986aec2388b6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:16.636148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-90eb5771-e0bf-4fd2-b2da-994b95de3e97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48fe591ca0aa4554852e986aec2388b6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:16.666802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-90eb5771-e0bf-4fd2-b2da-994b95de3e97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48fe591ca0aa4554852e986aec2388b6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:16.683041 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1073/2160] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:16.684002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286f47d-0ac3-417d-be17-415ab82776f7 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:16.695887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286f47d-0ac3-417d-be17-415ab82776f7 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:16.702257 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df418c1-c65b-46c2-896c-6bad8205817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:16.702779 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df418c1-c65b-46c2-896c-6bad8205817d admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:16.703339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df418c1-c65b-46c2-896c-6bad8205817d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:16.703614 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df418c1-c65b-46c2-896c-6bad8205817d admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:16.704365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df418c1-c65b-46c2-896c-6bad8205817d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:16.707495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df418c1-c65b-46c2-896c-6bad8205817d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:16.722723 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1074/2161] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:16.727662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df418c1-c65b-46c2-896c-6bad8205817d admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:16.742436 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df418c1-c65b-46c2-896c-6bad8205817d admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:16.744441 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd4e76-48d6-4671-8fa5-80d35583b5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:16.745132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd4e76-48d6-4671-8fa5-80d35583b5ff admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:16.745421 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd4e76-48d6-4671-8fa5-80d35583b5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:16.745704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd4e76-48d6-4671-8fa5-80d35583b5ff admin admin] PATH_INFO: `/v3/projects/3c55c4dc0c454a1b8a882d546280b1f7/users/7e129bf7fcbe41b1977cebbc6e7cc7e7/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:16.766228 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd4e76-48d6-4671-8fa5-80d35583b5ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c55c4dc0c454a1b8a882d546280b1f7, user_id=7e129bf7fcbe41b1977cebbc6e7cc7e7, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:16.773160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd4e76-48d6-4671-8fa5-80d35583b5ff admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:16.824197 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-90eb5771-e0bf-4fd2-b2da-994b95de3e97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48fe591ca0aa4554852e986aec2388b6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:16.826437 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-90eb5771-e0bf-4fd2-b2da-994b95de3e97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48fe591ca0aa4554852e986aec2388b6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:16.848563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1088/2162] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:01:16 2022] DELETE /identity/v3/users/48fe591ca0aa4554852e986aec2388b6 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:16.930835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1075/2163] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:16 2022] PUT /identity/v3/projects/3c55c4dc0c454a1b8a882d546280b1f7/users/7e129bf7fcbe41b1977cebbc6e7cc7e7/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:01:16.949010 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524a3fa-1630-46a1-bb9c-1a0c7922cf79 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:16.949010 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524a3fa-1630-46a1-bb9c-1a0c7922cf79 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:16.949010 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524a3fa-1630-46a1-bb9c-1a0c7922cf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:16.994361 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-2524a3fa-1630-46a1-bb9c-1a0c7922cf79 None None] MFA Rules not processed for user `7e129bf7fcbe41b1977cebbc6e7cc7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:16.995862 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2524a3fa-1630-46a1-bb9c-1a0c7922cf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:17.013789 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:17.115036 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1089/2164] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:17.128984 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd4e76-48d6-4671-8fa5-80d35583b5ff admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:17.130732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-17fd4e76-48d6-4671-8fa5-80d35583b5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:17.180047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524a3fa-1630-46a1-bb9c-1a0c7922cf79 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:17.182904 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2524a3fa-1630-46a1-bb9c-1a0c7922cf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:17.213407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd4e76-48d6-4671-8fa5-80d35583b5ff admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:17.218174 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae353b-6abe-4513-928e-40aee08e6892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:17.219262 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae353b-6abe-4513-928e-40aee08e6892 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:17.219262 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae353b-6abe-4513-928e-40aee08e6892 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:17.219540 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae353b-6abe-4513-928e-40aee08e6892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:17.239490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae353b-6abe-4513-928e-40aee08e6892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:17.241608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae353b-6abe-4513-928e-40aee08e6892 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:17.258956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1076/2165] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:01:17.283091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524a3fa-1630-46a1-bb9c-1a0c7922cf79 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:17.292930 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75615b29-7692-4567-9d73-fe58dce3d313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:17.294234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75615b29-7692-4567-9d73-fe58dce3d313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:17.294637 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75615b29-7692-4567-9d73-fe58dce3d313 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:17.294977 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75615b29-7692-4567-9d73-fe58dce3d313 admin admin] PATH_INFO: `/v3/users/aebb85cedc914c4a837d569ac489ff76` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:17.296707 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75615b29-7692-4567-9d73-fe58dce3d313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aebb85cedc914c4a837d569ac489ff76)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:17.299316 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75615b29-7692-4567-9d73-fe58dce3d313 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:17.558429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae353b-6abe-4513-928e-40aee08e6892 service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:17.560023 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8bae353b-6abe-4513-928e-40aee08e6892 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:17.593213 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae353b-6abe-4513-928e-40aee08e6892 service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:17.603479 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd27d3-82c1-4c14-a667-d570392aa4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:17.604172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd27d3-82c1-4c14-a667-d570392aa4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:17.604477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd27d3-82c1-4c14-a667-d570392aa4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:17.605746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd27d3-82c1-4c14-a667-d570392aa4fb admin admin] PATH_INFO: `/v3/projects/5d10b704b9bd40f2b24fb8d82ae306e6` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:17.606999 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd27d3-82c1-4c14-a667-d570392aa4fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d10b704b9bd40f2b24fb8d82ae306e6)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:17.609008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd27d3-82c1-4c14-a667-d570392aa4fb admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:17.635234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-75615b29-7692-4567-9d73-fe58dce3d313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aebb85cedc914c4a837d569ac489ff76'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:17.636476 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-75615b29-7692-4567-9d73-fe58dce3d313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aebb85cedc914c4a837d569ac489ff76'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:17.653931 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-75615b29-7692-4567-9d73-fe58dce3d313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aebb85cedc914c4a837d569ac489ff76'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:17.804322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-85cd27d3-82c1-4c14-a667-d570392aa4fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d10b704b9bd40f2b24fb8d82ae306e6', 'request_id': 'req-85cd27d3-82c1-4c14-a667-d570392aa4fb'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:17.810942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-85cd27d3-82c1-4c14-a667-d570392aa4fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d10b704b9bd40f2b24fb8d82ae306e6', 'request_id': 'req-85cd27d3-82c1-4c14-a667-d570392aa4fb'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:17.834763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-75615b29-7692-4567-9d73-fe58dce3d313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aebb85cedc914c4a837d569ac489ff76'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:17.837348 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-75615b29-7692-4567-9d73-fe58dce3d313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aebb85cedc914c4a837d569ac489ff76'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:17.850661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1090/2166] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:01:17 2022] DELETE /identity/v3/users/aebb85cedc914c4a837d569ac489ff76 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:17.855300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb261d09-6500-4b98-b4ee-d2e477113c10 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:17.855738 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb261d09-6500-4b98-b4ee-d2e477113c10 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:17.856096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb261d09-6500-4b98-b4ee-d2e477113c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:17.879079 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-eb261d09-6500-4b98-b4ee-d2e477113c10 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:17.880972 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-eb261d09-6500-4b98-b4ee-d2e477113c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:17.939077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1091/2167] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:01:17.949287 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb261d09-6500-4b98-b4ee-d2e477113c10 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:17.952073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-eb261d09-6500-4b98-b4ee-d2e477113c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:18.008468 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb261d09-6500-4b98-b4ee-d2e477113c10 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:18.012284 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c8cac-cdc4-45aa-9c3f-df96d3d4abfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:18.012912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c8cac-cdc4-45aa-9c3f-df96d3d4abfb service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:18.013201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c8cac-cdc4-45aa-9c3f-df96d3d4abfb service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:18.013478 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c8cac-cdc4-45aa-9c3f-df96d3d4abfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:18.023118 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c8cac-cdc4-45aa-9c3f-df96d3d4abfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:18.024593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c8cac-cdc4-45aa-9c3f-df96d3d4abfb service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:18.034678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1092/2168] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:01:18.058086 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-85cd27d3-82c1-4c14-a667-d570392aa4fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d10b704b9bd40f2b24fb8d82ae306e6', 'request_id': 'req-85cd27d3-82c1-4c14-a667-d570392aa4fb'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:18.071829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-85cd27d3-82c1-4c14-a667-d570392aa4fb admin admin] The token cache is being invalidate because project 5d10b704b9bd40f2b24fb8d82ae306e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:01:18.072339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-85cd27d3-82c1-4c14-a667-d570392aa4fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:18.073144 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-85cd27d3-82c1-4c14-a667-d570392aa4fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:18.076034 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1077/2169] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:01:17 2022] DELETE /identity/v3/projects/5d10b704b9bd40f2b24fb8d82ae306e6 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:01:18.081626 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281f832-5b46-4927-8587-496525a3e3db None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:18.081910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281f832-5b46-4927-8587-496525a3e3db None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:18.082191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281f832-5b46-4927-8587-496525a3e3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:18.119100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-3281f832-5b46-4927-8587-496525a3e3db None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:18.120384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3281f832-5b46-4927-8587-496525a3e3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:18.134937 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1093/2170] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:18.144139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60dfd4-adf4-4230-b3d0-09715ba38aee None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:18.144435 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60dfd4-adf4-4230-b3d0-09715ba38aee None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:18.144712 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60dfd4-adf4-4230-b3d0-09715ba38aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:18.165605 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-ed60dfd4-adf4-4230-b3d0-09715ba38aee None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:18.166961 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ed60dfd4-adf4-4230-b3d0-09715ba38aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:18.175069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1078/2171] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:18.180314 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281f832-5b46-4927-8587-496525a3e3db None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:18.190013 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281f832-5b46-4927-8587-496525a3e3db None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:18.194786 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d106f-e84b-4b3d-9421-bd0d904d93aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:18.196082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d106f-e84b-4b3d-9421-bd0d904d93aa admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:18.196318 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d106f-e84b-4b3d-9421-bd0d904d93aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:18.196639 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d106f-e84b-4b3d-9421-bd0d904d93aa admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:18.197367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d106f-e84b-4b3d-9421-bd0d904d93aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:01:18.197675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d106f-e84b-4b3d-9421-bd0d904d93aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:18.199385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d106f-e84b-4b3d-9421-bd0d904d93aa admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:18.219231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1094/2172] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:01:18.220593 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60dfd4-adf4-4230-b3d0-09715ba38aee None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:18.230511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60dfd4-adf4-4230-b3d0-09715ba38aee None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:18.235209 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c53ce-9f74-4314-8c4a-143c7435feae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:18.235818 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c53ce-9f74-4314-8c4a-143c7435feae admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:18.236102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c53ce-9f74-4314-8c4a-143c7435feae admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:18.236379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c53ce-9f74-4314-8c4a-143c7435feae admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:18.237050 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c53ce-9f74-4314-8c4a-143c7435feae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:18.239023 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c53ce-9f74-4314-8c4a-143c7435feae admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:18.310143 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:18.384129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1079/2173] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:01:18 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:18.388176 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d106f-e84b-4b3d-9421-bd0d904d93aa admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:18.403292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d106f-e84b-4b3d-9421-bd0d904d93aa admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:18.469695 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a147d-6127-4714-b005-45b9c1aeec81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:18.470268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a147d-6127-4714-b005-45b9c1aeec81 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:18.470959 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a147d-6127-4714-b005-45b9c1aeec81 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:18.470959 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a147d-6127-4714-b005-45b9c1aeec81 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:18.471503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a147d-6127-4714-b005-45b9c1aeec81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:18.473431 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a147d-6127-4714-b005-45b9c1aeec81 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:18.580510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:18.593214 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c53ce-9f74-4314-8c4a-143c7435feae admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:18.595911 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-fe4c53ce-9f74-4314-8c4a-143c7435feae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:18.596067 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1095/2174] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:01:18 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:18.600902 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a147d-6127-4714-b005-45b9c1aeec81 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:18.615124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a147d-6127-4714-b005-45b9c1aeec81 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:18.620367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05745b5d-e3d5-4378-81e3-d217e8250d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:18.629053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05745b5d-e3d5-4378-81e3-d217e8250d13 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:18.629053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05745b5d-e3d5-4378-81e3-d217e8250d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:18.629053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05745b5d-e3d5-4378-81e3-d217e8250d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:18.629053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05745b5d-e3d5-4378-81e3-d217e8250d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:18.629053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05745b5d-e3d5-4378-81e3-d217e8250d13 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:18.633631 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c53ce-9f74-4314-8c4a-143c7435feae admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:18.637862 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1096/2175] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:18.643776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619bdc6-c6b6-4fb8-ae52-4764b824d27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:18.644207 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05745b5d-e3d5-4378-81e3-d217e8250d13 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:18.645853 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619bdc6-c6b6-4fb8-ae52-4764b824d27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:18.647613 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619bdc6-c6b6-4fb8-ae52-4764b824d27e admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:18.649190 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619bdc6-c6b6-4fb8-ae52-4764b824d27e admin admin] PATH_INFO: `/v3/projects/be86dbb894e641b3a9ed4b3ecb94656a` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:18.651166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619bdc6-c6b6-4fb8-ae52-4764b824d27e admin admin] RBAC: Authorizing `identity:delete_project(project_id=be86dbb894e641b3a9ed4b3ecb94656a)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:18.653492 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619bdc6-c6b6-4fb8-ae52-4764b824d27e admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:18.663362 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05745b5d-e3d5-4378-81e3-d217e8250d13 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:18.672965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8410545-e94a-446b-80f4-ca6980043c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:18.672965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8410545-e94a-446b-80f4-ca6980043c7f admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:18.672965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8410545-e94a-446b-80f4-ca6980043c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:18.672965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8410545-e94a-446b-80f4-ca6980043c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:18.673358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8410545-e94a-446b-80f4-ca6980043c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:18.675038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8410545-e94a-446b-80f4-ca6980043c7f admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:18.686428 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1097/2176] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:18.690574 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8410545-e94a-446b-80f4-ca6980043c7f admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:18.701457 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8410545-e94a-446b-80f4-ca6980043c7f admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:18.707011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d017e1-41bd-425b-b7c4-379942e93980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:18.707719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d017e1-41bd-425b-b7c4-379942e93980 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:18.707997 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d017e1-41bd-425b-b7c4-379942e93980 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:18.708273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d017e1-41bd-425b-b7c4-379942e93980 admin admin] PATH_INFO: `/v3/projects/f256c2451a194f66b89fd2816aa6accf/users/79ae49dcca054862ab5758a68e766f16/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:18.723865 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d017e1-41bd-425b-b7c4-379942e93980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f256c2451a194f66b89fd2816aa6accf, user_id=79ae49dcca054862ab5758a68e766f16, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:18.727160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d017e1-41bd-425b-b7c4-379942e93980 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:19.028923 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1098/2177] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:18 2022] PUT /identity/v3/projects/f256c2451a194f66b89fd2816aa6accf/users/79ae49dcca054862ab5758a68e766f16/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:01:19.035182 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5619bdc6-c6b6-4fb8-ae52-4764b824d27e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be86dbb894e641b3a9ed4b3ecb94656a', 'request_id': 'req-5619bdc6-c6b6-4fb8-ae52-4764b824d27e'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:19.037663 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6fc20-f74b-4962-aca6-57d9d4ddcca5 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:19.037953 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6fc20-f74b-4962-aca6-57d9d4ddcca5 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:19.038227 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6fc20-f74b-4962-aca6-57d9d4ddcca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:19.041744 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5619bdc6-c6b6-4fb8-ae52-4764b824d27e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be86dbb894e641b3a9ed4b3ecb94656a', 'request_id': 'req-5619bdc6-c6b6-4fb8-ae52-4764b824d27e'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:19.068730 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-a5d6fc20-f74b-4962-aca6-57d9d4ddcca5 None None] MFA Rules not processed for user `79ae49dcca054862ab5758a68e766f16`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:19.074616 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a5d6fc20-f74b-4962-aca6-57d9d4ddcca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:19.132893 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1099/2178] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:01:19.137817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6fc20-f74b-4962-aca6-57d9d4ddcca5 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:19.201626 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6fc20-f74b-4962-aca6-57d9d4ddcca5 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:19.206236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089670d-aef4-46e4-9682-62cfb39b807d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:19.206892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089670d-aef4-46e4-9682-62cfb39b807d admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:19.207215 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089670d-aef4-46e4-9682-62cfb39b807d admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:19.207508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089670d-aef4-46e4-9682-62cfb39b807d admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:19.208201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089670d-aef4-46e4-9682-62cfb39b807d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:19.210124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089670d-aef4-46e4-9682-62cfb39b807d admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:19.292352 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5619bdc6-c6b6-4fb8-ae52-4764b824d27e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be86dbb894e641b3a9ed4b3ecb94656a', 'request_id': 'req-5619bdc6-c6b6-4fb8-ae52-4764b824d27e'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:19.305036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5619bdc6-c6b6-4fb8-ae52-4764b824d27e admin admin] The token cache is being invalidate because project be86dbb894e641b3a9ed4b3ecb94656a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:01:19.305378 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5619bdc6-c6b6-4fb8-ae52-4764b824d27e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:19.306030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5619bdc6-c6b6-4fb8-ae52-4764b824d27e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:19.307675 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1080/2179] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:01:18 2022] DELETE /identity/v3/projects/be86dbb894e641b3a9ed4b3ecb94656a => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:01:19.311772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619bdc6-c6b6-4fb8-ae52-4764b824d27e admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:19.313097 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-5619bdc6-c6b6-4fb8-ae52-4764b824d27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:19.326866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619bdc6-c6b6-4fb8-ae52-4764b824d27e admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:19.331907 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558b341-dbdc-46e1-9181-913afa9ae9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:19.332588 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558b341-dbdc-46e1-9181-913afa9ae9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:19.355511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558b341-dbdc-46e1-9181-913afa9ae9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:19.355511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558b341-dbdc-46e1-9181-913afa9ae9e0 admin admin] PATH_INFO: `/v3/users/2f34b663482143feb0bb7c90547f4a72` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:19.355511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558b341-dbdc-46e1-9181-913afa9ae9e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f34b663482143feb0bb7c90547f4a72)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:19.355511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558b341-dbdc-46e1-9181-913afa9ae9e0 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:19.383593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1100/2180] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:01:19 2022] POST /identity/v3/projects => generated 383 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:19.384618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089670d-aef4-46e4-9682-62cfb39b807d admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:19.386898 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-8089670d-aef4-46e4-9682-62cfb39b807d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:19.456471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089670d-aef4-46e4-9682-62cfb39b807d admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:19.461149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aeb3a1-157a-40b7-9a6b-7902985edf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:19.461774 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aeb3a1-157a-40b7-9a6b-7902985edf09 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:19.462063 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aeb3a1-157a-40b7-9a6b-7902985edf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:19.462349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aeb3a1-157a-40b7-9a6b-7902985edf09 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:19.463054 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aeb3a1-157a-40b7-9a6b-7902985edf09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:19.465071 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aeb3a1-157a-40b7-9a6b-7902985edf09 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:19.542125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f558b341-dbdc-46e1-9181-913afa9ae9e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f34b663482143feb0bb7c90547f4a72'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:19.550641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f558b341-dbdc-46e1-9181-913afa9ae9e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f34b663482143feb0bb7c90547f4a72'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:19.567445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1101/2181] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:01:19 2022] POST /identity/v3/users => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:19.570569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f558b341-dbdc-46e1-9181-913afa9ae9e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f34b663482143feb0bb7c90547f4a72'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:19.570569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f558b341-dbdc-46e1-9181-913afa9ae9e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f34b663482143feb0bb7c90547f4a72'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:19.570569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f558b341-dbdc-46e1-9181-913afa9ae9e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f34b663482143feb0bb7c90547f4a72'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:19.571408 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aeb3a1-157a-40b7-9a6b-7902985edf09 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:19.573468 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e6aeb3a1-157a-40b7-9a6b-7902985edf09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:19.587277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aeb3a1-157a-40b7-9a6b-7902985edf09 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:19.592297 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2288d7f-8352-4de6-8300-3bd8f5d6d7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:19.592946 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2288d7f-8352-4de6-8300-3bd8f5d6d7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:19.593458 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2288d7f-8352-4de6-8300-3bd8f5d6d7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:19.593874 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2288d7f-8352-4de6-8300-3bd8f5d6d7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:19.594615 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2288d7f-8352-4de6-8300-3bd8f5d6d7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:19.600898 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2288d7f-8352-4de6-8300-3bd8f5d6d7c7 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:19.606451 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1102/2182] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:19.610537 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2288d7f-8352-4de6-8300-3bd8f5d6d7c7 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:19.620284 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2288d7f-8352-4de6-8300-3bd8f5d6d7c7 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:19.625770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c499240-f930-4a30-9430-8dbc0cb99df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:19.632249 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c499240-f930-4a30-9430-8dbc0cb99df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:19.632249 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c499240-f930-4a30-9430-8dbc0cb99df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:19.632249 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c499240-f930-4a30-9430-8dbc0cb99df0 admin admin] PATH_INFO: `/v3/projects/ba3433e84f2d4f479d4d5afccfe5237b/users/2acad07cddbd4c6b885468b08c6b2722/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:19.643776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c499240-f930-4a30-9430-8dbc0cb99df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3433e84f2d4f479d4d5afccfe5237b, user_id=2acad07cddbd4c6b885468b08c6b2722, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:19.646760 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c499240-f930-4a30-9430-8dbc0cb99df0 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:19.659972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1081/2183] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:01:19 2022] DELETE /identity/v3/users/2f34b663482143feb0bb7c90547f4a72 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:01:19.877543 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1103/2184] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:19 2022] PUT /identity/v3/projects/ba3433e84f2d4f479d4d5afccfe5237b/users/2acad07cddbd4c6b885468b08c6b2722/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:01:19.881310 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558b341-dbdc-46e1-9181-913afa9ae9e0 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:19.960258 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558b341-dbdc-46e1-9181-913afa9ae9e0 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:20.022950 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78a18b-f44c-43e2-af8d-0f00fa1d2dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:20.023656 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78a18b-f44c-43e2-af8d-0f00fa1d2dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:20.023916 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78a18b-f44c-43e2-af8d-0f00fa1d2dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:20.024190 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78a18b-f44c-43e2-af8d-0f00fa1d2dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:20.024883 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78a18b-f44c-43e2-af8d-0f00fa1d2dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:20.026607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78a18b-f44c-43e2-af8d-0f00fa1d2dc0 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:20.043968 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1082/2185] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:20.051609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c499240-f930-4a30-9430-8dbc0cb99df0 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:20.064395 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c499240-f930-4a30-9430-8dbc0cb99df0 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:20.071194 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc512c-d955-40e4-b061-2628d35bdebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:20.071847 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc512c-d955-40e4-b061-2628d35bdebb admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:20.072453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc512c-d955-40e4-b061-2628d35bdebb admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:20.072901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc512c-d955-40e4-b061-2628d35bdebb admin admin] PATH_INFO: `/v3/projects/ba3433e84f2d4f479d4d5afccfe5237b/users/2acad07cddbd4c6b885468b08c6b2722/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:20.076472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc512c-d955-40e4-b061-2628d35bdebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3433e84f2d4f479d4d5afccfe5237b, user_id=2acad07cddbd4c6b885468b08c6b2722, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:20.079357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc512c-d955-40e4-b061-2628d35bdebb admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:20.093317 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1104/2186] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:20 2022] PUT /identity/v3/projects/ba3433e84f2d4f479d4d5afccfe5237b/users/2acad07cddbd4c6b885468b08c6b2722/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:20.103464 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02290c6a-671c-47d8-ac1d-18377eb5954a None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:20.103755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02290c6a-671c-47d8-ac1d-18377eb5954a None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:20.104030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02290c6a-671c-47d8-ac1d-18377eb5954a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:20.132285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-02290c6a-671c-47d8-ac1d-18377eb5954a None None] MFA Rules not processed for user `2acad07cddbd4c6b885468b08c6b2722`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:20.139036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-02290c6a-671c-47d8-ac1d-18377eb5954a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:20.208888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc512c-d955-40e4-b061-2628d35bdebb admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:20.210785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-dacc512c-d955-40e4-b061-2628d35bdebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:20.216720 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1083/2187] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:20.229175 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02290c6a-671c-47d8-ac1d-18377eb5954a None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:20.231386 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-02290c6a-671c-47d8-ac1d-18377eb5954a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:20.286115 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc512c-d955-40e4-b061-2628d35bdebb admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:20.291004 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e8d8e-8863-4b7d-a8fa-bc08517f6ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:20.291672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e8d8e-8863-4b7d-a8fa-bc08517f6ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:20.291958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e8d8e-8863-4b7d-a8fa-bc08517f6ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:20.292244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e8d8e-8863-4b7d-a8fa-bc08517f6ac0 admin admin] PATH_INFO: `/v3/projects/6ba1b628210a4a0a9204883e5d37bda0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:20.293816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02290c6a-671c-47d8-ac1d-18377eb5954a None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:20.294363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e8d8e-8863-4b7d-a8fa-bc08517f6ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ba1b628210a4a0a9204883e5d37bda0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:20.296356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e8d8e-8863-4b7d-a8fa-bc08517f6ac0 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:20.297858 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5279a7-b110-4310-921b-528c37fb9c0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:20.298614 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5279a7-b110-4310-921b-528c37fb9c0c service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:20.298969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5279a7-b110-4310-921b-528c37fb9c0c service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:20.299331 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5279a7-b110-4310-921b-528c37fb9c0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:20.309972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5279a7-b110-4310-921b-528c37fb9c0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:20.311515 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5279a7-b110-4310-921b-528c37fb9c0c service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:20.321899 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1084/2188] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:01:20.461563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fa8e8d8e-8863-4b7d-a8fa-bc08517f6ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ba1b628210a4a0a9204883e5d37bda0', 'request_id': 'req-fa8e8d8e-8863-4b7d-a8fa-bc08517f6ac0'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:20.468513 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fa8e8d8e-8863-4b7d-a8fa-bc08517f6ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ba1b628210a4a0a9204883e5d37bda0', 'request_id': 'req-fa8e8d8e-8863-4b7d-a8fa-bc08517f6ac0'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:20.475454 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fa8e8d8e-8863-4b7d-a8fa-bc08517f6ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ba1b628210a4a0a9204883e5d37bda0', 'request_id': 'req-fa8e8d8e-8863-4b7d-a8fa-bc08517f6ac0'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:20.676877 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fa8e8d8e-8863-4b7d-a8fa-bc08517f6ac0 admin admin] The token cache is being invalidate because project 6ba1b628210a4a0a9204883e5d37bda0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:01:20.676877 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fa8e8d8e-8863-4b7d-a8fa-bc08517f6ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:20.676877 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fa8e8d8e-8863-4b7d-a8fa-bc08517f6ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:20.676877 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1105/2189] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:01:20 2022] DELETE /identity/v3/projects/6ba1b628210a4a0a9204883e5d37bda0 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:01:20.677607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563087b5-928c-498b-a13b-a0631734d770 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:20.677607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563087b5-928c-498b-a13b-a0631734d770 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:20.677607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563087b5-928c-498b-a13b-a0631734d770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:20.700883 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-563087b5-928c-498b-a13b-a0631734d770 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:20.705208 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-563087b5-928c-498b-a13b-a0631734d770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:20.766592 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1085/2190] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:20.773154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720f03a-9a2b-4226-aeea-e4ceab38908f None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:20.773440 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720f03a-9a2b-4226-aeea-e4ceab38908f None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:20.773722 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720f03a-9a2b-4226-aeea-e4ceab38908f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:20.795006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-e720f03a-9a2b-4226-aeea-e4ceab38908f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:20.796315 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e720f03a-9a2b-4226-aeea-e4ceab38908f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:20.806156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1106/2191] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:01:20.810705 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563087b5-928c-498b-a13b-a0631734d770 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:20.821825 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563087b5-928c-498b-a13b-a0631734d770 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:20.826840 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b64d5f-eea2-4163-9010-c164b28377b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:20.827513 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b64d5f-eea2-4163-9010-c164b28377b9 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:20.827792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b64d5f-eea2-4163-9010-c164b28377b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:20.828074 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b64d5f-eea2-4163-9010-c164b28377b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:20.828904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b64d5f-eea2-4163-9010-c164b28377b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:01:20.829092 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b64d5f-eea2-4163-9010-c164b28377b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:20.830803 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b64d5f-eea2-4163-9010-c164b28377b9 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:20.847133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1086/2192] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:01:20.848345 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720f03a-9a2b-4226-aeea-e4ceab38908f None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:20.861960 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720f03a-9a2b-4226-aeea-e4ceab38908f None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:20.868269 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820987d-2e6e-4302-aef6-ceba79c8decf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:20.869019 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820987d-2e6e-4302-aef6-ceba79c8decf admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:20.869407 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820987d-2e6e-4302-aef6-ceba79c8decf admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:20.869764 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820987d-2e6e-4302-aef6-ceba79c8decf admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:20.870746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820987d-2e6e-4302-aef6-ceba79c8decf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:20.872751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820987d-2e6e-4302-aef6-ceba79c8decf admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:21.082221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1107/2193] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:01:20 2022] POST /identity/v3/projects => generated 369 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:21.086732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b64d5f-eea2-4163-9010-c164b28377b9 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:21.101272 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b64d5f-eea2-4163-9010-c164b28377b9 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:21.178045 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986327f-abab-4e91-8a0e-9991e45f5f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:21.178796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986327f-abab-4e91-8a0e-9991e45f5f4f admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:21.179240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986327f-abab-4e91-8a0e-9991e45f5f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:21.179670 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986327f-abab-4e91-8a0e-9991e45f5f4f admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:21.180488 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986327f-abab-4e91-8a0e-9991e45f5f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:21.182598 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986327f-abab-4e91-8a0e-9991e45f5f4f admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:21.311227 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1087/2194] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:01:21 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:21.315603 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820987d-2e6e-4302-aef6-ceba79c8decf admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:21.328766 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820987d-2e6e-4302-aef6-ceba79c8decf admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:21.335391 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11deb8-55e7-4da8-abd6-468445e1ec0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:21.340791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11deb8-55e7-4da8-abd6-468445e1ec0a admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:21.340791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11deb8-55e7-4da8-abd6-468445e1ec0a admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:21.340791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11deb8-55e7-4da8-abd6-468445e1ec0a admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:21.340791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11deb8-55e7-4da8-abd6-468445e1ec0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:21.340791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11deb8-55e7-4da8-abd6-468445e1ec0a admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:21.360749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1108/2195] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:21.365335 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986327f-abab-4e91-8a0e-9991e45f5f4f admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:21.376276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986327f-abab-4e91-8a0e-9991e45f5f4f admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:21.382994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e404c3-6a86-4803-b928-add9d0b063fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:21.384325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e404c3-6a86-4803-b928-add9d0b063fb admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:21.385048 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e404c3-6a86-4803-b928-add9d0b063fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:21.385048 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e404c3-6a86-4803-b928-add9d0b063fb admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:21.386038 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e404c3-6a86-4803-b928-add9d0b063fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:21.388668 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e404c3-6a86-4803-b928-add9d0b063fb admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:21.405422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1088/2196] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:21.409377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11deb8-55e7-4da8-abd6-468445e1ec0a admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:21.430636 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11deb8-55e7-4da8-abd6-468445e1ec0a admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:21.438569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1d270-47f2-4f7e-bf86-eaf54f151d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:21.441065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1d270-47f2-4f7e-bf86-eaf54f151d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:21.442762 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1d270-47f2-4f7e-bf86-eaf54f151d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:21.443457 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1d270-47f2-4f7e-bf86-eaf54f151d1f admin admin] PATH_INFO: `/v3/projects/594b1bd9211d44ffbf480bfcd4a07e9b/users/df0d28de119148f1a6b2360fcc89bfce/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:21.478742 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1d270-47f2-4f7e-bf86-eaf54f151d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=594b1bd9211d44ffbf480bfcd4a07e9b, user_id=df0d28de119148f1a6b2360fcc89bfce, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:21.478742 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1d270-47f2-4f7e-bf86-eaf54f151d1f admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:21.619106 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1109/2197] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:21 2022] PUT /identity/v3/projects/594b1bd9211d44ffbf480bfcd4a07e9b/users/df0d28de119148f1a6b2360fcc89bfce/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:01:21.698901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1356de-b4c9-49d2-9532-3da2beb3616e None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:21.698901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1356de-b4c9-49d2-9532-3da2beb3616e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:21.698901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1356de-b4c9-49d2-9532-3da2beb3616e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:21.743133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-5b1356de-b4c9-49d2-9532-3da2beb3616e None None] MFA Rules not processed for user `df0d28de119148f1a6b2360fcc89bfce`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:21.744458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-5b1356de-b4c9-49d2-9532-3da2beb3616e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:21.830828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1089/2198] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:21.849800 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1d270-47f2-4f7e-bf86-eaf54f151d1f admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:21.851885 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-fac1d270-47f2-4f7e-bf86-eaf54f151d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:21.905034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:21.963098 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1356de-b4c9-49d2-9532-3da2beb3616e None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:21.966164 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-5b1356de-b4c9-49d2-9532-3da2beb3616e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:21.967460 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1d270-47f2-4f7e-bf86-eaf54f151d1f admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:21.975765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36677022-8668-4f07-867b-ae529a9e0dcb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa31ecab10a6499f92da49bc7abb403a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:21.979349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36677022-8668-4f07-867b-ae529a9e0dcb service glance] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:21.979349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36677022-8668-4f07-867b-ae529a9e0dcb service glance] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:21.979349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36677022-8668-4f07-867b-ae529a9e0dcb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:21.995293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36677022-8668-4f07-867b-ae529a9e0dcb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:22.000901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36677022-8668-4f07-867b-ae529a9e0dcb service glance] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:22.023935 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1110/2199] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:01:22.076321 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:22.094876 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1356de-b4c9-49d2-9532-3da2beb3616e None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:22.099942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92584fe5-1d2b-4af6-9c6a-8b0770cb242a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:22.102375 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92584fe5-1d2b-4af6-9c6a-8b0770cb242a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:22.102375 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92584fe5-1d2b-4af6-9c6a-8b0770cb242a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:22.102375 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92584fe5-1d2b-4af6-9c6a-8b0770cb242a admin admin] PATH_INFO: `/v3/users/79ae49dcca054862ab5758a68e766f16` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:22.102728 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92584fe5-1d2b-4af6-9c6a-8b0770cb242a admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ae49dcca054862ab5758a68e766f16)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:22.104381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92584fe5-1d2b-4af6-9c6a-8b0770cb242a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:22.333070 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-92584fe5-1d2b-4af6-9c6a-8b0770cb242a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ae49dcca054862ab5758a68e766f16'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:22.341445 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-92584fe5-1d2b-4af6-9c6a-8b0770cb242a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ae49dcca054862ab5758a68e766f16'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:22.355046 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-92584fe5-1d2b-4af6-9c6a-8b0770cb242a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ae49dcca054862ab5758a68e766f16'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:22.355874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-92584fe5-1d2b-4af6-9c6a-8b0770cb242a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ae49dcca054862ab5758a68e766f16'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:22.356696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-92584fe5-1d2b-4af6-9c6a-8b0770cb242a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ae49dcca054862ab5758a68e766f16'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:22.463227 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1090/2200] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:01:21 2022] DELETE /identity/v3/users/79ae49dcca054862ab5758a68e766f16 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:22.467834 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07642812-70b0-4630-9925-097aaa4172d4 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:22.468648 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07642812-70b0-4630-9925-097aaa4172d4 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:22.469087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07642812-70b0-4630-9925-097aaa4172d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:22.491812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-07642812-70b0-4630-9925-097aaa4172d4 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:22.493023 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-07642812-70b0-4630-9925-097aaa4172d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:22.556691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1111/2201] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:22.567133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92584fe5-1d2b-4af6-9c6a-8b0770cb242a admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:22.568553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-92584fe5-1d2b-4af6-9c6a-8b0770cb242a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:22.625601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92584fe5-1d2b-4af6-9c6a-8b0770cb242a admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:22.629241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d825f-02e8-49c8-abf0-6bbce0965c58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:22.629863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d825f-02e8-49c8-abf0-6bbce0965c58 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:22.630139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d825f-02e8-49c8-abf0-6bbce0965c58 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:22.630435 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d825f-02e8-49c8-abf0-6bbce0965c58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:22.641333 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d825f-02e8-49c8-abf0-6bbce0965c58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:22.643077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d825f-02e8-49c8-abf0-6bbce0965c58 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:22.654941 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1091/2202] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:01:23.289448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07642812-70b0-4630-9925-097aaa4172d4 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:23.292119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-07642812-70b0-4630-9925-097aaa4172d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:23.304806 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07642812-70b0-4630-9925-097aaa4172d4 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:23.310909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c0eb0-0c2a-4913-8ddc-b0d37f428326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:23.311797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c0eb0-0c2a-4913-8ddc-b0d37f428326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:23.312281 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c0eb0-0c2a-4913-8ddc-b0d37f428326 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:23.324573 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c0eb0-0c2a-4913-8ddc-b0d37f428326 admin admin] PATH_INFO: `/v3/projects/f256c2451a194f66b89fd2816aa6accf` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:23.326799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c0eb0-0c2a-4913-8ddc-b0d37f428326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f256c2451a194f66b89fd2816aa6accf)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:23.329205 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c0eb0-0c2a-4913-8ddc-b0d37f428326 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:23.474645 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3d2c0eb0-0c2a-4913-8ddc-b0d37f428326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f256c2451a194f66b89fd2816aa6accf', 'request_id': 'req-3d2c0eb0-0c2a-4913-8ddc-b0d37f428326'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:23.482456 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3d2c0eb0-0c2a-4913-8ddc-b0d37f428326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f256c2451a194f66b89fd2816aa6accf', 'request_id': 'req-3d2c0eb0-0c2a-4913-8ddc-b0d37f428326'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:23.488840 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3d2c0eb0-0c2a-4913-8ddc-b0d37f428326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f256c2451a194f66b89fd2816aa6accf', 'request_id': 'req-3d2c0eb0-0c2a-4913-8ddc-b0d37f428326'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:23.577988 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3d2c0eb0-0c2a-4913-8ddc-b0d37f428326 admin admin] The token cache is being invalidate because project f256c2451a194f66b89fd2816aa6accf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:01:23.578193 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3d2c0eb0-0c2a-4913-8ddc-b0d37f428326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:23.578900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3d2c0eb0-0c2a-4913-8ddc-b0d37f428326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:23.580553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1112/2203] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:01:23 2022] DELETE /identity/v3/projects/f256c2451a194f66b89fd2816aa6accf => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:01:23.584903 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d825f-02e8-49c8-abf0-6bbce0965c58 service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:23.589719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:23.599077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d825f-02e8-49c8-abf0-6bbce0965c58 service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:23.664283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eb542-f92e-4ffb-a029-982fffcc303a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:23.664949 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eb542-f92e-4ffb-a029-982fffcc303a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:23.665233 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eb542-f92e-4ffb-a029-982fffcc303a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:23.667207 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eb542-f92e-4ffb-a029-982fffcc303a admin admin] PATH_INFO: `/v3/users/2acad07cddbd4c6b885468b08c6b2722` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:23.667207 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eb542-f92e-4ffb-a029-982fffcc303a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2acad07cddbd4c6b885468b08c6b2722)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:23.669478 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eb542-f92e-4ffb-a029-982fffcc303a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:23.918765 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0d8eb542-f92e-4ffb-a029-982fffcc303a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2acad07cddbd4c6b885468b08c6b2722'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:23.927285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0d8eb542-f92e-4ffb-a029-982fffcc303a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2acad07cddbd4c6b885468b08c6b2722'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:23.941814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0d8eb542-f92e-4ffb-a029-982fffcc303a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2acad07cddbd4c6b885468b08c6b2722'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:23.942277 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0d8eb542-f92e-4ffb-a029-982fffcc303a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2acad07cddbd4c6b885468b08c6b2722'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:23.943551 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0d8eb542-f92e-4ffb-a029-982fffcc303a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2acad07cddbd4c6b885468b08c6b2722'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:24.037933 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1092/2204] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:01:23 2022] DELETE /identity/v3/users/2acad07cddbd4c6b885468b08c6b2722 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:24.623994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:24.903584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c0eb0-0c2a-4913-8ddc-b0d37f428326 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:24.905531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3d2c0eb0-0c2a-4913-8ddc-b0d37f428326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:24.933040 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c0eb0-0c2a-4913-8ddc-b0d37f428326 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:25.044308 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e02cc-6588-4169-a32e-ac4c3266c6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:25.045018 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e02cc-6588-4169-a32e-ac4c3266c6f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:25.045833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e02cc-6588-4169-a32e-ac4c3266c6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:25.046472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e02cc-6588-4169-a32e-ac4c3266c6f6 admin admin] PATH_INFO: `/v3/projects/ba3433e84f2d4f479d4d5afccfe5237b` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:25.048813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e02cc-6588-4169-a32e-ac4c3266c6f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3433e84f2d4f479d4d5afccfe5237b)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:25.051319 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e02cc-6588-4169-a32e-ac4c3266c6f6 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:25.163877 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-298e02cc-6588-4169-a32e-ac4c3266c6f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3433e84f2d4f479d4d5afccfe5237b', 'request_id': 'req-298e02cc-6588-4169-a32e-ac4c3266c6f6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:25.170873 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-298e02cc-6588-4169-a32e-ac4c3266c6f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3433e84f2d4f479d4d5afccfe5237b', 'request_id': 'req-298e02cc-6588-4169-a32e-ac4c3266c6f6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:25.176893 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-298e02cc-6588-4169-a32e-ac4c3266c6f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3433e84f2d4f479d4d5afccfe5237b', 'request_id': 'req-298e02cc-6588-4169-a32e-ac4c3266c6f6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:25.269452 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-298e02cc-6588-4169-a32e-ac4c3266c6f6 admin admin] The token cache is being invalidate because project ba3433e84f2d4f479d4d5afccfe5237b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:01:25.275223 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-298e02cc-6588-4169-a32e-ac4c3266c6f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:25.275223 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-298e02cc-6588-4169-a32e-ac4c3266c6f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:01:25.275223 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1113/2205] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:01:24 2022] DELETE /identity/v3/projects/ba3433e84f2d4f479d4d5afccfe5237b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:25.278920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e4483-8579-42b2-b24c-f7f35a863fc7 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:25.279236 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e4483-8579-42b2-b24c-f7f35a863fc7 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:25.279536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e4483-8579-42b2-b24c-f7f35a863fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:25.301863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-182e4483-8579-42b2-b24c-f7f35a863fc7 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:25.303162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-182e4483-8579-42b2-b24c-f7f35a863fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:25.376275 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1093/2206] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:25.388405 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0b773-fdaa-47c2-bf8c-8d736f5ae1fe None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:25.388718 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0b773-fdaa-47c2-bf8c-8d736f5ae1fe None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:25.389003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0b773-fdaa-47c2-bf8c-8d736f5ae1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:25.410260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-1ed0b773-fdaa-47c2-bf8c-8d736f5ae1fe None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:25.411520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-1ed0b773-fdaa-47c2-bf8c-8d736f5ae1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:25.420860 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1114/2207] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:25.425281 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e4483-8579-42b2-b24c-f7f35a863fc7 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:25.435835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e4483-8579-42b2-b24c-f7f35a863fc7 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:25.441018 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3225311-2333-492b-bb83-f28f5bfbbe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:25.443099 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3225311-2333-492b-bb83-f28f5bfbbe28 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:25.443509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3225311-2333-492b-bb83-f28f5bfbbe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:25.443888 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3225311-2333-492b-bb83-f28f5bfbbe28 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:25.444771 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3225311-2333-492b-bb83-f28f5bfbbe28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:01:25.445302 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3225311-2333-492b-bb83-f28f5bfbbe28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:25.447130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3225311-2333-492b-bb83-f28f5bfbbe28 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:25.460561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1094/2208] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:01:25.465153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0b773-fdaa-47c2-bf8c-8d736f5ae1fe None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:25.474670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0b773-fdaa-47c2-bf8c-8d736f5ae1fe None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:25.479614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db2af5-88f4-481b-8916-48c7bdd67fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:25.480264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db2af5-88f4-481b-8916-48c7bdd67fdf admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:25.480549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db2af5-88f4-481b-8916-48c7bdd67fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:25.480833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db2af5-88f4-481b-8916-48c7bdd67fdf admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:25.481504 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db2af5-88f4-481b-8916-48c7bdd67fdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:25.483482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db2af5-88f4-481b-8916-48c7bdd67fdf admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:25.574642 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1115/2209] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:01:25 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:25.579489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3225311-2333-492b-bb83-f28f5bfbbe28 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:25.590246 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:25.593631 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3225311-2333-492b-bb83-f28f5bfbbe28 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:25.660614 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36c466-4e3d-42a3-9969-1c0dad791ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:25.661299 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36c466-4e3d-42a3-9969-1c0dad791ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:25.661598 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36c466-4e3d-42a3-9969-1c0dad791ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:25.661943 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36c466-4e3d-42a3-9969-1c0dad791ec8 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:25.662764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36c466-4e3d-42a3-9969-1c0dad791ec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:25.664685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36c466-4e3d-42a3-9969-1c0dad791ec8 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:26.018813 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1095/2210] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:01:25 2022] POST /identity/v3/users => generated 287 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:26.023262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db2af5-88f4-481b-8916-48c7bdd67fdf admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:26.035434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db2af5-88f4-481b-8916-48c7bdd67fdf admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:26.040507 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e2401-0111-46a9-b4dc-b3470277dced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:26.041221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e2401-0111-46a9-b4dc-b3470277dced admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:26.041575 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e2401-0111-46a9-b4dc-b3470277dced admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:26.041926 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e2401-0111-46a9-b4dc-b3470277dced admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:26.043447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e2401-0111-46a9-b4dc-b3470277dced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:26.045150 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e2401-0111-46a9-b4dc-b3470277dced admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:26.056273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1116/2211] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:26.060245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36c466-4e3d-42a3-9969-1c0dad791ec8 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:26.070320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36c466-4e3d-42a3-9969-1c0dad791ec8 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:26.075019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3508b1b-998e-432b-8c87-788a271a77da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:26.075703 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3508b1b-998e-432b-8c87-788a271a77da admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:26.075992 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3508b1b-998e-432b-8c87-788a271a77da admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:26.076319 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3508b1b-998e-432b-8c87-788a271a77da admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:26.077024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3508b1b-998e-432b-8c87-788a271a77da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:26.078818 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3508b1b-998e-432b-8c87-788a271a77da admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:26.091776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1096/2212] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:26.095772 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e2401-0111-46a9-b4dc-b3470277dced admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:26.107122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e2401-0111-46a9-b4dc-b3470277dced admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:26.112420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db554386-e0a4-46d5-8127-1034bd5797b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:26.113095 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db554386-e0a4-46d5-8127-1034bd5797b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:26.113471 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db554386-e0a4-46d5-8127-1034bd5797b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:26.113788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db554386-e0a4-46d5-8127-1034bd5797b6 admin admin] PATH_INFO: `/v3/projects/057b7de93037443fad1c26d77974b18f/users/e2b9865f039348918374fd68cae3d0a6/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:26.128630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db554386-e0a4-46d5-8127-1034bd5797b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=057b7de93037443fad1c26d77974b18f, user_id=e2b9865f039348918374fd68cae3d0a6, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:26.131339 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db554386-e0a4-46d5-8127-1034bd5797b6 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:26.252965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1117/2213] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:26 2022] PUT /identity/v3/projects/057b7de93037443fad1c26d77974b18f/users/e2b9865f039348918374fd68cae3d0a6/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:26.258166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5d263-0ee9-46bf-978d-966b901b74f1 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:26.266934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5d263-0ee9-46bf-978d-966b901b74f1 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:26.266934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5d263-0ee9-46bf-978d-966b901b74f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:26.281369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-57c5d263-0ee9-46bf-978d-966b901b74f1 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:26.282654 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-57c5d263-0ee9-46bf-978d-966b901b74f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:26.361661 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1097/2214] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:26.368551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db554386-e0a4-46d5-8127-1034bd5797b6 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:26.370306 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-db554386-e0a4-46d5-8127-1034bd5797b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:26.439446 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db554386-e0a4-46d5-8127-1034bd5797b6 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:26.443634 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a658e88-bec9-49f4-b322-fd5e971c04b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:26.444593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a658e88-bec9-49f4-b322-fd5e971c04b2 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:26.444593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a658e88-bec9-49f4-b322-fd5e971c04b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:26.444832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a658e88-bec9-49f4-b322-fd5e971c04b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:26.456027 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a658e88-bec9-49f4-b322-fd5e971c04b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:26.457508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a658e88-bec9-49f4-b322-fd5e971c04b2 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:26.468806 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1118/2215] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:01:26.949813 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:28.345471 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb6617-e071-41ae-9788-358f430ea16a None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:28.346550 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb6617-e071-41ae-9788-358f430ea16a None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:28.346833 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb6617-e071-41ae-9788-358f430ea16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:28.391712 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-a8cb6617-e071-41ae-9788-358f430ea16a None None] MFA Rules not processed for user `e2b9865f039348918374fd68cae3d0a6`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:28.395792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-a8cb6617-e071-41ae-9788-358f430ea16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:28.468221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1098/2216] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:28.472895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a658e88-bec9-49f4-b322-fd5e971c04b2 service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:28.492194 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a658e88-bec9-49f4-b322-fd5e971c04b2 service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:28.492194 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efe0b5-fe48-431d-8700-b3b40c0397b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:28.492194 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efe0b5-fe48-431d-8700-b3b40c0397b9 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:28.492194 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efe0b5-fe48-431d-8700-b3b40c0397b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:28.492747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efe0b5-fe48-431d-8700-b3b40c0397b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:28.492747 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efe0b5-fe48-431d-8700-b3b40c0397b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:28.495191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efe0b5-fe48-431d-8700-b3b40c0397b9 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:28.585219 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1119/2217] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:01:28 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:28.589939 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb6617-e071-41ae-9788-358f430ea16a None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:28.602574 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb6617-e071-41ae-9788-358f430ea16a None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:28.660066 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13088d-92e5-438c-b79e-670ca789d9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:28.660620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13088d-92e5-438c-b79e-670ca789d9bf admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:28.660901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13088d-92e5-438c-b79e-670ca789d9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:28.661176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13088d-92e5-438c-b79e-670ca789d9bf admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:28.661845 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13088d-92e5-438c-b79e-670ca789d9bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:28.663843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13088d-92e5-438c-b79e-670ca789d9bf admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:28.683712 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:28.761880 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1099/2218] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:01:28 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:01:28.767982 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efe0b5-fe48-431d-8700-b3b40c0397b9 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:28.779565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efe0b5-fe48-431d-8700-b3b40c0397b9 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:28.785213 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d17d8-836f-4966-8638-5a30853c1aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:28.785879 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d17d8-836f-4966-8638-5a30853c1aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:28.786166 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d17d8-836f-4966-8638-5a30853c1aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:28.786486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d17d8-836f-4966-8638-5a30853c1aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:28.787194 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d17d8-836f-4966-8638-5a30853c1aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:28.788881 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d17d8-836f-4966-8638-5a30853c1aa5 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:28.799830 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1120/2219] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:01:28.804057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13088d-92e5-438c-b79e-670ca789d9bf admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:28.817763 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13088d-92e5-438c-b79e-670ca789d9bf admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:28.825874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360dfae-0de6-4102-94fc-0dad847cfd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:28.825874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360dfae-0de6-4102-94fc-0dad847cfd04 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:28.825874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360dfae-0de6-4102-94fc-0dad847cfd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:28.825874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360dfae-0de6-4102-94fc-0dad847cfd04 admin admin] PATH_INFO: `/v3/projects/0640223205ba45f8834c7f6095cba855/users/1d59e4be3eb44d87be0a84a92aa69253/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:28.842607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360dfae-0de6-4102-94fc-0dad847cfd04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0640223205ba45f8834c7f6095cba855, user_id=1d59e4be3eb44d87be0a84a92aa69253, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:28.846895 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360dfae-0de6-4102-94fc-0dad847cfd04 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:28.927508 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1100/2220] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:28 2022] PUT /identity/v3/projects/0640223205ba45f8834c7f6095cba855/users/1d59e4be3eb44d87be0a84a92aa69253/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:28.931550 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d17d8-836f-4966-8638-5a30853c1aa5 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:28.943237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d17d8-836f-4966-8638-5a30853c1aa5 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:29.006802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b8803-466d-43f1-8784-1e99e4ae0953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:29.007433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b8803-466d-43f1-8784-1e99e4ae0953 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:29.007719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b8803-466d-43f1-8784-1e99e4ae0953 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:29.008005 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b8803-466d-43f1-8784-1e99e4ae0953 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:29.008711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b8803-466d-43f1-8784-1e99e4ae0953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:29.010345 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b8803-466d-43f1-8784-1e99e4ae0953 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:29.021988 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1121/2221] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:01:29.025537 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360dfae-0de6-4102-94fc-0dad847cfd04 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:29.037033 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360dfae-0de6-4102-94fc-0dad847cfd04 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:29.042317 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7598e-055c-4614-88b9-5dcf5bdc3769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:29.043125 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7598e-055c-4614-88b9-5dcf5bdc3769 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:29.043422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7598e-055c-4614-88b9-5dcf5bdc3769 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:29.043784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7598e-055c-4614-88b9-5dcf5bdc3769 admin admin] PATH_INFO: `/v3/projects/0640223205ba45f8834c7f6095cba855/users/1d59e4be3eb44d87be0a84a92aa69253/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:29.045802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7598e-055c-4614-88b9-5dcf5bdc3769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0640223205ba45f8834c7f6095cba855, user_id=1d59e4be3eb44d87be0a84a92aa69253, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:29.048820 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7598e-055c-4614-88b9-5dcf5bdc3769 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:29.062657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1101/2222] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:01:29 2022] PUT /identity/v3/projects/0640223205ba45f8834c7f6095cba855/users/1d59e4be3eb44d87be0a84a92aa69253/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:01:29.109708 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:30.552255 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94d7d0-8201-42d2-b497-0e8e996aafc5 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:30.552665 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94d7d0-8201-42d2-b497-0e8e996aafc5 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:30.552830 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94d7d0-8201-42d2-b497-0e8e996aafc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:30.590455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-bb94d7d0-8201-42d2-b497-0e8e996aafc5 None None] MFA Rules not processed for user `1d59e4be3eb44d87be0a84a92aa69253`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:30.593276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-bb94d7d0-8201-42d2-b497-0e8e996aafc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:30.722437 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1122/2223] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:30.726002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886d9f7-328d-46ab-9c5f-6fe80cc33a51 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:30.726478 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886d9f7-328d-46ab-9c5f-6fe80cc33a51 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:30.726585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886d9f7-328d-46ab-9c5f-6fe80cc33a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:30.747687 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-3886d9f7-328d-46ab-9c5f-6fe80cc33a51 None None] MFA Rules not processed for user `e2b9865f039348918374fd68cae3d0a6`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:01:30.748958 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-3886d9f7-328d-46ab-9c5f-6fe80cc33a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:30.827075 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1102/2224] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:01:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:01:30.841196 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94d7d0-8201-42d2-b497-0e8e996aafc5 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:01:30.842834 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-bb94d7d0-8201-42d2-b497-0e8e996aafc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:01:30.930341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94d7d0-8201-42d2-b497-0e8e996aafc5 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:01:30.936264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8f655-678a-4913-b421-eb14f09f7d16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:01:30.937024 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8f655-678a-4913-b421-eb14f09f7d16 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:01:30.937287 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8f655-678a-4913-b421-eb14f09f7d16 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:01:30.937569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8f655-678a-4913-b421-eb14f09f7d16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:01:30.945979 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8f655-678a-4913-b421-eb14f09f7d16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:01:30.947677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8f655-678a-4913-b421-eb14f09f7d16 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:01:30.957298 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1123/2225] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:01:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:01:31.183995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:31.367489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:33.533262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:34.961336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:36.201971 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:37.516382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:38.464540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:38.590312 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:39.950648 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:40.127434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:40.424795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:40.549934 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:40.858349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:41.350135 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:41.689429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:42.070091 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:42.361599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:42.579033 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:43.110174 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:43.767762 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:44.082326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:44.870233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:44.898458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:DELETE=10 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:46.331391 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:46.401750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:47.190049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:47.304732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:47.951052 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:48.019495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:48.972868 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:49.173265 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:49.264981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:49.295395 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:49.493391 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:49.647558 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:49.738767 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:50.173409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:50.207656 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:50.338997 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:50.596543 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:50.761685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:51.064400 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:51.196154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:51.437014 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:51.550302 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:51.578565 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:52.139167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:52.185201 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:52.270632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:52.298955 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:52.384635 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:52.470277 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:52.556072 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:52.658962 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:52.717060 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:52.779698 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:53.281651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:53.327654 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:53.624512 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:53.819597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:01.895742 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d330a-4c07-4784-a882-6ed3a382daf8 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:01.896589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d330a-4c07-4784-a882-6ed3a382daf8 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:01.896589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d330a-4c07-4784-a882-6ed3a382daf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:01.916906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-451d330a-4c07-4784-a882-6ed3a382daf8 None None] MFA Rules not processed for user `bda23788bfe8424aa5b24a6f4983d189`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:01.918133 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-451d330a-4c07-4784-a882-6ed3a382daf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:01.977322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1103/2226] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:02:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:02:03.572984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=42 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:03.931589 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8f655-678a-4913-b421-eb14f09f7d16 service nova] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:03.933279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-25b8f655-678a-4913-b421-eb14f09f7d16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:03.994676 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8f655-678a-4913-b421-eb14f09f7d16 service nova] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:03.998303 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f8071-3f2d-48cb-a412-3a0ac203ba44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:03.999524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f8071-3f2d-48cb-a412-3a0ac203ba44 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:03.999822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f8071-3f2d-48cb-a412-3a0ac203ba44 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:04.000099 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f8071-3f2d-48cb-a412-3a0ac203ba44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:04.009100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f8071-3f2d-48cb-a412-3a0ac203ba44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:04.010579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f8071-3f2d-48cb-a412-3a0ac203ba44 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:04.020797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1124/2227] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:02:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:02:04.920146 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d330a-4c07-4784-a882-6ed3a382daf8 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:04.921689 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-451d330a-4c07-4784-a882-6ed3a382daf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:04.989447 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d330a-4c07-4784-a882-6ed3a382daf8 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:04.993040 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586581d-0a2f-4c08-a918-e25339889337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:04.993696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586581d-0a2f-4c08-a918-e25339889337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:04.993979 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586581d-0a2f-4c08-a918-e25339889337 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:04.994285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586581d-0a2f-4c08-a918-e25339889337 admin admin] PATH_INFO: `/v3/users/df0d28de119148f1a6b2360fcc89bfce` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:04.995571 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586581d-0a2f-4c08-a918-e25339889337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df0d28de119148f1a6b2360fcc89bfce)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:04.997512 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586581d-0a2f-4c08-a918-e25339889337 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:05.218332 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-e586581d-0a2f-4c08-a918-e25339889337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df0d28de119148f1a6b2360fcc89bfce'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:05.218593 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-e586581d-0a2f-4c08-a918-e25339889337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df0d28de119148f1a6b2360fcc89bfce'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:05.237100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-e586581d-0a2f-4c08-a918-e25339889337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df0d28de119148f1a6b2360fcc89bfce'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:05.237840 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-e586581d-0a2f-4c08-a918-e25339889337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df0d28de119148f1a6b2360fcc89bfce'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:05.238496 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-e586581d-0a2f-4c08-a918-e25339889337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df0d28de119148f1a6b2360fcc89bfce'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:05.240234 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:05.362498 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1104/2228] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:02:04 2022] DELETE /identity/v3/users/df0d28de119148f1a6b2360fcc89bfce => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:02:05.367216 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606354f7-93ce-4a57-85b9-f44a2f01a09d None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:05.367681 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606354f7-93ce-4a57-85b9-f44a2f01a09d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:05.367821 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606354f7-93ce-4a57-85b9-f44a2f01a09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:05.388696 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-606354f7-93ce-4a57-85b9-f44a2f01a09d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:05.390562 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-606354f7-93ce-4a57-85b9-f44a2f01a09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:05.456743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1125/2229] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:02:05.467422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586581d-0a2f-4c08-a918-e25339889337 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:05.469037 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e586581d-0a2f-4c08-a918-e25339889337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:05.528920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586581d-0a2f-4c08-a918-e25339889337 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:05.532748 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf7a52-9d9b-4a5a-98cc-2c48e4a6f5c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:05.533379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf7a52-9d9b-4a5a-98cc-2c48e4a6f5c4 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:05.533663 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf7a52-9d9b-4a5a-98cc-2c48e4a6f5c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:05.533937 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf7a52-9d9b-4a5a-98cc-2c48e4a6f5c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:05.543258 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf7a52-9d9b-4a5a-98cc-2c48e4a6f5c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:05.544694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf7a52-9d9b-4a5a-98cc-2c48e4a6f5c4 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:05.556665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1105/2230] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:02:06.066616 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606354f7-93ce-4a57-85b9-f44a2f01a09d None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:06.068054 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-606354f7-93ce-4a57-85b9-f44a2f01a09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:06.081699 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606354f7-93ce-4a57-85b9-f44a2f01a09d None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:06.087212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3531d-a7ab-4926-b845-e09e51724dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:06.088053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3531d-a7ab-4926-b845-e09e51724dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:06.088497 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3531d-a7ab-4926-b845-e09e51724dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:06.088986 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3531d-a7ab-4926-b845-e09e51724dbb admin admin] PATH_INFO: `/v3/projects/594b1bd9211d44ffbf480bfcd4a07e9b` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:06.090731 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3531d-a7ab-4926-b845-e09e51724dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=594b1bd9211d44ffbf480bfcd4a07e9b)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:06.094700 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3531d-a7ab-4926-b845-e09e51724dbb admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:06.290622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-1dc3531d-a7ab-4926-b845-e09e51724dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594b1bd9211d44ffbf480bfcd4a07e9b', 'request_id': 'req-1dc3531d-a7ab-4926-b845-e09e51724dbb'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:06.297994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-1dc3531d-a7ab-4926-b845-e09e51724dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594b1bd9211d44ffbf480bfcd4a07e9b', 'request_id': 'req-1dc3531d-a7ab-4926-b845-e09e51724dbb'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:06.304312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-1dc3531d-a7ab-4926-b845-e09e51724dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594b1bd9211d44ffbf480bfcd4a07e9b', 'request_id': 'req-1dc3531d-a7ab-4926-b845-e09e51724dbb'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:06.407817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-1dc3531d-a7ab-4926-b845-e09e51724dbb admin admin] The token cache is being invalidate because project 594b1bd9211d44ffbf480bfcd4a07e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:02:06.408474 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-1dc3531d-a7ab-4926-b845-e09e51724dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:06.408886 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-1dc3531d-a7ab-4926-b845-e09e51724dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:06.410463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1126/2231] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:02:06 2022] DELETE /identity/v3/projects/594b1bd9211d44ffbf480bfcd4a07e9b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:02:06.415707 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e62d25-c0dd-4778-9b8e-3c8925244491 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:06.416120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e62d25-c0dd-4778-9b8e-3c8925244491 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:06.416263 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e62d25-c0dd-4778-9b8e-3c8925244491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:06.436555 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-49e62d25-c0dd-4778-9b8e-3c8925244491 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:06.437751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-49e62d25-c0dd-4778-9b8e-3c8925244491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:06.498612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1106/2232] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:02:06.506628 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e9b9f-0440-48e2-8f8e-d8984f4e78b4 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:06.506923 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e9b9f-0440-48e2-8f8e-d8984f4e78b4 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:06.507384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e9b9f-0440-48e2-8f8e-d8984f4e78b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:06.529553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-370e9b9f-0440-48e2-8f8e-d8984f4e78b4 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:06.531366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-370e9b9f-0440-48e2-8f8e-d8984f4e78b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:06.539253 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1127/2233] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:02:06.543817 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e62d25-c0dd-4778-9b8e-3c8925244491 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:06.553759 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e62d25-c0dd-4778-9b8e-3c8925244491 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:06.558596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf612b-8dd5-4658-bb56-4e067440deb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:06.559209 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf612b-8dd5-4658-bb56-4e067440deb3 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:06.559494 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf612b-8dd5-4658-bb56-4e067440deb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:06.559776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf612b-8dd5-4658-bb56-4e067440deb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:06.560473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf612b-8dd5-4658-bb56-4e067440deb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:02:06.560773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf612b-8dd5-4658-bb56-4e067440deb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:06.562416 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf612b-8dd5-4658-bb56-4e067440deb3 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:06.574225 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1107/2234] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:02:06.579153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e9b9f-0440-48e2-8f8e-d8984f4e78b4 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:06.588591 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e9b9f-0440-48e2-8f8e-d8984f4e78b4 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:06.594462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b40cb8-f9f8-4a1b-ab2d-41072a9219cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:06.595071 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b40cb8-f9f8-4a1b-ab2d-41072a9219cc admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:06.595356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b40cb8-f9f8-4a1b-ab2d-41072a9219cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:06.595632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b40cb8-f9f8-4a1b-ab2d-41072a9219cc admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:06.596306 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b40cb8-f9f8-4a1b-ab2d-41072a9219cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:06.598209 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b40cb8-f9f8-4a1b-ab2d-41072a9219cc admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:06.693809 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:06.701180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1128/2235] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:02:06 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:02:06.705763 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf612b-8dd5-4658-bb56-4e067440deb3 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:06.715848 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf612b-8dd5-4658-bb56-4e067440deb3 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:06.772170 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9227d6c-e522-4cd1-a298-1066760a45ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:06.772776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9227d6c-e522-4cd1-a298-1066760a45ee admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:06.773058 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9227d6c-e522-4cd1-a298-1066760a45ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:06.773333 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9227d6c-e522-4cd1-a298-1066760a45ee admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:06.773994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9227d6c-e522-4cd1-a298-1066760a45ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:06.776084 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9227d6c-e522-4cd1-a298-1066760a45ee admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:06.888796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1108/2236] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:02:06 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:02:06.893905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b40cb8-f9f8-4a1b-ab2d-41072a9219cc admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:06.908682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b40cb8-f9f8-4a1b-ab2d-41072a9219cc admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:06.913461 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95ce4c-e585-4d06-9e39-050cdbc6e328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:06.914154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95ce4c-e585-4d06-9e39-050cdbc6e328 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:06.914473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95ce4c-e585-4d06-9e39-050cdbc6e328 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:06.914753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95ce4c-e585-4d06-9e39-050cdbc6e328 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:06.915479 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95ce4c-e585-4d06-9e39-050cdbc6e328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:06.917073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95ce4c-e585-4d06-9e39-050cdbc6e328 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:06.929903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1129/2237] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:02:06.933334 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9227d6c-e522-4cd1-a298-1066760a45ee admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:06.944454 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9227d6c-e522-4cd1-a298-1066760a45ee admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:06.950641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42854323-d817-4125-afde-e5cb12ef1708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:06.950641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42854323-d817-4125-afde-e5cb12ef1708 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:06.950641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42854323-d817-4125-afde-e5cb12ef1708 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:06.950946 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42854323-d817-4125-afde-e5cb12ef1708 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:06.951608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42854323-d817-4125-afde-e5cb12ef1708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:06.954106 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42854323-d817-4125-afde-e5cb12ef1708 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:06.961385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:06.970409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1109/2238] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:02:06.971676 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95ce4c-e585-4d06-9e39-050cdbc6e328 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:06.986370 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95ce4c-e585-4d06-9e39-050cdbc6e328 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:06.991191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4287a-322b-424d-8fcf-49b5d557c4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:06.991874 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4287a-322b-424d-8fcf-49b5d557c4f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:06.992166 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4287a-322b-424d-8fcf-49b5d557c4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:06.992453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4287a-322b-424d-8fcf-49b5d557c4f2 admin admin] PATH_INFO: `/v3/projects/b95daf0e3a2844aeb3d9e7385fae355d/users/1e229e7f9e5149ac84e1ac18aa947c92/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:07.009733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4287a-322b-424d-8fcf-49b5d557c4f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95daf0e3a2844aeb3d9e7385fae355d, user_id=1e229e7f9e5149ac84e1ac18aa947c92, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:07.012511 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4287a-322b-424d-8fcf-49b5d557c4f2 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:07.098967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1130/2239] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:02:06 2022] PUT /identity/v3/projects/b95daf0e3a2844aeb3d9e7385fae355d/users/1e229e7f9e5149ac84e1ac18aa947c92/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:02:07.110329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8407b6-2402-4cea-a811-b4e388928ca8 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:07.110648 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8407b6-2402-4cea-a811-b4e388928ca8 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:07.110927 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8407b6-2402-4cea-a811-b4e388928ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:07.140112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-5b8407b6-2402-4cea-a811-b4e388928ca8 None None] MFA Rules not processed for user `1e229e7f9e5149ac84e1ac18aa947c92`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:07.141398 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-5b8407b6-2402-4cea-a811-b4e388928ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:07.219363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1110/2240] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:02:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:02:07.231006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4287a-322b-424d-8fcf-49b5d557c4f2 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:07.233639 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-8fa4287a-322b-424d-8fcf-49b5d557c4f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:07.313569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4287a-322b-424d-8fcf-49b5d557c4f2 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:07.317451 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58feb109-2f68-4072-acf3-ef3ba796b461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:07.317451 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58feb109-2f68-4072-acf3-ef3ba796b461 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:07.317978 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58feb109-2f68-4072-acf3-ef3ba796b461 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:07.318329 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58feb109-2f68-4072-acf3-ef3ba796b461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:07.329038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58feb109-2f68-4072-acf3-ef3ba796b461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:07.331379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58feb109-2f68-4072-acf3-ef3ba796b461 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:07.341805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1131/2241] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:02:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:02:12.813117 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8407b6-2402-4cea-a811-b4e388928ca8 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:12.882696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8407b6-2402-4cea-a811-b4e388928ca8 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:12.887468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef6514-d914-44bc-bc1d-b0900d534e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:12.888136 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef6514-d914-44bc-bc1d-b0900d534e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:12.891832 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef6514-d914-44bc-bc1d-b0900d534e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:12.891832 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef6514-d914-44bc-bc1d-b0900d534e4a admin admin] PATH_INFO: `/v3/users/1e229e7f9e5149ac84e1ac18aa947c92` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:12.891832 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef6514-d914-44bc-bc1d-b0900d534e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e229e7f9e5149ac84e1ac18aa947c92)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:12.892661 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef6514-d914-44bc-bc1d-b0900d534e4a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:13.118275 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-41ef6514-d914-44bc-bc1d-b0900d534e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e229e7f9e5149ac84e1ac18aa947c92'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:13.125020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-41ef6514-d914-44bc-bc1d-b0900d534e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e229e7f9e5149ac84e1ac18aa947c92'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:13.137257 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-41ef6514-d914-44bc-bc1d-b0900d534e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e229e7f9e5149ac84e1ac18aa947c92'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:13.137938 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-41ef6514-d914-44bc-bc1d-b0900d534e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e229e7f9e5149ac84e1ac18aa947c92'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:13.139670 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-41ef6514-d914-44bc-bc1d-b0900d534e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e229e7f9e5149ac84e1ac18aa947c92'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:13.241276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1111/2242] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:02:12 2022] DELETE /identity/v3/users/1e229e7f9e5149ac84e1ac18aa947c92 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:02:13.245865 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce0976-c469-4499-88c6-1633f9464b2f None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:13.246356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce0976-c469-4499-88c6-1633f9464b2f None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:13.246512 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce0976-c469-4499-88c6-1633f9464b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:13.266143 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-4cce0976-c469-4499-88c6-1633f9464b2f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:13.267413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4cce0976-c469-4499-88c6-1633f9464b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:13.328266 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1132/2243] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:02:13.345203 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef6514-d914-44bc-bc1d-b0900d534e4a admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:13.346750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-41ef6514-d914-44bc-bc1d-b0900d534e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:13.359027 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:13.407461 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef6514-d914-44bc-bc1d-b0900d534e4a admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:13.410957 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95200ad-3b19-4c3a-9242-33c1fdcf8e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:13.411588 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95200ad-3b19-4c3a-9242-33c1fdcf8e42 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:13.411877 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95200ad-3b19-4c3a-9242-33c1fdcf8e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:13.412152 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95200ad-3b19-4c3a-9242-33c1fdcf8e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:13.421444 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95200ad-3b19-4c3a-9242-33c1fdcf8e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:13.423470 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95200ad-3b19-4c3a-9242-33c1fdcf8e42 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:13.434206 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1112/2244] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:02:13.901007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce0976-c469-4499-88c6-1633f9464b2f None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:13.902478 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4cce0976-c469-4499-88c6-1633f9464b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:13.918089 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce0976-c469-4499-88c6-1633f9464b2f None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:13.924637 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214c16f-eb3c-47c1-b0f8-374a8f1594db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:13.925218 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214c16f-eb3c-47c1-b0f8-374a8f1594db admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:13.925508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214c16f-eb3c-47c1-b0f8-374a8f1594db admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:13.925894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214c16f-eb3c-47c1-b0f8-374a8f1594db admin admin] PATH_INFO: `/v3/projects/b95daf0e3a2844aeb3d9e7385fae355d` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:13.927111 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214c16f-eb3c-47c1-b0f8-374a8f1594db admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95daf0e3a2844aeb3d9e7385fae355d)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:13.928962 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214c16f-eb3c-47c1-b0f8-374a8f1594db admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:14.064102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d214c16f-eb3c-47c1-b0f8-374a8f1594db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95daf0e3a2844aeb3d9e7385fae355d', 'request_id': 'req-d214c16f-eb3c-47c1-b0f8-374a8f1594db'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:14.070375 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d214c16f-eb3c-47c1-b0f8-374a8f1594db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95daf0e3a2844aeb3d9e7385fae355d', 'request_id': 'req-d214c16f-eb3c-47c1-b0f8-374a8f1594db'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:14.075137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:14.076395 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d214c16f-eb3c-47c1-b0f8-374a8f1594db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95daf0e3a2844aeb3d9e7385fae355d', 'request_id': 'req-d214c16f-eb3c-47c1-b0f8-374a8f1594db'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:14.189932 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d214c16f-eb3c-47c1-b0f8-374a8f1594db admin admin] The token cache is being invalidate because project b95daf0e3a2844aeb3d9e7385fae355d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:02:14.190225 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d214c16f-eb3c-47c1-b0f8-374a8f1594db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:14.190868 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d214c16f-eb3c-47c1-b0f8-374a8f1594db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:14.192405 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1133/2245] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:02:13 2022] DELETE /identity/v3/projects/b95daf0e3a2844aeb3d9e7385fae355d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:02:22.445054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9b2bf-f43c-44e7-99a1-8f19423ca758 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:22.445645 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9b2bf-f43c-44e7-99a1-8f19423ca758 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:22.445645 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9b2bf-f43c-44e7-99a1-8f19423ca758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:22.468254 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-93b9b2bf-f43c-44e7-99a1-8f19423ca758 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:22.468254 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-93b9b2bf-f43c-44e7-99a1-8f19423ca758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:22.530252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1113/2246] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 15:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:02:22.572341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214c16f-eb3c-47c1-b0f8-374a8f1594db admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:22.573927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d214c16f-eb3c-47c1-b0f8-374a8f1594db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:22.653445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214c16f-eb3c-47c1-b0f8-374a8f1594db admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:22.659014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e81069-c3e1-47fa-b23c-1f7fa4160823 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:22.659640 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e81069-c3e1-47fa-b23c-1f7fa4160823 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:22.659928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e81069-c3e1-47fa-b23c-1f7fa4160823 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:22.660215 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e81069-c3e1-47fa-b23c-1f7fa4160823 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:22.670026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e81069-c3e1-47fa-b23c-1f7fa4160823 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:22.672337 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e81069-c3e1-47fa-b23c-1f7fa4160823 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:22.683508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1134/2247] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:02:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:02:28.273754 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9b2bf-f43c-44e7-99a1-8f19423ca758 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:28.275269 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-93b9b2bf-f43c-44e7-99a1-8f19423ca758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:28.287231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9b2bf-f43c-44e7-99a1-8f19423ca758 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:28.291791 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b625f7-72f1-4983-a451-2260ebd452dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:28.292423 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b625f7-72f1-4983-a451-2260ebd452dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:28.292711 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b625f7-72f1-4983-a451-2260ebd452dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:28.292991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b625f7-72f1-4983-a451-2260ebd452dd admin admin] PATH_INFO: `/v3/users/7e129bf7fcbe41b1977cebbc6e7cc7e7` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:28.294147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b625f7-72f1-4983-a451-2260ebd452dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e129bf7fcbe41b1977cebbc6e7cc7e7)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:28.296124 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b625f7-72f1-4983-a451-2260ebd452dd admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:28.490655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-38b625f7-72f1-4983-a451-2260ebd452dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e129bf7fcbe41b1977cebbc6e7cc7e7'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:28.497528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-38b625f7-72f1-4983-a451-2260ebd452dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e129bf7fcbe41b1977cebbc6e7cc7e7'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:28.513786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-38b625f7-72f1-4983-a451-2260ebd452dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e129bf7fcbe41b1977cebbc6e7cc7e7'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:28.514544 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-38b625f7-72f1-4983-a451-2260ebd452dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e129bf7fcbe41b1977cebbc6e7cc7e7'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:28.515167 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-38b625f7-72f1-4983-a451-2260ebd452dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e129bf7fcbe41b1977cebbc6e7cc7e7'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:28.577997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1114/2248] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:02:28 2022] DELETE /identity/v3/users/7e129bf7fcbe41b1977cebbc6e7cc7e7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:02:28.582993 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486acbc-86d3-4323-acec-86ea53ee59a8 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:28.583457 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486acbc-86d3-4323-acec-86ea53ee59a8 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:28.583594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486acbc-86d3-4323-acec-86ea53ee59a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:28.603016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-7486acbc-86d3-4323-acec-86ea53ee59a8 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:28.604206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-7486acbc-86d3-4323-acec-86ea53ee59a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:28.642736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfb7f1-11c1-425e-aa46-eda2cbfca9cb None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:28.643027 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfb7f1-11c1-425e-aa46-eda2cbfca9cb None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:28.643302 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfb7f1-11c1-425e-aa46-eda2cbfca9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:28.665174 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1135/2249] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:02:28.665468 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-74dfb7f1-11c1-425e-aa46-eda2cbfca9cb None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:28.666351 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-74dfb7f1-11c1-425e-aa46-eda2cbfca9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:28.679188 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486acbc-86d3-4323-acec-86ea53ee59a8 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:28.679188 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-7486acbc-86d3-4323-acec-86ea53ee59a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:28.684252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1115/2250] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 15:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:02:28.713337 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfb7f1-11c1-425e-aa46-eda2cbfca9cb None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:28.714872 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-74dfb7f1-11c1-425e-aa46-eda2cbfca9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:28.736263 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:28.742429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486acbc-86d3-4323-acec-86ea53ee59a8 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:28.746032 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5664b-abb8-4a2a-91e8-e3866c65183d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:28.746674 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5664b-abb8-4a2a-91e8-e3866c65183d service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:28.747060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5664b-abb8-4a2a-91e8-e3866c65183d service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:28.747229 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5664b-abb8-4a2a-91e8-e3866c65183d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:28.756607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5664b-abb8-4a2a-91e8-e3866c65183d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:28.760832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5664b-abb8-4a2a-91e8-e3866c65183d service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:28.767867 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1136/2251] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:02:28.793973 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfb7f1-11c1-425e-aa46-eda2cbfca9cb None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:28.801700 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4e554-0500-48aa-afe9-41b28b0d8467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:28.802339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4e554-0500-48aa-afe9-41b28b0d8467 service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:28.802655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4e554-0500-48aa-afe9-41b28b0d8467 service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:28.803004 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4e554-0500-48aa-afe9-41b28b0d8467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:28.811924 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4e554-0500-48aa-afe9-41b28b0d8467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:28.813509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4e554-0500-48aa-afe9-41b28b0d8467 service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:28.824272 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1116/2252] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:02:29.191889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5664b-abb8-4a2a-91e8-e3866c65183d service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:29.193441 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-60d5664b-abb8-4a2a-91e8-e3866c65183d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:29.208223 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5664b-abb8-4a2a-91e8-e3866c65183d service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:29.212450 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0068c7-c08c-4e0d-aff7-8b107ba72a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:29.213094 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0068c7-c08c-4e0d-aff7-8b107ba72a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:29.213503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0068c7-c08c-4e0d-aff7-8b107ba72a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:29.213792 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0068c7-c08c-4e0d-aff7-8b107ba72a55 admin admin] PATH_INFO: `/v3/projects/3c55c4dc0c454a1b8a882d546280b1f7` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:29.214988 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0068c7-c08c-4e0d-aff7-8b107ba72a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c55c4dc0c454a1b8a882d546280b1f7)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:29.219495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0068c7-c08c-4e0d-aff7-8b107ba72a55 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:29.231555 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:29.363492 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-4c0068c7-c08c-4e0d-aff7-8b107ba72a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c55c4dc0c454a1b8a882d546280b1f7', 'request_id': 'req-4c0068c7-c08c-4e0d-aff7-8b107ba72a55'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:29.369706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-4c0068c7-c08c-4e0d-aff7-8b107ba72a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c55c4dc0c454a1b8a882d546280b1f7', 'request_id': 'req-4c0068c7-c08c-4e0d-aff7-8b107ba72a55'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:29.375620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-4c0068c7-c08c-4e0d-aff7-8b107ba72a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c55c4dc0c454a1b8a882d546280b1f7', 'request_id': 'req-4c0068c7-c08c-4e0d-aff7-8b107ba72a55'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:29.499315 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-4c0068c7-c08c-4e0d-aff7-8b107ba72a55 admin admin] The token cache is being invalidate because project 3c55c4dc0c454a1b8a882d546280b1f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:02:29.499631 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-4c0068c7-c08c-4e0d-aff7-8b107ba72a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:29.500243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-4c0068c7-c08c-4e0d-aff7-8b107ba72a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:29.501925 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1137/2253] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:02:29 2022] DELETE /identity/v3/projects/3c55c4dc0c454a1b8a882d546280b1f7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:02:29.507255 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f7811-0673-427d-b4af-9a29c2883bb4 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:29.507722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f7811-0673-427d-b4af-9a29c2883bb4 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:29.507817 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f7811-0673-427d-b4af-9a29c2883bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:29.528038 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-de8f7811-0673-427d-b4af-9a29c2883bb4 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:29.530591 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-de8f7811-0673-427d-b4af-9a29c2883bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:29.600742 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1117/2254] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:02:29.608854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f1d6f-9a09-43ae-802d-78a2a4b8e670 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:29.609672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f1d6f-9a09-43ae-802d-78a2a4b8e670 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:29.609672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f1d6f-9a09-43ae-802d-78a2a4b8e670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:29.631988 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-925f1d6f-9a09-43ae-802d-78a2a4b8e670 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:29.633196 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-925f1d6f-9a09-43ae-802d-78a2a4b8e670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:29.641160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1138/2255] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:02:29.645508 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f7811-0673-427d-b4af-9a29c2883bb4 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:29.655418 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f7811-0673-427d-b4af-9a29c2883bb4 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:29.660400 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d350d50-1245-4b31-ae97-1d1254e41df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:29.661008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d350d50-1245-4b31-ae97-1d1254e41df0 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:29.661290 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d350d50-1245-4b31-ae97-1d1254e41df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:29.661566 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d350d50-1245-4b31-ae97-1d1254e41df0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:29.662256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d350d50-1245-4b31-ae97-1d1254e41df0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:02:29.662597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d350d50-1245-4b31-ae97-1d1254e41df0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:29.664181 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d350d50-1245-4b31-ae97-1d1254e41df0 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:29.676663 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1118/2256] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:02:29.680907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f1d6f-9a09-43ae-802d-78a2a4b8e670 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:29.691539 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f1d6f-9a09-43ae-802d-78a2a4b8e670 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:29.696683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87005190-db84-466f-b9d0-3b68d946e958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:29.697307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87005190-db84-466f-b9d0-3b68d946e958 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:29.697597 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87005190-db84-466f-b9d0-3b68d946e958 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:29.697930 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87005190-db84-466f-b9d0-3b68d946e958 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:29.698575 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87005190-db84-466f-b9d0-3b68d946e958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:29.700487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87005190-db84-466f-b9d0-3b68d946e958 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:29.821915 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1139/2257] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:02:29 2022] POST /identity/v3/projects => generated 391 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:02:29.826165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d350d50-1245-4b31-ae97-1d1254e41df0 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:29.837433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d350d50-1245-4b31-ae97-1d1254e41df0 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:29.912511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d486f-ba56-4aff-b946-d43e3d904b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:29.912511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d486f-ba56-4aff-b946-d43e3d904b94 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:29.912511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d486f-ba56-4aff-b946-d43e3d904b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:29.912511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d486f-ba56-4aff-b946-d43e3d904b94 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:29.912899 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d486f-ba56-4aff-b946-d43e3d904b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:29.912899 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d486f-ba56-4aff-b946-d43e3d904b94 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:29.980374 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1119/2258] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:02:29 2022] POST /identity/v3/users => generated 296 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:02:29.984655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87005190-db84-466f-b9d0-3b68d946e958 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:29.995888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87005190-db84-466f-b9d0-3b68d946e958 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:30.003472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553eec59-2ece-4507-b578-ab830eb9fad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:30.004163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553eec59-2ece-4507-b578-ab830eb9fad5 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:30.004446 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553eec59-2ece-4507-b578-ab830eb9fad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:30.004729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553eec59-2ece-4507-b578-ab830eb9fad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:30.006102 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553eec59-2ece-4507-b578-ab830eb9fad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:30.007073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553eec59-2ece-4507-b578-ab830eb9fad5 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:30.017630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1140/2259] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:02:30.021800 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d486f-ba56-4aff-b946-d43e3d904b94 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:30.031944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d486f-ba56-4aff-b946-d43e3d904b94 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:30.037117 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8465f8c-ff87-444e-a02a-b29d4a7fe11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:30.037749 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8465f8c-ff87-444e-a02a-b29d4a7fe11c admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:30.038023 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8465f8c-ff87-444e-a02a-b29d4a7fe11c admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:30.038296 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8465f8c-ff87-444e-a02a-b29d4a7fe11c admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:30.039014 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8465f8c-ff87-444e-a02a-b29d4a7fe11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:30.040588 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8465f8c-ff87-444e-a02a-b29d4a7fe11c admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:30.051816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1120/2260] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:02:30.055998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553eec59-2ece-4507-b578-ab830eb9fad5 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:30.065888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553eec59-2ece-4507-b578-ab830eb9fad5 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:30.070534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8d2fe-e45d-442d-a320-15cc76f69cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:30.071197 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8d2fe-e45d-442d-a320-15cc76f69cae admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:30.071500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8d2fe-e45d-442d-a320-15cc76f69cae admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:30.071767 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8d2fe-e45d-442d-a320-15cc76f69cae admin admin] PATH_INFO: `/v3/projects/12b9d2e3d8724736ad333560c23a41a8/users/46d48c986c50431199187381b91e218b/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:30.090296 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8d2fe-e45d-442d-a320-15cc76f69cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b9d2e3d8724736ad333560c23a41a8, user_id=46d48c986c50431199187381b91e218b, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:30.090296 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8d2fe-e45d-442d-a320-15cc76f69cae admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:30.185221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1141/2261] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:02:30 2022] PUT /identity/v3/projects/12b9d2e3d8724736ad333560c23a41a8/users/46d48c986c50431199187381b91e218b/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:02:30.204324 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411abd50-fe61-4640-9551-aa17187a68da None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:30.204608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411abd50-fe61-4640-9551-aa17187a68da None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:30.204924 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411abd50-fe61-4640-9551-aa17187a68da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:30.225010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:30.233486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-411abd50-fe61-4640-9551-aa17187a68da None None] MFA Rules not processed for user `46d48c986c50431199187381b91e218b`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:30.234765 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-411abd50-fe61-4640-9551-aa17187a68da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:30.299946 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1121/2262] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:02:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:02:30.311263 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8d2fe-e45d-442d-a320-15cc76f69cae admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:30.312957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d6f8d2fe-e45d-442d-a320-15cc76f69cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:30.369941 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8d2fe-e45d-442d-a320-15cc76f69cae admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:30.373609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a7b69-6c97-412f-ae92-11a886ded1c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:30.374381 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a7b69-6c97-412f-ae92-11a886ded1c8 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:30.374549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a7b69-6c97-412f-ae92-11a886ded1c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:30.374843 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a7b69-6c97-412f-ae92-11a886ded1c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:30.384248 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a7b69-6c97-412f-ae92-11a886ded1c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:30.385701 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a7b69-6c97-412f-ae92-11a886ded1c8 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:30.396129 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1142/2263] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:02:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:02:34.168137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cc798-08ad-418f-98bb-7c15514a0bc4 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:34.168674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cc798-08ad-418f-98bb-7c15514a0bc4 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:34.168790 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cc798-08ad-418f-98bb-7c15514a0bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:34.194118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-cd4cc798-08ad-418f-98bb-7c15514a0bc4 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:34.194118 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-cd4cc798-08ad-418f-98bb-7c15514a0bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:34.248363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1122/2264] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 15:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:02:34.303266 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a7b69-6c97-412f-ae92-11a886ded1c8 service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:34.304657 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-831a7b69-6c97-412f-ae92-11a886ded1c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:34.361273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:34.391030 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a7b69-6c97-412f-ae92-11a886ded1c8 service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:34.397412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a723e2-566b-4715-a233-8ab605c2551d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:34.398038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a723e2-566b-4715-a233-8ab605c2551d service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:34.404365 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a723e2-566b-4715-a233-8ab605c2551d service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:34.404365 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a723e2-566b-4715-a233-8ab605c2551d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:34.408617 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a723e2-566b-4715-a233-8ab605c2551d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:34.411151 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a723e2-566b-4715-a233-8ab605c2551d service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:34.422604 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1143/2265] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:02:40.109909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517aaed-3dbc-4009-9658-4592c5be76dd None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:40.111016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517aaed-3dbc-4009-9658-4592c5be76dd None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:40.111206 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517aaed-3dbc-4009-9658-4592c5be76dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:40.134214 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-e517aaed-3dbc-4009-9658-4592c5be76dd None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:40.135459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e517aaed-3dbc-4009-9658-4592c5be76dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:40.143516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1123/2266] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 15:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:02:40.170037 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a723e2-566b-4715-a233-8ab605c2551d service nova] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:40.184998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a723e2-566b-4715-a233-8ab605c2551d service nova] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:40.187622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df539b9a-6e4d-4416-9c96-7d48ad792123 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:40.188247 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df539b9a-6e4d-4416-9c96-7d48ad792123 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:40.188627 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df539b9a-6e4d-4416-9c96-7d48ad792123 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:40.188921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df539b9a-6e4d-4416-9c96-7d48ad792123 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:40.198746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df539b9a-6e4d-4416-9c96-7d48ad792123 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:40.200577 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df539b9a-6e4d-4416-9c96-7d48ad792123 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:40.220362 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1144/2267] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:02:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:02:41.218263 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdd30a-223f-4d2f-bc61-ae8041556464 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:41.218743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdd30a-223f-4d2f-bc61-ae8041556464 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:41.218855 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdd30a-223f-4d2f-bc61-ae8041556464 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:41.220357 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1124/2268] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jul 26 15:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:02:41.250624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3aeb71-60bd-4d17-9165-a431779c7c18 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:41.251534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3aeb71-60bd-4d17-9165-a431779c7c18 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:41.251534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3aeb71-60bd-4d17-9165-a431779c7c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:41.272072 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-5f3aeb71-60bd-4d17-9165-a431779c7c18 None None] MFA Rules not processed for user `0fab620bc5d044479746d8ea17615a74`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:41.273531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5f3aeb71-60bd-4d17-9165-a431779c7c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:41.335614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1145/2269] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jul 26 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:02:41.346678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdd30a-223f-4d2f-bc61-ae8041556464 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:41.348581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-1bbdd30a-223f-4d2f-bc61-ae8041556464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:41.363405 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3aeb71-60bd-4d17-9165-a431779c7c18 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:41.363405 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5f3aeb71-60bd-4d17-9165-a431779c7c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:41.366858 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdd30a-223f-4d2f-bc61-ae8041556464 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:41.372323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f67df0-17b7-4f0d-b19b-d869edf5a998 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fab620bc5d044479746d8ea17615a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:41.372949 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f67df0-17b7-4f0d-b19b-d869edf5a998 service placement] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:41.373436 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f67df0-17b7-4f0d-b19b-d869edf5a998 service placement] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:41.373711 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f67df0-17b7-4f0d-b19b-d869edf5a998 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:41.380092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3aeb71-60bd-4d17-9165-a431779c7c18 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:41.383879 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f67df0-17b7-4f0d-b19b-d869edf5a998 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:41.384863 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33cd49-00f1-4895-bb23-63e83238daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:41.385460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f67df0-17b7-4f0d-b19b-d869edf5a998 service placement] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:41.385565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33cd49-00f1-4895-bb23-63e83238daaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:41.385805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33cd49-00f1-4895-bb23-63e83238daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:41.386064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33cd49-00f1-4895-bb23-63e83238daaa admin admin] PATH_INFO: `/v3/users/e2b9865f039348918374fd68cae3d0a6` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:41.387336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33cd49-00f1-4895-bb23-63e83238daaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b9865f039348918374fd68cae3d0a6)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:41.389422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33cd49-00f1-4895-bb23-63e83238daaa admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:41.396289 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1125/2270] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:02:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:02:41.645128 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5a33cd49-00f1-4895-bb23-63e83238daaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b9865f039348918374fd68cae3d0a6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:41.645732 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5a33cd49-00f1-4895-bb23-63e83238daaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b9865f039348918374fd68cae3d0a6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:41.657957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5a33cd49-00f1-4895-bb23-63e83238daaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b9865f039348918374fd68cae3d0a6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:41.721996 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5a33cd49-00f1-4895-bb23-63e83238daaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b9865f039348918374fd68cae3d0a6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:41.722668 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5a33cd49-00f1-4895-bb23-63e83238daaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b9865f039348918374fd68cae3d0a6'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:41.735241 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1146/2271] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:02:41 2022] DELETE /identity/v3/users/e2b9865f039348918374fd68cae3d0a6 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:02:41.963622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f67df0-17b7-4f0d-b19b-d869edf5a998 service placement] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:41.980811 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f67df0-17b7-4f0d-b19b-d869edf5a998 service placement] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:42.039320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736032a-10e2-4731-a140-5ba58de9032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:42.039897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736032a-10e2-4731-a140-5ba58de9032d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:42.040185 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736032a-10e2-4731-a140-5ba58de9032d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:42.040509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736032a-10e2-4731-a140-5ba58de9032d admin admin] PATH_INFO: `/v3/projects/057b7de93037443fad1c26d77974b18f` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:42.041667 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736032a-10e2-4731-a140-5ba58de9032d admin admin] RBAC: Authorizing `identity:delete_project(project_id=057b7de93037443fad1c26d77974b18f)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:42.050343 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736032a-10e2-4731-a140-5ba58de9032d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:42.068947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:42.191744 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-9736032a-10e2-4731-a140-5ba58de9032d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '057b7de93037443fad1c26d77974b18f', 'request_id': 'req-9736032a-10e2-4731-a140-5ba58de9032d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:42.197784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-9736032a-10e2-4731-a140-5ba58de9032d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '057b7de93037443fad1c26d77974b18f', 'request_id': 'req-9736032a-10e2-4731-a140-5ba58de9032d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:42.299422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-9736032a-10e2-4731-a140-5ba58de9032d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '057b7de93037443fad1c26d77974b18f', 'request_id': 'req-9736032a-10e2-4731-a140-5ba58de9032d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:42.312406 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-9736032a-10e2-4731-a140-5ba58de9032d admin admin] The token cache is being invalidate because project 057b7de93037443fad1c26d77974b18f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:02:42.314631 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-9736032a-10e2-4731-a140-5ba58de9032d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:42.314631 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-9736032a-10e2-4731-a140-5ba58de9032d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:42.315112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1126/2272] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:02:41 2022] DELETE /identity/v3/projects/057b7de93037443fad1c26d77974b18f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:02:42.319293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33cd49-00f1-4895-bb23-63e83238daaa admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:42.321945 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5a33cd49-00f1-4895-bb23-63e83238daaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:42.336834 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33cd49-00f1-4895-bb23-63e83238daaa admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:42.355350 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:42.398626 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7c7b3-d34e-4208-b011-4c9a74b71dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:42.399552 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7c7b3-d34e-4208-b011-4c9a74b71dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:42.400074 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7c7b3-d34e-4208-b011-4c9a74b71dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:42.400445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7c7b3-d34e-4208-b011-4c9a74b71dc8 admin admin] PATH_INFO: `/v3/users/1d59e4be3eb44d87be0a84a92aa69253` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:42.401709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7c7b3-d34e-4208-b011-4c9a74b71dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d59e4be3eb44d87be0a84a92aa69253)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:42.403978 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7c7b3-d34e-4208-b011-4c9a74b71dc8 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:42.613715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-8ef7c7b3-d34e-4208-b011-4c9a74b71dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d59e4be3eb44d87be0a84a92aa69253'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:42.614458 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-8ef7c7b3-d34e-4208-b011-4c9a74b71dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d59e4be3eb44d87be0a84a92aa69253'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:42.627443 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-8ef7c7b3-d34e-4208-b011-4c9a74b71dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d59e4be3eb44d87be0a84a92aa69253'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:42.699660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-8ef7c7b3-d34e-4208-b011-4c9a74b71dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d59e4be3eb44d87be0a84a92aa69253'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:42.700275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-8ef7c7b3-d34e-4208-b011-4c9a74b71dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d59e4be3eb44d87be0a84a92aa69253'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:42.713328 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1147/2273] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:02:42 2022] DELETE /identity/v3/users/1d59e4be3eb44d87be0a84a92aa69253 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:02:42.981564 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736032a-10e2-4731-a140-5ba58de9032d admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:42.984517 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-9736032a-10e2-4731-a140-5ba58de9032d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:43.002674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736032a-10e2-4731-a140-5ba58de9032d admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:43.066544 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36368415-8b01-4016-8c7c-184f4ce37dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:43.067194 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36368415-8b01-4016-8c7c-184f4ce37dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:43.067476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36368415-8b01-4016-8c7c-184f4ce37dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:43.067750 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36368415-8b01-4016-8c7c-184f4ce37dd5 admin admin] PATH_INFO: `/v3/projects/0640223205ba45f8834c7f6095cba855` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:43.068907 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36368415-8b01-4016-8c7c-184f4ce37dd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0640223205ba45f8834c7f6095cba855)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:43.070901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36368415-8b01-4016-8c7c-184f4ce37dd5 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:43.186977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-36368415-8b01-4016-8c7c-184f4ce37dd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0640223205ba45f8834c7f6095cba855', 'request_id': 'req-36368415-8b01-4016-8c7c-184f4ce37dd5'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:43.194364 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-36368415-8b01-4016-8c7c-184f4ce37dd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0640223205ba45f8834c7f6095cba855', 'request_id': 'req-36368415-8b01-4016-8c7c-184f4ce37dd5'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:43.277126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-36368415-8b01-4016-8c7c-184f4ce37dd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0640223205ba45f8834c7f6095cba855', 'request_id': 'req-36368415-8b01-4016-8c7c-184f4ce37dd5'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:43.290333 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-36368415-8b01-4016-8c7c-184f4ce37dd5 admin admin] The token cache is being invalidate because project 0640223205ba45f8834c7f6095cba855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:02:43.290705 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-36368415-8b01-4016-8c7c-184f4ce37dd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:43.291518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-36368415-8b01-4016-8c7c-184f4ce37dd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:43.293209 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1127/2274] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:02:42 2022] DELETE /identity/v3/projects/0640223205ba45f8834c7f6095cba855 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:02:43.298016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b268bd-d7ee-401f-a34e-6fbf21b51585 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:43.298316 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b268bd-d7ee-401f-a34e-6fbf21b51585 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:43.298623 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b268bd-d7ee-401f-a34e-6fbf21b51585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:43.321052 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-53b268bd-d7ee-401f-a34e-6fbf21b51585 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:43.322258 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-53b268bd-d7ee-401f-a34e-6fbf21b51585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:43.382039 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1148/2275] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:02:43.450453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7da42-5bee-4ed0-9e32-9e19dc27a956 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:43.451095 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7da42-5bee-4ed0-9e32-9e19dc27a956 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:43.451095 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7da42-5bee-4ed0-9e32-9e19dc27a956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:43.471234 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-91c7da42-5bee-4ed0-9e32-9e19dc27a956 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:43.472449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-91c7da42-5bee-4ed0-9e32-9e19dc27a956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:43.480320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1128/2276] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:02:43.484704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b268bd-d7ee-401f-a34e-6fbf21b51585 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:43.494463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b268bd-d7ee-401f-a34e-6fbf21b51585 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:43.499055 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ec802-bccc-43ee-bbec-e817c0527811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:43.499661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ec802-bccc-43ee-bbec-e817c0527811 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:43.499940 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ec802-bccc-43ee-bbec-e817c0527811 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:43.500218 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ec802-bccc-43ee-bbec-e817c0527811 admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:43.500904 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ec802-bccc-43ee-bbec-e817c0527811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:02:43.501207 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ec802-bccc-43ee-bbec-e817c0527811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:43.502838 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ec802-bccc-43ee-bbec-e817c0527811 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:43.514949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1149/2277] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:02:43.519162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7da42-5bee-4ed0-9e32-9e19dc27a956 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:43.529438 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7da42-5bee-4ed0-9e32-9e19dc27a956 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:43.534256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca9bc1-2146-4045-aca6-1dfb768667c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:43.534920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca9bc1-2146-4045-aca6-1dfb768667c2 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:43.535201 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca9bc1-2146-4045-aca6-1dfb768667c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:43.535476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca9bc1-2146-4045-aca6-1dfb768667c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:43.536189 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca9bc1-2146-4045-aca6-1dfb768667c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:43.538114 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca9bc1-2146-4045-aca6-1dfb768667c2 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:43.639757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1129/2278] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:02:43 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:02:43.646298 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ec802-bccc-43ee-bbec-e817c0527811 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:43.656600 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ec802-bccc-43ee-bbec-e817c0527811 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:43.680527 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:43.712776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07e27d-5c1e-4ee5-bf2c-95a83c12f5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:43.713410 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07e27d-5c1e-4ee5-bf2c-95a83c12f5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:43.713689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07e27d-5c1e-4ee5-bf2c-95a83c12f5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:43.714010 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07e27d-5c1e-4ee5-bf2c-95a83c12f5f5 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:43.714677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07e27d-5c1e-4ee5-bf2c-95a83c12f5f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:43.716609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07e27d-5c1e-4ee5-bf2c-95a83c12f5f5 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:43.796743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1150/2279] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:02:43 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:02:43.800997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca9bc1-2146-4045-aca6-1dfb768667c2 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:43.811303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca9bc1-2146-4045-aca6-1dfb768667c2 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:43.817231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20295a13-1cdf-45cb-84af-cd5807d6811e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:43.817934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20295a13-1cdf-45cb-84af-cd5807d6811e admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:43.818255 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20295a13-1cdf-45cb-84af-cd5807d6811e admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:43.820266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20295a13-1cdf-45cb-84af-cd5807d6811e admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:43.820266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20295a13-1cdf-45cb-84af-cd5807d6811e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:43.820918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20295a13-1cdf-45cb-84af-cd5807d6811e admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:43.826311 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:43.833127 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1130/2280] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:02:43.837730 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07e27d-5c1e-4ee5-bf2c-95a83c12f5f5 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:43.850748 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07e27d-5c1e-4ee5-bf2c-95a83c12f5f5 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:43.855570 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034ce9b-2780-45e2-b8dd-c44eaee5d30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:43.856197 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034ce9b-2780-45e2-b8dd-c44eaee5d30e admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:43.856571 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034ce9b-2780-45e2-b8dd-c44eaee5d30e admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:43.860717 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034ce9b-2780-45e2-b8dd-c44eaee5d30e admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:43.860717 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034ce9b-2780-45e2-b8dd-c44eaee5d30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:43.860717 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034ce9b-2780-45e2-b8dd-c44eaee5d30e admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:43.872166 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1151/2281] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:02:43.874549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20295a13-1cdf-45cb-84af-cd5807d6811e admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:43.892721 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20295a13-1cdf-45cb-84af-cd5807d6811e admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:43.898263 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d488d-c8dc-4361-b4fc-b16ec436d1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:43.898967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d488d-c8dc-4361-b4fc-b16ec436d1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:43.899253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d488d-c8dc-4361-b4fc-b16ec436d1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:43.899533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d488d-c8dc-4361-b4fc-b16ec436d1c8 admin admin] PATH_INFO: `/v3/projects/9ab790e9810a49629b19f587c4fffdc1/users/644fc8ed73ad46b29448e39d79480432/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:43.915083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d488d-c8dc-4361-b4fc-b16ec436d1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ab790e9810a49629b19f587c4fffdc1, user_id=644fc8ed73ad46b29448e39d79480432, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:43.918170 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d488d-c8dc-4361-b4fc-b16ec436d1c8 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:44.009907 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1131/2282] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:02:43 2022] PUT /identity/v3/projects/9ab790e9810a49629b19f587c4fffdc1/users/644fc8ed73ad46b29448e39d79480432/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:02:44.020166 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd08e2-245b-4280-b44f-cb68a6f9e919 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:44.020457 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd08e2-245b-4280-b44f-cb68a6f9e919 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:44.020756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd08e2-245b-4280-b44f-cb68a6f9e919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:44.048445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-eafd08e2-245b-4280-b44f-cb68a6f9e919 None None] MFA Rules not processed for user `644fc8ed73ad46b29448e39d79480432`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:44.049580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-eafd08e2-245b-4280-b44f-cb68a6f9e919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:44.112948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1152/2283] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:02:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:02:44.124979 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d488d-c8dc-4361-b4fc-b16ec436d1c8 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:44.126770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-169d488d-c8dc-4361-b4fc-b16ec436d1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:44.185749 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d488d-c8dc-4361-b4fc-b16ec436d1c8 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:44.189510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea701741-5c97-4f84-a189-0a9a4e01965a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa31ecab10a6499f92da49bc7abb403a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:44.190129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea701741-5c97-4f84-a189-0a9a4e01965a service glance] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:44.190442 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea701741-5c97-4f84-a189-0a9a4e01965a service glance] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:44.190727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea701741-5c97-4f84-a189-0a9a4e01965a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:44.199908 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea701741-5c97-4f84-a189-0a9a4e01965a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:44.201340 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea701741-5c97-4f84-a189-0a9a4e01965a service glance] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:44.210284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1132/2284] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:02:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:02:46.648806 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e757e74-0b42-4511-b018-8d93d3c6e61f None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:46.649416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e757e74-0b42-4511-b018-8d93d3c6e61f None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:46.649511 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e757e74-0b42-4511-b018-8d93d3c6e61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:46.676550 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-2e757e74-0b42-4511-b018-8d93d3c6e61f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:46.677788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2e757e74-0b42-4511-b018-8d93d3c6e61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:46.758742 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1153/2285] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 15:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:02:46.781534 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea701741-5c97-4f84-a189-0a9a4e01965a service glance] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:46.783013 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ea701741-5c97-4f84-a189-0a9a4e01965a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:46.869399 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea701741-5c97-4f84-a189-0a9a4e01965a service glance] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:46.874949 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead07bdd-b0f9-4513-8640-ad28eb0edcab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:46.875576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead07bdd-b0f9-4513-8640-ad28eb0edcab service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:46.875861 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead07bdd-b0f9-4513-8640-ad28eb0edcab service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:46.876144 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead07bdd-b0f9-4513-8640-ad28eb0edcab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:46.885165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead07bdd-b0f9-4513-8640-ad28eb0edcab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:46.887028 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead07bdd-b0f9-4513-8640-ad28eb0edcab service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:46.899782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1133/2286] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:02:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:02:47.888121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e757e74-0b42-4511-b018-8d93d3c6e61f None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:47.889669 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2e757e74-0b42-4511-b018-8d93d3c6e61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:47.902326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e757e74-0b42-4511-b018-8d93d3c6e61f None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:47.906973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37a865-2832-4883-8349-7231df7fb43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:47.907613 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37a865-2832-4883-8349-7231df7fb43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:47.907896 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37a865-2832-4883-8349-7231df7fb43a admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:47.908171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37a865-2832-4883-8349-7231df7fb43a admin admin] PATH_INFO: `/v3/users/46d48c986c50431199187381b91e218b` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:47.909323 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37a865-2832-4883-8349-7231df7fb43a admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d48c986c50431199187381b91e218b)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:47.911849 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37a865-2832-4883-8349-7231df7fb43a admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:48.049056 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:48.062898 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-da37a865-2832-4883-8349-7231df7fb43a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d48c986c50431199187381b91e218b'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:48.063544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-da37a865-2832-4883-8349-7231df7fb43a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d48c986c50431199187381b91e218b'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:48.076935 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-da37a865-2832-4883-8349-7231df7fb43a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d48c986c50431199187381b91e218b'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:48.145001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-da37a865-2832-4883-8349-7231df7fb43a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d48c986c50431199187381b91e218b'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:48.147983 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-da37a865-2832-4883-8349-7231df7fb43a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d48c986c50431199187381b91e218b'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:48.161370 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1154/2287] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:02:47 2022] DELETE /identity/v3/users/46d48c986c50431199187381b91e218b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:02:48.165966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b1a30-2a58-4b8f-bcf7-1bf11a651089 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:48.166514 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b1a30-2a58-4b8f-bcf7-1bf11a651089 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:48.166631 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b1a30-2a58-4b8f-bcf7-1bf11a651089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:48.185891 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-4f8b1a30-2a58-4b8f-bcf7-1bf11a651089 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:48.187137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4f8b1a30-2a58-4b8f-bcf7-1bf11a651089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:48.248294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1134/2288] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:02:48.258758 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37a865-2832-4883-8349-7231df7fb43a admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:48.260220 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-da37a865-2832-4883-8349-7231df7fb43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:48.319952 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37a865-2832-4883-8349-7231df7fb43a admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:48.323575 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279bbd3-163e-4bfd-9075-f92dde361866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:48.324198 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279bbd3-163e-4bfd-9075-f92dde361866 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:48.324483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279bbd3-163e-4bfd-9075-f92dde361866 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:48.324760 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279bbd3-163e-4bfd-9075-f92dde361866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:48.334749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279bbd3-163e-4bfd-9075-f92dde361866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:48.336184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279bbd3-163e-4bfd-9075-f92dde361866 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:48.346037 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1155/2289] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:02:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:02:48.758892 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b1a30-2a58-4b8f-bcf7-1bf11a651089 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:48.760320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4f8b1a30-2a58-4b8f-bcf7-1bf11a651089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:48.769741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:48.777079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b1a30-2a58-4b8f-bcf7-1bf11a651089 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:48.784819 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6250b06-b930-4de0-b611-6a3bed158850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:48.787531 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6250b06-b930-4de0-b611-6a3bed158850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:48.787969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6250b06-b930-4de0-b611-6a3bed158850 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:48.788470 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6250b06-b930-4de0-b611-6a3bed158850 admin admin] PATH_INFO: `/v3/projects/12b9d2e3d8724736ad333560c23a41a8` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:48.794413 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6250b06-b930-4de0-b611-6a3bed158850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12b9d2e3d8724736ad333560c23a41a8)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:48.797724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6250b06-b930-4de0-b611-6a3bed158850 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:48.949267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-d6250b06-b930-4de0-b611-6a3bed158850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12b9d2e3d8724736ad333560c23a41a8', 'request_id': 'req-d6250b06-b930-4de0-b611-6a3bed158850'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:48.955796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-d6250b06-b930-4de0-b611-6a3bed158850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12b9d2e3d8724736ad333560c23a41a8', 'request_id': 'req-d6250b06-b930-4de0-b611-6a3bed158850'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:49.021025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-d6250b06-b930-4de0-b611-6a3bed158850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12b9d2e3d8724736ad333560c23a41a8', 'request_id': 'req-d6250b06-b930-4de0-b611-6a3bed158850'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:49.034376 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-d6250b06-b930-4de0-b611-6a3bed158850 admin admin] The token cache is being invalidate because project 12b9d2e3d8724736ad333560c23a41a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:02:49.034888 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-d6250b06-b930-4de0-b611-6a3bed158850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:49.044316 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-d6250b06-b930-4de0-b611-6a3bed158850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:02:49.044316 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1135/2290] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:02:48 2022] DELETE /identity/v3/projects/12b9d2e3d8724736ad333560c23a41a8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:02:52.984209 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e16c78-d2cd-4d8c-b9ab-21a6683cc08a None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:52.984771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e16c78-d2cd-4d8c-b9ab-21a6683cc08a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:52.985028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e16c78-d2cd-4d8c-b9ab-21a6683cc08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:53.005384 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-37e16c78-d2cd-4d8c-b9ab-21a6683cc08a None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:02:53.006635 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-37e16c78-d2cd-4d8c-b9ab-21a6683cc08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:53.069919 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1156/2291] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 15:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:02:53.095371 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6250b06-b930-4de0-b611-6a3bed158850 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:02:53.096809 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d6250b06-b930-4de0-b611-6a3bed158850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:02:53.185343 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6250b06-b930-4de0-b611-6a3bed158850 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:02:53.190888 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93bfc0-a87a-43c4-beb6-ed1caf4c7d28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:02:53.191548 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93bfc0-a87a-43c4-beb6-ed1caf4c7d28 service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:02:53.191905 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93bfc0-a87a-43c4-beb6-ed1caf4c7d28 service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:02:53.192268 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93bfc0-a87a-43c4-beb6-ed1caf4c7d28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:02:53.200639 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93bfc0-a87a-43c4-beb6-ed1caf4c7d28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:02:53.202265 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93bfc0-a87a-43c4-beb6-ed1caf4c7d28 service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:02:53.212383 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1136/2292] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:03:03.062074 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=71,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:03.208252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=59,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:08.260678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e16c78-d2cd-4d8c-b9ab-21a6683cc08a None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:08.262239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-37e16c78-d2cd-4d8c-b9ab-21a6683cc08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:08.340309 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e16c78-d2cd-4d8c-b9ab-21a6683cc08a None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:08.345361 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117cd77-c9fa-4bc1-990d-ea3ef37ff368 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fab620bc5d044479746d8ea17615a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:08.346020 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117cd77-c9fa-4bc1-990d-ea3ef37ff368 service placement] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:08.346302 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117cd77-c9fa-4bc1-990d-ea3ef37ff368 service placement] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:08.346638 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117cd77-c9fa-4bc1-990d-ea3ef37ff368 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:08.348934 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4117cd77-c9fa-4bc1-990d-ea3ef37ff368 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:08.361259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117cd77-c9fa-4bc1-990d-ea3ef37ff368 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:08.363078 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117cd77-c9fa-4bc1-990d-ea3ef37ff368 service placement] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:08.374592 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1157/2293] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:03:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:03:09.923971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93bfc0-a87a-43c4-beb6-ed1caf4c7d28 service nova] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:09.925339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-0b93bfc0-a87a-43c4-beb6-ed1caf4c7d28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:09.939945 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93bfc0-a87a-43c4-beb6-ed1caf4c7d28 service nova] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:09.945573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5404e-b69e-4b77-b932-c3257c0c8d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:09.946221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5404e-b69e-4b77-b932-c3257c0c8d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:09.946564 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5404e-b69e-4b77-b932-c3257c0c8d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:09.946839 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5404e-b69e-4b77-b932-c3257c0c8d1b admin admin] PATH_INFO: `/v3/users/644fc8ed73ad46b29448e39d79480432` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:09.948035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5404e-b69e-4b77-b932-c3257c0c8d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=644fc8ed73ad46b29448e39d79480432)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:09.950235 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5404e-b69e-4b77-b932-c3257c0c8d1b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:10.107516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-94a5404e-b69e-4b77-b932-c3257c0c8d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '644fc8ed73ad46b29448e39d79480432'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:10.114824 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-94a5404e-b69e-4b77-b932-c3257c0c8d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '644fc8ed73ad46b29448e39d79480432'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:10.127377 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-94a5404e-b69e-4b77-b932-c3257c0c8d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '644fc8ed73ad46b29448e39d79480432'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:10.128102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-94a5404e-b69e-4b77-b932-c3257c0c8d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '644fc8ed73ad46b29448e39d79480432'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:10.128697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-94a5404e-b69e-4b77-b932-c3257c0c8d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '644fc8ed73ad46b29448e39d79480432'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:10.213886 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1137/2294] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:03:09 2022] DELETE /identity/v3/users/644fc8ed73ad46b29448e39d79480432 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:03:10.218309 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a301e-ac3c-4cdc-b01f-6d0659f83c9f None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:10.218807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a301e-ac3c-4cdc-b01f-6d0659f83c9f None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:10.218933 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a301e-ac3c-4cdc-b01f-6d0659f83c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:10.239097 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-279a301e-ac3c-4cdc-b01f-6d0659f83c9f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:10.240298 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-279a301e-ac3c-4cdc-b01f-6d0659f83c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:10.298811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1158/2295] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:03:10.308341 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5404e-b69e-4b77-b932-c3257c0c8d1b admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:10.309734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-94a5404e-b69e-4b77-b932-c3257c0c8d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:10.369642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5404e-b69e-4b77-b932-c3257c0c8d1b admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:10.373236 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e8770-d4ee-48b6-9591-0f4b3140044f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:10.373905 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e8770-d4ee-48b6-9591-0f4b3140044f service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:10.374189 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e8770-d4ee-48b6-9591-0f4b3140044f service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:10.374502 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e8770-d4ee-48b6-9591-0f4b3140044f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:10.383335 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e8770-d4ee-48b6-9591-0f4b3140044f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:10.384756 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e8770-d4ee-48b6-9591-0f4b3140044f service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:10.393950 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1138/2296] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:03:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:03:10.902051 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a301e-ac3c-4cdc-b01f-6d0659f83c9f None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:10.903792 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-279a301e-ac3c-4cdc-b01f-6d0659f83c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:10.918115 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a301e-ac3c-4cdc-b01f-6d0659f83c9f None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:10.923007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab59f2-73e0-496a-8210-e9b7dc82bc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:10.923665 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab59f2-73e0-496a-8210-e9b7dc82bc2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:10.923949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab59f2-73e0-496a-8210-e9b7dc82bc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:10.926533 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab59f2-73e0-496a-8210-e9b7dc82bc2b admin admin] PATH_INFO: `/v3/projects/9ab790e9810a49629b19f587c4fffdc1` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:10.926533 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab59f2-73e0-496a-8210-e9b7dc82bc2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ab790e9810a49629b19f587c4fffdc1)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:10.927530 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab59f2-73e0-496a-8210-e9b7dc82bc2b admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:11.043928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-10ab59f2-73e0-496a-8210-e9b7dc82bc2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ab790e9810a49629b19f587c4fffdc1', 'request_id': 'req-10ab59f2-73e0-496a-8210-e9b7dc82bc2b'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:11.050447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-10ab59f2-73e0-496a-8210-e9b7dc82bc2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ab790e9810a49629b19f587c4fffdc1', 'request_id': 'req-10ab59f2-73e0-496a-8210-e9b7dc82bc2b'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:11.056514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-10ab59f2-73e0-496a-8210-e9b7dc82bc2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ab790e9810a49629b19f587c4fffdc1', 'request_id': 'req-10ab59f2-73e0-496a-8210-e9b7dc82bc2b'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:11.139467 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-10ab59f2-73e0-496a-8210-e9b7dc82bc2b admin admin] The token cache is being invalidate because project 9ab790e9810a49629b19f587c4fffdc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:03:11.139894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-10ab59f2-73e0-496a-8210-e9b7dc82bc2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:11.140615 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-10ab59f2-73e0-496a-8210-e9b7dc82bc2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:11.142215 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1159/2297] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:03:10 2022] DELETE /identity/v3/projects/9ab790e9810a49629b19f587c4fffdc1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:03:11.151771 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902726c-bbc2-404b-ab38-04c172f115b1 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:11.153430 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902726c-bbc2-404b-ab38-04c172f115b1 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:11.159450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902726c-bbc2-404b-ab38-04c172f115b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:11.174761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-7902726c-bbc2-404b-ab38-04c172f115b1 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:11.176006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-7902726c-bbc2-404b-ab38-04c172f115b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:11.234719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1139/2298] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:03:11.244400 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc036d51-4404-432b-9b84-54ded3516c46 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:11.244870 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc036d51-4404-432b-9b84-54ded3516c46 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:11.244989 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc036d51-4404-432b-9b84-54ded3516c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:11.265179 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-bc036d51-4404-432b-9b84-54ded3516c46 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:11.266375 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-bc036d51-4404-432b-9b84-54ded3516c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:11.274655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1160/2299] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:03:11.278842 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902726c-bbc2-404b-ab38-04c172f115b1 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:11.289104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902726c-bbc2-404b-ab38-04c172f115b1 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:11.293640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37700153-bee0-4b4e-b7ff-50661190640b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:11.294254 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37700153-bee0-4b4e-b7ff-50661190640b admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:11.294574 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37700153-bee0-4b4e-b7ff-50661190640b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:11.294854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37700153-bee0-4b4e-b7ff-50661190640b admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:11.295552 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37700153-bee0-4b4e-b7ff-50661190640b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:03:11.295860 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37700153-bee0-4b4e-b7ff-50661190640b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:11.297447 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37700153-bee0-4b4e-b7ff-50661190640b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:11.310069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1140/2300] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:03:11.314211 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc036d51-4404-432b-9b84-54ded3516c46 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:11.323679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc036d51-4404-432b-9b84-54ded3516c46 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:11.329300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b64570-3a68-4dd2-aad3-a9746000b7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:11.329914 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b64570-3a68-4dd2-aad3-a9746000b7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:11.330197 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b64570-3a68-4dd2-aad3-a9746000b7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:11.330517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b64570-3a68-4dd2-aad3-a9746000b7e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:11.331222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b64570-3a68-4dd2-aad3-a9746000b7e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:11.333272 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b64570-3a68-4dd2-aad3-a9746000b7e2 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:11.338013 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:11.467997 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1161/2301] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:03:11 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:03:11.472393 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37700153-bee0-4b4e-b7ff-50661190640b admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:11.477995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:11.483408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37700153-bee0-4b4e-b7ff-50661190640b admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:11.542029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4060d-98bd-46ad-83cc-2b1943083e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:11.542712 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4060d-98bd-46ad-83cc-2b1943083e09 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:11.543002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4060d-98bd-46ad-83cc-2b1943083e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:11.543285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4060d-98bd-46ad-83cc-2b1943083e09 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:11.543956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4060d-98bd-46ad-83cc-2b1943083e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:11.545910 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4060d-98bd-46ad-83cc-2b1943083e09 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:11.668847 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1141/2302] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:03:11 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:03:11.672962 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b64570-3a68-4dd2-aad3-a9746000b7e2 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:11.684066 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b64570-3a68-4dd2-aad3-a9746000b7e2 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:11.688817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd3966-5c43-43bd-8d63-af3dd699a314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:11.689438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd3966-5c43-43bd-8d63-af3dd699a314 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:11.689726 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd3966-5c43-43bd-8d63-af3dd699a314 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:11.690000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd3966-5c43-43bd-8d63-af3dd699a314 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:11.690795 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd3966-5c43-43bd-8d63-af3dd699a314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:11.693439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd3966-5c43-43bd-8d63-af3dd699a314 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:11.703760 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1162/2303] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:03:11.708518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4060d-98bd-46ad-83cc-2b1943083e09 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:11.718447 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4060d-98bd-46ad-83cc-2b1943083e09 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:11.723096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84561c-a485-4cb1-a5bf-a637e59428c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:11.723747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84561c-a485-4cb1-a5bf-a637e59428c7 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:11.724031 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84561c-a485-4cb1-a5bf-a637e59428c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:11.724308 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84561c-a485-4cb1-a5bf-a637e59428c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:11.725007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84561c-a485-4cb1-a5bf-a637e59428c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:11.726642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84561c-a485-4cb1-a5bf-a637e59428c7 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:11.737938 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1142/2304] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:03:11.742767 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd3966-5c43-43bd-8d63-af3dd699a314 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:11.753175 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd3966-5c43-43bd-8d63-af3dd699a314 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:11.759074 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80aa347-1dd8-4ca6-8e49-bf45743129e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:11.759905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aa347-1dd8-4ca6-8e49-bf45743129e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:11.760252 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aa347-1dd8-4ca6-8e49-bf45743129e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:11.760538 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aa347-1dd8-4ca6-8e49-bf45743129e6 admin admin] PATH_INFO: `/v3/projects/7771ff58ff51421fa2c255b5635337d3/users/f2b5716759364380b3b8d71d970af3f1/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:11.792502 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80aa347-1dd8-4ca6-8e49-bf45743129e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7771ff58ff51421fa2c255b5635337d3, user_id=f2b5716759364380b3b8d71d970af3f1, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:11.795355 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80aa347-1dd8-4ca6-8e49-bf45743129e6 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:11.859524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1163/2305] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:03:11 2022] PUT /identity/v3/projects/7771ff58ff51421fa2c255b5635337d3/users/f2b5716759364380b3b8d71d970af3f1/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:03:11.871660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db8edd-2370-4687-aaf9-7030a5e083a2 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:11.871947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db8edd-2370-4687-aaf9-7030a5e083a2 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:11.872857 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db8edd-2370-4687-aaf9-7030a5e083a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:11.900327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-73db8edd-2370-4687-aaf9-7030a5e083a2 None None] MFA Rules not processed for user `f2b5716759364380b3b8d71d970af3f1`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:11.901542 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-73db8edd-2370-4687-aaf9-7030a5e083a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:11.969765 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1143/2306] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:03:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:03:11.981159 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80aa347-1dd8-4ca6-8e49-bf45743129e6 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:11.982998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c80aa347-1dd8-4ca6-8e49-bf45743129e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:12.043088 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80aa347-1dd8-4ca6-8e49-bf45743129e6 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:12.046889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c46222-51f6-40a3-b2b8-d24d2a1fea9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:12.047506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c46222-51f6-40a3-b2b8-d24d2a1fea9f service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:12.047794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c46222-51f6-40a3-b2b8-d24d2a1fea9f service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:12.048071 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c46222-51f6-40a3-b2b8-d24d2a1fea9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:12.057031 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c46222-51f6-40a3-b2b8-d24d2a1fea9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:12.058567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c46222-51f6-40a3-b2b8-d24d2a1fea9f service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:12.067484 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1164/2307] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:03:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:03:15.641177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26e27b-6920-4e8a-83b4-103790dfc4fb None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:15.641752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26e27b-6920-4e8a-83b4-103790dfc4fb None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:15.641842 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26e27b-6920-4e8a-83b4-103790dfc4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:15.661114 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-ab26e27b-6920-4e8a-83b4-103790dfc4fb None None] MFA Rules not processed for user `b537d1da4fc34421a2c2c97f06517e35`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:15.666603 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ab26e27b-6920-4e8a-83b4-103790dfc4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:15.726113 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1144/2308] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:03:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:03:16.015300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620e592-e46e-40c4-9c46-9bbc7c4cff49 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:16.015300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620e592-e46e-40c4-9c46-9bbc7c4cff49 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:16.015300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620e592-e46e-40c4-9c46-9bbc7c4cff49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:16.036219 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-8620e592-e46e-40c4-9c46-9bbc7c4cff49 None None] MFA Rules not processed for user `0834be7405cd4c968763099251d37154`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:16.037432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-8620e592-e46e-40c4-9c46-9bbc7c4cff49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:16.100432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1165/2309] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jul 26 15:03:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:03:16.152718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26e27b-6920-4e8a-83b4-103790dfc4fb None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:16.154215 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ab26e27b-6920-4e8a-83b4-103790dfc4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:16.173465 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:16.227800 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26e27b-6920-4e8a-83b4-103790dfc4fb None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:16.230953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1c480-16ff-4a80-9d47-7a900370b371 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '462ecbb85c6b4a17a952fb74fa2de65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:16.231581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1c480-16ff-4a80-9d47-7a900370b371 service swift] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:16.231870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1c480-16ff-4a80-9d47-7a900370b371 service swift] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:16.232148 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1c480-16ff-4a80-9d47-7a900370b371 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:16.240624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1c480-16ff-4a80-9d47-7a900370b371 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:16.242207 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1c480-16ff-4a80-9d47-7a900370b371 service swift] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:16.251422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1145/2310] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jul 26 15:03:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:03:17.338437 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620e592-e46e-40c4-9c46-9bbc7c4cff49 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:17.416154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:17.421241 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620e592-e46e-40c4-9c46-9bbc7c4cff49 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:17.427331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3968e3-6e53-4274-97cc-aaa950125726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:17.427937 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3968e3-6e53-4274-97cc-aaa950125726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:17.428223 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3968e3-6e53-4274-97cc-aaa950125726 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:17.428500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3968e3-6e53-4274-97cc-aaa950125726 admin admin] PATH_INFO: `/v3/users/f2b5716759364380b3b8d71d970af3f1` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:17.430204 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3968e3-6e53-4274-97cc-aaa950125726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b5716759364380b3b8d71d970af3f1)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:17.433348 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3968e3-6e53-4274-97cc-aaa950125726 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:17.758740 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7b3968e3-6e53-4274-97cc-aaa950125726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b5716759364380b3b8d71d970af3f1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:17.759160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7b3968e3-6e53-4274-97cc-aaa950125726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b5716759364380b3b8d71d970af3f1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:17.781100 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7b3968e3-6e53-4274-97cc-aaa950125726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b5716759364380b3b8d71d970af3f1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:17.880882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7b3968e3-6e53-4274-97cc-aaa950125726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b5716759364380b3b8d71d970af3f1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:17.881570 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-7b3968e3-6e53-4274-97cc-aaa950125726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b5716759364380b3b8d71d970af3f1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:17.901826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1166/2311] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:03:17 2022] DELETE /identity/v3/users/f2b5716759364380b3b8d71d970af3f1 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:03:17.903467 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb859f-b65c-43ff-acb3-f08df80717b0 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:17.903950 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb859f-b65c-43ff-acb3-f08df80717b0 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:17.904104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb859f-b65c-43ff-acb3-f08df80717b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:17.933951 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-8bbb859f-b65c-43ff-acb3-f08df80717b0 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:17.935102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8bbb859f-b65c-43ff-acb3-f08df80717b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:18.015956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1146/2312] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:03:18.017491 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3968e3-6e53-4274-97cc-aaa950125726 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:18.023732 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-7b3968e3-6e53-4274-97cc-aaa950125726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:18.096020 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3968e3-6e53-4274-97cc-aaa950125726 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:18.100830 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113ba4e-58ca-43a4-95b4-363b442c7996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:18.101469 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113ba4e-58ca-43a4-95b4-363b442c7996 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:18.101753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113ba4e-58ca-43a4-95b4-363b442c7996 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:18.102032 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113ba4e-58ca-43a4-95b4-363b442c7996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:18.113138 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113ba4e-58ca-43a4-95b4-363b442c7996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:18.114888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113ba4e-58ca-43a4-95b4-363b442c7996 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:18.126639 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1167/2313] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:03:18.727363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb859f-b65c-43ff-acb3-f08df80717b0 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:18.732471 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8bbb859f-b65c-43ff-acb3-f08df80717b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:18.743008 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb859f-b65c-43ff-acb3-f08df80717b0 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:18.748784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd2570-1aeb-4dc4-a96f-875a4fd45a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:18.749847 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd2570-1aeb-4dc4-a96f-875a4fd45a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:18.750533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd2570-1aeb-4dc4-a96f-875a4fd45a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:18.751019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd2570-1aeb-4dc4-a96f-875a4fd45a9d admin admin] PATH_INFO: `/v3/projects/7771ff58ff51421fa2c255b5635337d3` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:18.752487 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd2570-1aeb-4dc4-a96f-875a4fd45a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7771ff58ff51421fa2c255b5635337d3)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:18.755351 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd2570-1aeb-4dc4-a96f-875a4fd45a9d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:18.918518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-85fd2570-1aeb-4dc4-a96f-875a4fd45a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7771ff58ff51421fa2c255b5635337d3', 'request_id': 'req-85fd2570-1aeb-4dc4-a96f-875a4fd45a9d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:18.929851 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-85fd2570-1aeb-4dc4-a96f-875a4fd45a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7771ff58ff51421fa2c255b5635337d3', 'request_id': 'req-85fd2570-1aeb-4dc4-a96f-875a4fd45a9d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:19.054595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-85fd2570-1aeb-4dc4-a96f-875a4fd45a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7771ff58ff51421fa2c255b5635337d3', 'request_id': 'req-85fd2570-1aeb-4dc4-a96f-875a4fd45a9d'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:19.086500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-85fd2570-1aeb-4dc4-a96f-875a4fd45a9d admin admin] The token cache is being invalidate because project 7771ff58ff51421fa2c255b5635337d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:03:19.087053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-85fd2570-1aeb-4dc4-a96f-875a4fd45a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:19.088114 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-85fd2570-1aeb-4dc4-a96f-875a4fd45a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:03:19.091606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1147/2314] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:03:18 2022] DELETE /identity/v3/projects/7771ff58ff51421fa2c255b5635337d3 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:03:19.099009 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cb32d-e2ee-4773-b268-fea64f97277e None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:19.099580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cb32d-e2ee-4773-b268-fea64f97277e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:19.099580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cb32d-e2ee-4773-b268-fea64f97277e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:19.131192 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-873cb32d-e2ee-4773-b268-fea64f97277e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:19.132425 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-873cb32d-e2ee-4773-b268-fea64f97277e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:19.216305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1168/2315] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:03:19.219433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4c1c4-723e-4a25-9d18-63efa81a232b None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:19.220332 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4c1c4-723e-4a25-9d18-63efa81a232b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:19.221060 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4c1c4-723e-4a25-9d18-63efa81a232b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:19.259609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-42f4c1c4-723e-4a25-9d18-63efa81a232b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:19.266183 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-42f4c1c4-723e-4a25-9d18-63efa81a232b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:19.270442 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1148/2316] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:03:19.274307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cb32d-e2ee-4773-b268-fea64f97277e None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:19.284363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cb32d-e2ee-4773-b268-fea64f97277e None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:19.289598 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e87659-d58a-4fb6-a978-485fcd9593cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:19.290516 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e87659-d58a-4fb6-a978-485fcd9593cf admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:19.290812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e87659-d58a-4fb6-a978-485fcd9593cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:19.291091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e87659-d58a-4fb6-a978-485fcd9593cf admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:19.291799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e87659-d58a-4fb6-a978-485fcd9593cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:03:19.292112 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e87659-d58a-4fb6-a978-485fcd9593cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:19.294917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e87659-d58a-4fb6-a978-485fcd9593cf admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:19.308225 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1169/2317] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:03:19.313039 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4c1c4-723e-4a25-9d18-63efa81a232b None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:19.325050 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4c1c4-723e-4a25-9d18-63efa81a232b None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:19.331895 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40daec92-0ced-4b25-89ff-c5e6ea0f9a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:19.333011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daec92-0ced-4b25-89ff-c5e6ea0f9a79 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:19.333470 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daec92-0ced-4b25-89ff-c5e6ea0f9a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:19.333930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daec92-0ced-4b25-89ff-c5e6ea0f9a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:19.334853 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40daec92-0ced-4b25-89ff-c5e6ea0f9a79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:19.337781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40daec92-0ced-4b25-89ff-c5e6ea0f9a79 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:19.401100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:19.416948 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1149/2318] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:03:19 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:03:19.418990 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e87659-d58a-4fb6-a978-485fcd9593cf admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:19.434442 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e87659-d58a-4fb6-a978-485fcd9593cf admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:19.439491 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:19.511907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911d63b-5b8e-4825-91ca-f76453be3a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:19.512763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911d63b-5b8e-4825-91ca-f76453be3a2f admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:19.513123 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911d63b-5b8e-4825-91ca-f76453be3a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:19.513482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911d63b-5b8e-4825-91ca-f76453be3a2f admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:19.514273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911d63b-5b8e-4825-91ca-f76453be3a2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:19.516490 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911d63b-5b8e-4825-91ca-f76453be3a2f admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:19.823160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1170/2319] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:03:19 2022] POST /identity/v3/users => generated 287 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:03:19.828168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40daec92-0ced-4b25-89ff-c5e6ea0f9a79 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:19.839320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40daec92-0ced-4b25-89ff-c5e6ea0f9a79 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:19.845235 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788183b7-8fa8-4ce3-ba50-1374ad2b128b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:19.845955 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788183b7-8fa8-4ce3-ba50-1374ad2b128b admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:19.846313 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788183b7-8fa8-4ce3-ba50-1374ad2b128b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:19.864289 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788183b7-8fa8-4ce3-ba50-1374ad2b128b admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:19.864289 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788183b7-8fa8-4ce3-ba50-1374ad2b128b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:19.865733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788183b7-8fa8-4ce3-ba50-1374ad2b128b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:19.908369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1150/2320] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:03:19.912942 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911d63b-5b8e-4825-91ca-f76453be3a2f admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:19.923634 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911d63b-5b8e-4825-91ca-f76453be3a2f admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:19.929205 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47eed73-4a8b-4cae-aaa7-030398059235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:19.930061 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47eed73-4a8b-4cae-aaa7-030398059235 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:19.930541 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47eed73-4a8b-4cae-aaa7-030398059235 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:19.930979 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47eed73-4a8b-4cae-aaa7-030398059235 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:19.932014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47eed73-4a8b-4cae-aaa7-030398059235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:19.933853 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47eed73-4a8b-4cae-aaa7-030398059235 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:19.949386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1171/2321] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:03:19.953416 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788183b7-8fa8-4ce3-ba50-1374ad2b128b admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:19.977365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788183b7-8fa8-4ce3-ba50-1374ad2b128b admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:19.995263 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9dcfb-c24a-4f72-bbf3-f18de22ed211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:19.996456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9dcfb-c24a-4f72-bbf3-f18de22ed211 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:19.996960 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9dcfb-c24a-4f72-bbf3-f18de22ed211 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:19.997478 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9dcfb-c24a-4f72-bbf3-f18de22ed211 admin admin] PATH_INFO: `/v3/projects/1a51f592a9bb45249dc1db56d328fb1f/users/d55973a68db34057b5dc4edde84e9a9a/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:20.026576 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9dcfb-c24a-4f72-bbf3-f18de22ed211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a51f592a9bb45249dc1db56d328fb1f, user_id=d55973a68db34057b5dc4edde84e9a9a, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:20.030533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9dcfb-c24a-4f72-bbf3-f18de22ed211 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:20.177989 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1151/2322] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:03:19 2022] PUT /identity/v3/projects/1a51f592a9bb45249dc1db56d328fb1f/users/d55973a68db34057b5dc4edde84e9a9a/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:03:20.185008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382d61c-ec36-40cc-8f83-3587fbe358c8 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:20.185008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382d61c-ec36-40cc-8f83-3587fbe358c8 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:20.185008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382d61c-ec36-40cc-8f83-3587fbe358c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:20.228402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-f382d61c-ec36-40cc-8f83-3587fbe358c8 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:20.230169 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-f382d61c-ec36-40cc-8f83-3587fbe358c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:20.312508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1172/2323] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:03:20.327878 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9dcfb-c24a-4f72-bbf3-f18de22ed211 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:20.332859 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-86a9dcfb-c24a-4f72-bbf3-f18de22ed211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:20.416699 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9dcfb-c24a-4f72-bbf3-f18de22ed211 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:20.421471 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6bbcf-7cb0-4ee9-9e37-1e472286f6cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:20.422170 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6bbcf-7cb0-4ee9-9e37-1e472286f6cc service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:20.422605 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6bbcf-7cb0-4ee9-9e37-1e472286f6cc service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:20.422899 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6bbcf-7cb0-4ee9-9e37-1e472286f6cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:20.440871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6bbcf-7cb0-4ee9-9e37-1e472286f6cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:20.442921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6bbcf-7cb0-4ee9-9e37-1e472286f6cc service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:20.457215 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1152/2324] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:03:28.397332 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24029dfd-b098-4c56-b6be-93021910a341 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:28.397878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24029dfd-b098-4c56-b6be-93021910a341 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:28.397959 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24029dfd-b098-4c56-b6be-93021910a341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:28.441069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-24029dfd-b098-4c56-b6be-93021910a341 None None] MFA Rules not processed for user `d55973a68db34057b5dc4edde84e9a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:28.443243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-24029dfd-b098-4c56-b6be-93021910a341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:28.532513 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1173/2325] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:03:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:03:28.535914 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6bbcf-7cb0-4ee9-9e37-1e472286f6cc service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:28.550100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6bbcf-7cb0-4ee9-9e37-1e472286f6cc service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:28.567860 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b4af0-860e-4d80-9876-d68a039d4114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:28.568511 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b4af0-860e-4d80-9876-d68a039d4114 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:28.571820 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b4af0-860e-4d80-9876-d68a039d4114 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:28.571820 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b4af0-860e-4d80-9876-d68a039d4114 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:28.571820 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b4af0-860e-4d80-9876-d68a039d4114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:28.572548 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b4af0-860e-4d80-9876-d68a039d4114 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:28.735904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1153/2326] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:03:28 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:03:28.742679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24029dfd-b098-4c56-b6be-93021910a341 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:28.756305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24029dfd-b098-4c56-b6be-93021910a341 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:28.772968 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:28.915163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84aca4-b0ed-413e-8383-245174f61ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:28.917551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84aca4-b0ed-413e-8383-245174f61ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:28.920382 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84aca4-b0ed-413e-8383-245174f61ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:28.921117 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84aca4-b0ed-413e-8383-245174f61ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:28.922066 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84aca4-b0ed-413e-8383-245174f61ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:28.924270 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84aca4-b0ed-413e-8383-245174f61ac8 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:29.054157 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1174/2327] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:03:28 2022] POST /identity/v3/users => generated 293 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:03:29.054680 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b4af0-860e-4d80-9876-d68a039d4114 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:29.071241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b4af0-860e-4d80-9876-d68a039d4114 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:29.076699 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f2540-4762-4bc6-8cac-2c65ff10b50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:29.077371 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f2540-4762-4bc6-8cac-2c65ff10b50e admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:29.077681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f2540-4762-4bc6-8cac-2c65ff10b50e admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:29.077969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f2540-4762-4bc6-8cac-2c65ff10b50e admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:29.078728 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f2540-4762-4bc6-8cac-2c65ff10b50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:29.080505 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f2540-4762-4bc6-8cac-2c65ff10b50e admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:29.099236 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1154/2328] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:03:29.105346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84aca4-b0ed-413e-8383-245174f61ac8 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:29.125545 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84aca4-b0ed-413e-8383-245174f61ac8 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:29.134055 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147d614-40ec-401f-ada6-95f66c91728f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:29.135949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147d614-40ec-401f-ada6-95f66c91728f admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:29.136329 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147d614-40ec-401f-ada6-95f66c91728f admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:29.136852 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147d614-40ec-401f-ada6-95f66c91728f admin admin] PATH_INFO: `/v3/projects/81689181471846bea71711b297202991/users/ac8fcc211c2b4046831de49f9a143422/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:29.173800 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147d614-40ec-401f-ada6-95f66c91728f admin admin] RBAC: Authorizing `identity:create_grant(project_id=81689181471846bea71711b297202991, user_id=ac8fcc211c2b4046831de49f9a143422, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:29.176820 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147d614-40ec-401f-ada6-95f66c91728f admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:29.293780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1175/2329] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:03:29 2022] PUT /identity/v3/projects/81689181471846bea71711b297202991/users/ac8fcc211c2b4046831de49f9a143422/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:03:29.297897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f2540-4762-4bc6-8cac-2c65ff10b50e admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:29.320053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f2540-4762-4bc6-8cac-2c65ff10b50e admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:29.428457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f999f1-b1a0-4b77-8fb2-ff726a88f6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:29.429188 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f999f1-b1a0-4b77-8fb2-ff726a88f6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:29.429481 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f999f1-b1a0-4b77-8fb2-ff726a88f6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:29.429761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f999f1-b1a0-4b77-8fb2-ff726a88f6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:29.430968 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f999f1-b1a0-4b77-8fb2-ff726a88f6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:29.432655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f999f1-b1a0-4b77-8fb2-ff726a88f6d0 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:29.445116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1155/2330] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:03:29.457066 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147d614-40ec-401f-ada6-95f66c91728f admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:29.473574 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147d614-40ec-401f-ada6-95f66c91728f admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:29.486521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a89d0-45b5-4fdd-99b3-5df821fbcf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:29.487376 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a89d0-45b5-4fdd-99b3-5df821fbcf91 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:29.488123 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a89d0-45b5-4fdd-99b3-5df821fbcf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:29.488552 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a89d0-45b5-4fdd-99b3-5df821fbcf91 admin admin] PATH_INFO: `/v3/projects/81689181471846bea71711b297202991/users/ac8fcc211c2b4046831de49f9a143422/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:29.494890 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a89d0-45b5-4fdd-99b3-5df821fbcf91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81689181471846bea71711b297202991, user_id=ac8fcc211c2b4046831de49f9a143422, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:29.501163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a89d0-45b5-4fdd-99b3-5df821fbcf91 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:29.533896 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1176/2331] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:03:29 2022] PUT /identity/v3/projects/81689181471846bea71711b297202991/users/ac8fcc211c2b4046831de49f9a143422/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:03:36.703230 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908a340-f7de-4629-bbcd-047c24dbf493 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:36.703818 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908a340-f7de-4629-bbcd-047c24dbf493 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:36.703818 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908a340-f7de-4629-bbcd-047c24dbf493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:36.775234 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-3908a340-f7de-4629-bbcd-047c24dbf493 None None] MFA Rules not processed for user `ac8fcc211c2b4046831de49f9a143422`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:36.776484 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-3908a340-f7de-4629-bbcd-047c24dbf493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:36.837527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:36.891852 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1156/2332] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:03:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:03:36.909825 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a89d0-45b5-4fdd-99b3-5df821fbcf91 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:36.911944 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-299a89d0-45b5-4fdd-99b3-5df821fbcf91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:37.034147 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a89d0-45b5-4fdd-99b3-5df821fbcf91 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:37.040345 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d7e85-1aba-411a-a176-7e56de4099f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:37.041262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d7e85-1aba-411a-a176-7e56de4099f1 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:37.041818 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d7e85-1aba-411a-a176-7e56de4099f1 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:37.042417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d7e85-1aba-411a-a176-7e56de4099f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:37.125863 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d7e85-1aba-411a-a176-7e56de4099f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:37.127630 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d7e85-1aba-411a-a176-7e56de4099f1 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:37.141413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1177/2333] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:03:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:03:39.240876 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa2814-76a5-4f0c-b5bf-09d2fe9d9382 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:39.241516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa2814-76a5-4f0c-b5bf-09d2fe9d9382 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:39.241516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa2814-76a5-4f0c-b5bf-09d2fe9d9382 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:39.246797 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1157/2334] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jul 26 15:03:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:03:39.256028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3f7c3-d6a3-4b41-ad58-5b27507e8924 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:39.256544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3f7c3-d6a3-4b41-ad58-5b27507e8924 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:39.256652 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3f7c3-d6a3-4b41-ad58-5b27507e8924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:39.294838 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:39.300746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-ded3f7c3-d6a3-4b41-ad58-5b27507e8924 None None] MFA Rules not processed for user `d12fc26e640f4337b4a4da60cc4d9adc`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:39.303430 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ded3f7c3-d6a3-4b41-ad58-5b27507e8924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:39.318058 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1178/2335] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jul 26 15:03:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:03:39.330586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa2814-76a5-4f0c-b5bf-09d2fe9d9382 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:39.332931 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b3aa2814-76a5-4f0c-b5bf-09d2fe9d9382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:39.425399 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa2814-76a5-4f0c-b5bf-09d2fe9d9382 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:39.429606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97b7a6-8965-498c-8122-936d7b648a04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa31ecab10a6499f92da49bc7abb403a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:39.430282 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97b7a6-8965-498c-8122-936d7b648a04 service glance] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:39.430601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97b7a6-8965-498c-8122-936d7b648a04 service glance] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:39.430879 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97b7a6-8965-498c-8122-936d7b648a04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:39.444436 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97b7a6-8965-498c-8122-936d7b648a04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:39.446280 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97b7a6-8965-498c-8122-936d7b648a04 service glance] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:39.462870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1158/2336] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:03:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:03:39.840311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3438a-4d99-4d83-97cf-ea273a48fc61 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:39.840691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3438a-4d99-4d83-97cf-ea273a48fc61 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:39.841173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3438a-4d99-4d83-97cf-ea273a48fc61 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:39.842443 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1179/2337] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jul 26 15:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:03:39.848098 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2f00f-4354-4a7f-8f28-9bbd30b9ee7d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:39.848620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2f00f-4354-4a7f-8f28-9bbd30b9ee7d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:39.849224 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2f00f-4354-4a7f-8f28-9bbd30b9ee7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:39.879405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-36c2f00f-4354-4a7f-8f28-9bbd30b9ee7d None None] MFA Rules not processed for user `e71086ec00454e26b24337e0876bfe89`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:39.880693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-36c2f00f-4354-4a7f-8f28-9bbd30b9ee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:39.948451 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1159/2338] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jul 26 15:03:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:03:39.963991 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3438a-4d99-4d83-97cf-ea273a48fc61 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:39.965846 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-6eb3438a-4d99-4d83-97cf-ea273a48fc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:39.982260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3438a-4d99-4d83-97cf-ea273a48fc61 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:39.986017 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fd6cb-b239-49c0-8b30-f52b6547b948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:39.986705 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fd6cb-b239-49c0-8b30-f52b6547b948 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:39.986991 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fd6cb-b239-49c0-8b30-f52b6547b948 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:39.987269 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fd6cb-b239-49c0-8b30-f52b6547b948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:39.995654 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fd6cb-b239-49c0-8b30-f52b6547b948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:39.998019 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fd6cb-b239-49c0-8b30-f52b6547b948 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:40.008070 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1180/2339] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:03:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:03:40.114548 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c580728-b8b5-4102-b719-9bd53d949828 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:40.114966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c580728-b8b5-4102-b719-9bd53d949828 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:40.115233 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c580728-b8b5-4102-b719-9bd53d949828 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:40.117705 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1160/2340] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jul 26 15:03:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:03:40.123220 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020d814-2d2e-4265-a76c-02ba9d848ae8 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:40.123535 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020d814-2d2e-4265-a76c-02ba9d848ae8 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:40.124006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020d814-2d2e-4265-a76c-02ba9d848ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:40.147133 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-0020d814-2d2e-4265-a76c-02ba9d848ae8 None None] MFA Rules not processed for user `d12fc26e640f4337b4a4da60cc4d9adc`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:40.152177 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0020d814-2d2e-4265-a76c-02ba9d848ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:40.159016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1181/2341] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jul 26 15:03:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:03:40.170632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c580728-b8b5-4102-b719-9bd53d949828 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:40.182694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c580728-b8b5-4102-b719-9bd53d949828 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:40.186535 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e0e45-a5fd-4798-a24e-b5410f274a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:40.187156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e0e45-a5fd-4798-a24e-b5410f274a84 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:40.187439 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e0e45-a5fd-4798-a24e-b5410f274a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:40.187715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e0e45-a5fd-4798-a24e-b5410f274a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:40.199354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e0e45-a5fd-4798-a24e-b5410f274a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:40.200896 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e0e45-a5fd-4798-a24e-b5410f274a84 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:40.212696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1161/2342] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:03:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:03:40.356136 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c79423-b1c1-416f-b935-f1d453d33599 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:40.356637 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c79423-b1c1-416f-b935-f1d453d33599 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:40.357013 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c79423-b1c1-416f-b935-f1d453d33599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:40.385933 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-a3c79423-b1c1-416f-b935-f1d453d33599 None None] MFA Rules not processed for user `d55973a68db34057b5dc4edde84e9a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:40.386363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a3c79423-b1c1-416f-b935-f1d453d33599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:40.394038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1182/2343] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:03:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:03:41.557019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaa511-b147-4299-9f1d-f17a87575e78 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:41.557501 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaa511-b147-4299-9f1d-f17a87575e78 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:41.557697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaa511-b147-4299-9f1d-f17a87575e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:41.583641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-dbeaa511-b147-4299-9f1d-f17a87575e78 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:41.588467 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-dbeaa511-b147-4299-9f1d-f17a87575e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:41.645424 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:41.656654 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1162/2344] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 15:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:03:41.677936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c79423-b1c1-416f-b935-f1d453d33599 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:41.694037 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c79423-b1c1-416f-b935-f1d453d33599 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:41.700585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468369a1-52a9-4b7d-ae36-ab64c54d898e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:41.701085 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468369a1-52a9-4b7d-ae36-ab64c54d898e service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:41.701540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468369a1-52a9-4b7d-ae36-ab64c54d898e service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:41.701822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468369a1-52a9-4b7d-ae36-ab64c54d898e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:41.711886 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468369a1-52a9-4b7d-ae36-ab64c54d898e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:41.713730 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468369a1-52a9-4b7d-ae36-ab64c54d898e service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:41.728194 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1183/2345] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:03:46.427203 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7169a8-dde4-4d08-adc3-c4661ac5850b None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:46.427785 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7169a8-dde4-4d08-adc3-c4661ac5850b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:46.427785 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7169a8-dde4-4d08-adc3-c4661ac5850b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:46.455689 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-0d7169a8-dde4-4d08-adc3-c4661ac5850b None None] MFA Rules not processed for user `0834be7405cd4c968763099251d37154`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:46.457230 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-0d7169a8-dde4-4d08-adc3-c4661ac5850b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:46.534507 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1163/2346] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jul 26 15:03:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:03:46.556029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468369a1-52a9-4b7d-ae36-ab64c54d898e service nova] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:46.557593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-468369a1-52a9-4b7d-ae36-ab64c54d898e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:46.680798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468369a1-52a9-4b7d-ae36-ab64c54d898e service nova] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:46.688050 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add40a8b-a513-48e1-beb0-377cfed684c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '462ecbb85c6b4a17a952fb74fa2de65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:46.694613 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add40a8b-a513-48e1-beb0-377cfed684c6 service swift] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:46.694613 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add40a8b-a513-48e1-beb0-377cfed684c6 service swift] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:46.694613 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add40a8b-a513-48e1-beb0-377cfed684c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:46.698214 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add40a8b-a513-48e1-beb0-377cfed684c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:46.699950 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add40a8b-a513-48e1-beb0-377cfed684c6 service swift] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:46.710835 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1184/2347] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jul 26 15:03:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:03:47.320656 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e435a8-237e-4572-b9f9-63f879df494d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:47.321026 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e435a8-237e-4572-b9f9-63f879df494d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:47.321570 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e435a8-237e-4572-b9f9-63f879df494d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:47.347036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-f5e435a8-237e-4572-b9f9-63f879df494d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:03:47.349478 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f5e435a8-237e-4572-b9f9-63f879df494d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:47.367044 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1164/2348] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 15:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:03:47.398989 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add40a8b-a513-48e1-beb0-377cfed684c6 service swift] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:03:47.400992 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-add40a8b-a513-48e1-beb0-377cfed684c6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:03:47.424003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add40a8b-a513-48e1-beb0-377cfed684c6 service swift] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:03:47.433487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06262d9-61a2-4def-a7c4-d62b800b52f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:03:47.434282 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06262d9-61a2-4def-a7c4-d62b800b52f8 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:03:47.434623 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06262d9-61a2-4def-a7c4-d62b800b52f8 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:03:47.434974 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06262d9-61a2-4def-a7c4-d62b800b52f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:03:47.448807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06262d9-61a2-4def-a7c4-d62b800b52f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:03:47.450459 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06262d9-61a2-4def-a7c4-d62b800b52f8 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:03:47.464449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1185/2349] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:03:57.340545 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=30 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:57.456106 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=57 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:19.933007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825bcbe-87f3-4b13-a479-becb8659e55d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:04:19.933636 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825bcbe-87f3-4b13-a479-becb8659e55d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:04:19.933636 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825bcbe-87f3-4b13-a479-becb8659e55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:04:19.953605 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-0825bcbe-87f3-4b13-a479-becb8659e55d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:04:19.954902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-0825bcbe-87f3-4b13-a479-becb8659e55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:04:19.964121 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1165/2350] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 15:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:04:20.001903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06262d9-61a2-4def-a7c4-d62b800b52f8 service nova] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:04:20.014124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06262d9-61a2-4def-a7c4-d62b800b52f8 service nova] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:04:20.020955 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942067a-a595-47e9-9b1b-9da0bf643d17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:04:20.021618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942067a-a595-47e9-9b1b-9da0bf643d17 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:04:20.021903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942067a-a595-47e9-9b1b-9da0bf643d17 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:04:20.022181 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942067a-a595-47e9-9b1b-9da0bf643d17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:04:20.031247 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942067a-a595-47e9-9b1b-9da0bf643d17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:04:20.032888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942067a-a595-47e9-9b1b-9da0bf643d17 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:04:20.043234 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1186/2351] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:04:20.256472 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c287e20-1c30-4166-a9bd-ff5527a5b9a5 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:04:20.258718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c287e20-1c30-4166-a9bd-ff5527a5b9a5 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:04:20.258718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c287e20-1c30-4166-a9bd-ff5527a5b9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:04:20.276951 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-9c287e20-1c30-4166-a9bd-ff5527a5b9a5 None None] MFA Rules not processed for user `d7dbcd204d864ad6914aca2c3594089c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:04:20.278144 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-9c287e20-1c30-4166-a9bd-ff5527a5b9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:04:20.335794 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1166/2352] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:04:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:04:20.521944 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f671a15-982a-4513-b905-0a66b28ab208 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:04:20.522475 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f671a15-982a-4513-b905-0a66b28ab208 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:04:20.522807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f671a15-982a-4513-b905-0a66b28ab208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:04:20.543398 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-4f671a15-982a-4513-b905-0a66b28ab208 None None] MFA Rules not processed for user `0834be7405cd4c968763099251d37154`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:04:20.544681 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4f671a15-982a-4513-b905-0a66b28ab208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:04:20.553010 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1187/2353] 10.222.0.86 () {58 vars in 967 bytes} [Tue Jul 26 15:04:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:04:20.579670 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c287e20-1c30-4166-a9bd-ff5527a5b9a5 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:04:20.593354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c287e20-1c30-4166-a9bd-ff5527a5b9a5 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:04:20.599198 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0805a-0141-4ee9-88f3-f31cfbfc9c1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '462ecbb85c6b4a17a952fb74fa2de65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:04:20.599846 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0805a-0141-4ee9-88f3-f31cfbfc9c1c service swift] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:04:20.600122 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0805a-0141-4ee9-88f3-f31cfbfc9c1c service swift] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:04:20.600662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0805a-0141-4ee9-88f3-f31cfbfc9c1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:04:20.611651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0805a-0141-4ee9-88f3-f31cfbfc9c1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:04:20.614686 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0805a-0141-4ee9-88f3-f31cfbfc9c1c service swift] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:04:20.624673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1167/2354] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jul 26 15:04:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 15:04:28.325201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544be8bd-23f6-48d3-ba6b-e00c6fe4cd91 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:04:28.325706 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544be8bd-23f6-48d3-ba6b-e00c6fe4cd91 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:04:28.325810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544be8bd-23f6-48d3-ba6b-e00c6fe4cd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:04:28.350958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-544be8bd-23f6-48d3-ba6b-e00c6fe4cd91 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:04:28.352154 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-544be8bd-23f6-48d3-ba6b-e00c6fe4cd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:04:28.361734 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1188/2355] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 15:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:04:28.386421 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0805a-0141-4ee9-88f3-f31cfbfc9c1c service swift] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:04:28.399344 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0805a-0141-4ee9-88f3-f31cfbfc9c1c service swift] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:04:28.405826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a650c3-3b13-4994-839f-0d1620502926 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:04:28.406655 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a650c3-3b13-4994-839f-0d1620502926 service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:04:28.406948 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a650c3-3b13-4994-839f-0d1620502926 service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:04:28.412690 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a650c3-3b13-4994-839f-0d1620502926 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:04:28.417253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a650c3-3b13-4994-839f-0d1620502926 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:04:28.419108 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a650c3-3b13-4994-839f-0d1620502926 service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:04:28.430150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1168/2356] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:04:32.891925 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544be8bd-23f6-48d3-ba6b-e00c6fe4cd91 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:04:32.902566 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544be8bd-23f6-48d3-ba6b-e00c6fe4cd91 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:04:32.906200 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265397b4-7028-4c94-84df-789dbe444923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:04:32.906776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265397b4-7028-4c94-84df-789dbe444923 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:04:32.907064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265397b4-7028-4c94-84df-789dbe444923 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:04:32.907345 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265397b4-7028-4c94-84df-789dbe444923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:04:32.909529 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-265397b4-7028-4c94-84df-789dbe444923 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:04:32.923673 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265397b4-7028-4c94-84df-789dbe444923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:04:32.925115 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265397b4-7028-4c94-84df-789dbe444923 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:04:32.936402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1189/2357] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:04:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:04:35.582448 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a650c3-3b13-4994-839f-0d1620502926 service nova] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:04:35.593594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a650c3-3b13-4994-839f-0d1620502926 service nova] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:04:35.597814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a7cbe-2340-4e9a-9f97-0690555811ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:04:35.598435 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a7cbe-2340-4e9a-9f97-0690555811ba service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:04:35.598791 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a7cbe-2340-4e9a-9f97-0690555811ba service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:04:35.599139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a7cbe-2340-4e9a-9f97-0690555811ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:04:35.610160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a7cbe-2340-4e9a-9f97-0690555811ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:04:35.611681 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a7cbe-2340-4e9a-9f97-0690555811ba service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:04:35.622736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1169/2358] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:04:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:04:35.708683 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda51930-3020-4b6c-ad11-76ae383096ff None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:04:35.709267 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda51930-3020-4b6c-ad11-76ae383096ff None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:04:35.709370 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda51930-3020-4b6c-ad11-76ae383096ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:04:35.728301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-eda51930-3020-4b6c-ad11-76ae383096ff None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:04:35.729500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-eda51930-3020-4b6c-ad11-76ae383096ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:04:35.737612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1190/2359] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 26 15:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:04:35.766640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a7cbe-2340-4e9a-9f97-0690555811ba service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:04:35.779534 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a7cbe-2340-4e9a-9f97-0690555811ba service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:04:35.784903 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dc9db-37df-4729-b96a-7e04153ebda3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:04:35.785523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dc9db-37df-4729-b96a-7e04153ebda3 service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:04:35.785805 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dc9db-37df-4729-b96a-7e04153ebda3 service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:04:35.786081 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dc9db-37df-4729-b96a-7e04153ebda3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:04:35.797913 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dc9db-37df-4729-b96a-7e04153ebda3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:04:35.797913 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dc9db-37df-4729-b96a-7e04153ebda3 service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:04:35.806237 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1170/2360] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:04:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:04:36.673729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda51930-3020-4b6c-ad11-76ae383096ff None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:04:36.689788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda51930-3020-4b6c-ad11-76ae383096ff None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:04:36.694359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f165e0-570c-4bd6-a202-f291dfdc3284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:04:36.695188 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f165e0-570c-4bd6-a202-f291dfdc3284 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:04:36.695474 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f165e0-570c-4bd6-a202-f291dfdc3284 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:04:36.695750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f165e0-570c-4bd6-a202-f291dfdc3284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:04:36.697584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-14f165e0-570c-4bd6-a202-f291dfdc3284 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:04:36.712541 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f165e0-570c-4bd6-a202-f291dfdc3284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:04:36.713985 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f165e0-570c-4bd6-a202-f291dfdc3284 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:04:36.727429 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1191/2361] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:04:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:04:41.834746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dc9db-37df-4729-b96a-7e04153ebda3 service nova] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:04:41.836137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-1b5dc9db-37df-4729-b96a-7e04153ebda3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:04:41.894419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dc9db-37df-4729-b96a-7e04153ebda3 service nova] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:04:41.897958 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65305aab-33eb-43c3-9918-174a7124803e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:04:41.898607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65305aab-33eb-43c3-9918-174a7124803e service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:04:41.898893 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65305aab-33eb-43c3-9918-174a7124803e service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:04:41.899171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65305aab-33eb-43c3-9918-174a7124803e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:04:41.900905 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-65305aab-33eb-43c3-9918-174a7124803e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:04:41.958435 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65305aab-33eb-43c3-9918-174a7124803e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:04:41.959880 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65305aab-33eb-43c3-9918-174a7124803e service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:04:41.964342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:41.969055 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1171/2362] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:04:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:04:46.130799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f165e0-570c-4bd6-a202-f291dfdc3284 service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:04:46.142019 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f165e0-570c-4bd6-a202-f291dfdc3284 service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:04:46.147465 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93064b-8092-4d53-9f2f-6d217755499f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:04:46.148069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93064b-8092-4d53-9f2f-6d217755499f service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:04:46.148353 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93064b-8092-4d53-9f2f-6d217755499f service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:04:46.148631 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93064b-8092-4d53-9f2f-6d217755499f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:04:46.150407 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-1c93064b-8092-4d53-9f2f-6d217755499f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:04:46.208889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93064b-8092-4d53-9f2f-6d217755499f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:04:46.210415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93064b-8092-4d53-9f2f-6d217755499f service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:04:46.219919 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1192/2363] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:04:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:04:56.215308 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=55 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:04.922297 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65305aab-33eb-43c3-9918-174a7124803e service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:05:04.931860 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65305aab-33eb-43c3-9918-174a7124803e service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:05:04.935609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe81dd4-eefc-4007-bf0d-bc8eced3a155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:05:04.936930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe81dd4-eefc-4007-bf0d-bc8eced3a155 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:05:04.937211 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe81dd4-eefc-4007-bf0d-bc8eced3a155 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:05:04.937764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe81dd4-eefc-4007-bf0d-bc8eced3a155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:05:04.939678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-cfe81dd4-eefc-4007-bf0d-bc8eced3a155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:05:04.949830 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe81dd4-eefc-4007-bf0d-bc8eced3a155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:05:04.951365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe81dd4-eefc-4007-bf0d-bc8eced3a155 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:05:04.959370 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1172/2364] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:05:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:05:07.577505 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca673f70-891a-4752-906a-848d11ffe973 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:05:07.578037 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca673f70-891a-4752-906a-848d11ffe973 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:05:07.578219 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca673f70-891a-4752-906a-848d11ffe973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:05:07.598696 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-ca673f70-891a-4752-906a-848d11ffe973 None None] MFA Rules not processed for user `bda23788bfe8424aa5b24a6f4983d189`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:05:07.599924 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ca673f70-891a-4752-906a-848d11ffe973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:05:07.606948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1193/2365] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:05:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:05:14.955775 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=6 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:15.481815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe81dd4-eefc-4007-bf0d-bc8eced3a155 service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:05:15.496999 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe81dd4-eefc-4007-bf0d-bc8eced3a155 service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:05:15.505796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8cc27-de12-4531-8f8f-b23ad48a1844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:05:15.506598 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8cc27-de12-4531-8f8f-b23ad48a1844 service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:05:15.506958 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8cc27-de12-4531-8f8f-b23ad48a1844 service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:05:15.507308 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8cc27-de12-4531-8f8f-b23ad48a1844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:05:15.509250 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-72d8cc27-de12-4531-8f8f-b23ad48a1844 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:05:15.523018 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8cc27-de12-4531-8f8f-b23ad48a1844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:05:15.524733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8cc27-de12-4531-8f8f-b23ad48a1844 service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:05:15.537070 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1173/2366] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:05:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:05:17.592746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:21.288110 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca673f70-891a-4752-906a-848d11ffe973 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:05:21.289576 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ca673f70-891a-4752-906a-848d11ffe973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:05:21.305096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca673f70-891a-4752-906a-848d11ffe973 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:05:21.309844 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9f05a-c51f-4628-8898-a43ca67400e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:05:21.310461 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9f05a-c51f-4628-8898-a43ca67400e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:05:21.310751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9f05a-c51f-4628-8898-a43ca67400e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:05:21.311031 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9f05a-c51f-4628-8898-a43ca67400e0 admin admin] PATH_INFO: `/v3/users/b537d1da4fc34421a2c2c97f06517e35` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:05:21.312230 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9f05a-c51f-4628-8898-a43ca67400e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b537d1da4fc34421a2c2c97f06517e35)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:05:21.314191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9f05a-c51f-4628-8898-a43ca67400e0 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:05:21.580500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-50b9f05a-c51f-4628-8898-a43ca67400e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b537d1da4fc34421a2c2c97f06517e35'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:05:21.581065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-50b9f05a-c51f-4628-8898-a43ca67400e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b537d1da4fc34421a2c2c97f06517e35'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:05:21.598143 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-50b9f05a-c51f-4628-8898-a43ca67400e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b537d1da4fc34421a2c2c97f06517e35'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:05:21.693763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-50b9f05a-c51f-4628-8898-a43ca67400e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b537d1da4fc34421a2c2c97f06517e35'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:05:21.694408 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-50b9f05a-c51f-4628-8898-a43ca67400e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b537d1da4fc34421a2c2c97f06517e35'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:05:21.707508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1194/2367] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:05:21 2022] DELETE /identity/v3/users/b537d1da4fc34421a2c2c97f06517e35 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:05:22.086553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8cc27-de12-4531-8f8f-b23ad48a1844 service nova] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:05:22.097331 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8cc27-de12-4531-8f8f-b23ad48a1844 service nova] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:05:22.157318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2936b4-68c8-4aec-9684-a3126a4bdfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:05:22.157974 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2936b4-68c8-4aec-9684-a3126a4bdfaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:05:22.158262 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2936b4-68c8-4aec-9684-a3126a4bdfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:05:22.158581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2936b4-68c8-4aec-9684-a3126a4bdfaa admin admin] PATH_INFO: `/v3/projects/61a61a49f1674f3f8c86b879e5a15d12` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:05:22.159747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2936b4-68c8-4aec-9684-a3126a4bdfaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=61a61a49f1674f3f8c86b879e5a15d12)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:05:22.161692 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2936b4-68c8-4aec-9684-a3126a4bdfaa admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:05:22.278200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6c2936b4-68c8-4aec-9684-a3126a4bdfaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61a61a49f1674f3f8c86b879e5a15d12', 'request_id': 'req-6c2936b4-68c8-4aec-9684-a3126a4bdfaa'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:05:22.284719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6c2936b4-68c8-4aec-9684-a3126a4bdfaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61a61a49f1674f3f8c86b879e5a15d12', 'request_id': 'req-6c2936b4-68c8-4aec-9684-a3126a4bdfaa'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:05:22.392926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6c2936b4-68c8-4aec-9684-a3126a4bdfaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61a61a49f1674f3f8c86b879e5a15d12', 'request_id': 'req-6c2936b4-68c8-4aec-9684-a3126a4bdfaa'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:05:22.404343 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6c2936b4-68c8-4aec-9684-a3126a4bdfaa admin admin] The token cache is being invalidate because project 61a61a49f1674f3f8c86b879e5a15d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:05:22.404631 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6c2936b4-68c8-4aec-9684-a3126a4bdfaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:05:22.405251 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6c2936b4-68c8-4aec-9684-a3126a4bdfaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:05:22.406974 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1174/2368] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:05:22 2022] DELETE /identity/v3/projects/61a61a49f1674f3f8c86b879e5a15d12 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:05:31.703634 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:32.401001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:39.256916 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9f05a-c51f-4628-8898-a43ca67400e0 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:05:39.261891 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-50b9f05a-c51f-4628-8898-a43ca67400e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:05:39.332109 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9f05a-c51f-4628-8898-a43ca67400e0 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:05:39.395722 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82ec4f-64c3-40e7-b4c7-39057f5c5b12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:05:39.397123 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82ec4f-64c3-40e7-b4c7-39057f5c5b12 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:05:39.397584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82ec4f-64c3-40e7-b4c7-39057f5c5b12 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:05:39.398035 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82ec4f-64c3-40e7-b4c7-39057f5c5b12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:05:39.399836 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-1b82ec4f-64c3-40e7-b4c7-39057f5c5b12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:05:39.457005 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82ec4f-64c3-40e7-b4c7-39057f5c5b12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:05:39.458687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82ec4f-64c3-40e7-b4c7-39057f5c5b12 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:05:39.468208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1195/2369] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:05:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:05:49.463975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=84 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:50.458129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e55abb-aca1-4453-89f2-a2d8d4858b30 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:05:50.459177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e55abb-aca1-4453-89f2-a2d8d4858b30 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:05:50.459177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e55abb-aca1-4453-89f2-a2d8d4858b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:05:50.478538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-80e55abb-aca1-4453-89f2-a2d8d4858b30 None None] MFA Rules not processed for user `5cd44ebc6bf442bca1e68c8b0fa94f00`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:05:50.479775 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-80e55abb-aca1-4453-89f2-a2d8d4858b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:05:50.487329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1175/2370] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:05:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:05:50.791789 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82ec4f-64c3-40e7-b4c7-39057f5c5b12 service nova] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:05:50.793249 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-1b82ec4f-64c3-40e7-b4c7-39057f5c5b12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:05:50.849902 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82ec4f-64c3-40e7-b4c7-39057f5c5b12 service nova] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:05:50.853546 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e53b2-4c5b-4827-a0db-2c6f08a72a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:05:50.854167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e53b2-4c5b-4827-a0db-2c6f08a72a6a service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:05:50.854484 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e53b2-4c5b-4827-a0db-2c6f08a72a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:05:50.854769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e53b2-4c5b-4827-a0db-2c6f08a72a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:05:50.856519 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-da8e53b2-4c5b-4827-a0db-2c6f08a72a6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:05:50.866108 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e53b2-4c5b-4827-a0db-2c6f08a72a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:05:50.867578 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e53b2-4c5b-4827-a0db-2c6f08a72a6a service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:05:50.875729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1196/2371] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:05:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:05:51.312322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e55abb-aca1-4453-89f2-a2d8d4858b30 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:05:51.313759 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-80e55abb-aca1-4453-89f2-a2d8d4858b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:05:51.387966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e55abb-aca1-4453-89f2-a2d8d4858b30 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:05:51.393038 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e2352-66ad-4fe8-b448-1578fde4d633 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fab620bc5d044479746d8ea17615a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:05:51.393660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e2352-66ad-4fe8-b448-1578fde4d633 service placement] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:05:51.393944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e2352-66ad-4fe8-b448-1578fde4d633 service placement] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:05:51.394224 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e2352-66ad-4fe8-b448-1578fde4d633 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:05:51.396043 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-bf6e2352-66ad-4fe8-b448-1578fde4d633 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:05:51.408161 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e2352-66ad-4fe8-b448-1578fde4d633 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:05:51.409755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e2352-66ad-4fe8-b448-1578fde4d633 service placement] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:05:51.419521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1176/2372] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:05:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:06:00.872207 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=26 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:01.415359 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=35 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:03.976149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e53b2-4c5b-4827-a0db-2c6f08a72a6a service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:06:03.977708 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-da8e53b2-4c5b-4827-a0db-2c6f08a72a6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:06:03.993412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e53b2-4c5b-4827-a0db-2c6f08a72a6a service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:06:03.998864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ef536-e33d-44fa-a020-e121cb575dff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:06:03.999499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ef536-e33d-44fa-a020-e121cb575dff service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:03.999782 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ef536-e33d-44fa-a020-e121cb575dff service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:04.000056 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ef536-e33d-44fa-a020-e121cb575dff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:04.001766 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-060ef536-e33d-44fa-a020-e121cb575dff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:06:04.014204 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ef536-e33d-44fa-a020-e121cb575dff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:06:04.015814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ef536-e33d-44fa-a020-e121cb575dff service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:06:04.026114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1197/2373] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:06:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:06:07.964810 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e2352-66ad-4fe8-b448-1578fde4d633 service placement] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:06:07.966762 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-bf6e2352-66ad-4fe8-b448-1578fde4d633 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:06:07.981908 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e2352-66ad-4fe8-b448-1578fde4d633 service placement] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:06:07.987640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adc664-75dd-426e-b5f1-e6739d0a4d96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:06:07.988264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adc664-75dd-426e-b5f1-e6739d0a4d96 service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:07.988547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adc664-75dd-426e-b5f1-e6739d0a4d96 service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:07.988826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adc664-75dd-426e-b5f1-e6739d0a4d96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:07.990629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-a5adc664-75dd-426e-b5f1-e6739d0a4d96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:06:08.003615 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5adc664-75dd-426e-b5f1-e6739d0a4d96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:06:08.005201 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5adc664-75dd-426e-b5f1-e6739d0a4d96 service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:06:08.016757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1177/2374] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:06:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:06:14.021844 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=6 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:18.012018 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=6 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:22.742496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ef536-e33d-44fa-a020-e121cb575dff service nova] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:06:22.753540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ef536-e33d-44fa-a020-e121cb575dff service nova] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:06:22.759480 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3391b-0bcd-41cf-af6a-8b54f2cc600d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:06:22.760114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3391b-0bcd-41cf-af6a-8b54f2cc600d service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:22.760399 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3391b-0bcd-41cf-af6a-8b54f2cc600d service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:22.760678 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3391b-0bcd-41cf-af6a-8b54f2cc600d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:22.762412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d8d3391b-0bcd-41cf-af6a-8b54f2cc600d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:06:22.820953 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3391b-0bcd-41cf-af6a-8b54f2cc600d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:06:22.822583 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3391b-0bcd-41cf-af6a-8b54f2cc600d service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:06:22.831534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1198/2375] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:06:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:06:32.827432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=28 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:37.043515 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfcbb1-2d98-4f26-974e-c1a4895320b0 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:37.044074 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfcbb1-2d98-4f26-974e-c1a4895320b0 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:37.044074 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfcbb1-2d98-4f26-974e-c1a4895320b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:37.063399 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-eebfcbb1-2d98-4f26-974e-c1a4895320b0 None None] MFA Rules not processed for user `23f8fb537ff1459b8061b78f689b56fb`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:06:37.064734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-eebfcbb1-2d98-4f26-974e-c1a4895320b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:06:37.137894 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1178/2376] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:06:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:06:37.443576 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3391b-0bcd-41cf-af6a-8b54f2cc600d service nova] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:06:37.445565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d8d3391b-0bcd-41cf-af6a-8b54f2cc600d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:06:37.456807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3391b-0bcd-41cf-af6a-8b54f2cc600d service nova] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:06:37.460324 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb6779-92b6-41d8-b262-a09b83b906e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:06:37.460926 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb6779-92b6-41d8-b262-a09b83b906e5 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:37.461207 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb6779-92b6-41d8-b262-a09b83b906e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:37.461485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb6779-92b6-41d8-b262-a09b83b906e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:37.463167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-98bb6779-92b6-41d8-b262-a09b83b906e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:06:37.472404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb6779-92b6-41d8-b262-a09b83b906e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:06:37.473815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb6779-92b6-41d8-b262-a09b83b906e5 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:06:37.482494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1199/2377] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:06:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:06:45.854449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e773e-0e50-44f2-bead-6982334b6711 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:45.855005 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e773e-0e50-44f2-bead-6982334b6711 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:45.855005 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e773e-0e50-44f2-bead-6982334b6711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:45.874286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-1b6e773e-0e50-44f2-bead-6982334b6711 None None] MFA Rules not processed for user `d7dbcd204d864ad6914aca2c3594089c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:06:45.875528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-1b6e773e-0e50-44f2-bead-6982334b6711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:06:45.882425 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1179/2378] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:06:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:06:47.478730 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=6 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:48.614562 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb6779-92b6-41d8-b262-a09b83b906e5 service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:06:48.628055 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb6779-92b6-41d8-b262-a09b83b906e5 service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:06:48.633552 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b5738-0b05-4cb7-82bf-d9109f3a9a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:06:48.634647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5738-0b05-4cb7-82bf-d9109f3a9a2b service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:48.635150 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5738-0b05-4cb7-82bf-d9109f3a9a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:48.635607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5738-0b05-4cb7-82bf-d9109f3a9a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:48.637814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-9f5b5738-0b05-4cb7-82bf-d9109f3a9a2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:06:48.711381 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b5738-0b05-4cb7-82bf-d9109f3a9a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:06:48.712991 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b5738-0b05-4cb7-82bf-d9109f3a9a2b service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:06:48.723257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1200/2379] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:06:54.376837 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e773e-0e50-44f2-bead-6982334b6711 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:06:54.378329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-1b6e773e-0e50-44f2-bead-6982334b6711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:06:54.393442 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e773e-0e50-44f2-bead-6982334b6711 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:06:54.399110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e13fdd-7b6b-4b28-abe2-05c9160920e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fab620bc5d044479746d8ea17615a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:06:54.399730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e13fdd-7b6b-4b28-abe2-05c9160920e4 service placement] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:54.400010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e13fdd-7b6b-4b28-abe2-05c9160920e4 service placement] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:54.400290 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e13fdd-7b6b-4b28-abe2-05c9160920e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:54.402010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e6e13fdd-7b6b-4b28-abe2-05c9160920e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:06:54.414611 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e13fdd-7b6b-4b28-abe2-05c9160920e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:06:54.416181 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e13fdd-7b6b-4b28-abe2-05c9160920e4 service placement] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:06:54.426999 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1180/2380] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:06:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:06:54.527186 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b5738-0b05-4cb7-82bf-d9109f3a9a2b service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:06:54.528626 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-9f5b5738-0b05-4cb7-82bf-d9109f3a9a2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:06:54.542166 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b5738-0b05-4cb7-82bf-d9109f3a9a2b service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:06:54.546863 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59396e8-738c-4962-a189-e4f06b519bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:06:54.550928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59396e8-738c-4962-a189-e4f06b519bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:54.550928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59396e8-738c-4962-a189-e4f06b519bec admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:54.550928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59396e8-738c-4962-a189-e4f06b519bec admin admin] PATH_INFO: `/v3/users/bda23788bfe8424aa5b24a6f4983d189` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:54.550928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59396e8-738c-4962-a189-e4f06b519bec admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda23788bfe8424aa5b24a6f4983d189)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:06:54.551383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59396e8-738c-4962-a189-e4f06b519bec admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:06:54.807691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a59396e8-738c-4962-a189-e4f06b519bec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda23788bfe8424aa5b24a6f4983d189'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:06:54.808903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a59396e8-738c-4962-a189-e4f06b519bec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda23788bfe8424aa5b24a6f4983d189'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:06:54.832504 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a59396e8-738c-4962-a189-e4f06b519bec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda23788bfe8424aa5b24a6f4983d189'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:06:54.919402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a59396e8-738c-4962-a189-e4f06b519bec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda23788bfe8424aa5b24a6f4983d189'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:06:54.920120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a59396e8-738c-4962-a189-e4f06b519bec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda23788bfe8424aa5b24a6f4983d189'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:06:54.933753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1201/2381] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:06:54 2022] DELETE /identity/v3/users/bda23788bfe8424aa5b24a6f4983d189 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:06:55.266949 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e13fdd-7b6b-4b28-abe2-05c9160920e4 service placement] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:06:55.279594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e13fdd-7b6b-4b28-abe2-05c9160920e4 service placement] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:06:55.349920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3310115-40f5-420e-b1c4-0a341367196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:06:55.350688 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3310115-40f5-420e-b1c4-0a341367196f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:55.350975 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3310115-40f5-420e-b1c4-0a341367196f admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:55.351288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3310115-40f5-420e-b1c4-0a341367196f admin admin] PATH_INFO: `/v3/projects/9074a12481df4e6eb5a600be17bd4984` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:55.352453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3310115-40f5-420e-b1c4-0a341367196f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9074a12481df4e6eb5a600be17bd4984)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:06:55.354453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3310115-40f5-420e-b1c4-0a341367196f admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:06:55.523978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-e3310115-40f5-420e-b1c4-0a341367196f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9074a12481df4e6eb5a600be17bd4984', 'request_id': 'req-e3310115-40f5-420e-b1c4-0a341367196f'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:06:55.534010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-e3310115-40f5-420e-b1c4-0a341367196f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9074a12481df4e6eb5a600be17bd4984', 'request_id': 'req-e3310115-40f5-420e-b1c4-0a341367196f'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:06:55.622422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-e3310115-40f5-420e-b1c4-0a341367196f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9074a12481df4e6eb5a600be17bd4984', 'request_id': 'req-e3310115-40f5-420e-b1c4-0a341367196f'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:06:55.635087 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-e3310115-40f5-420e-b1c4-0a341367196f admin admin] The token cache is being invalidate because project 9074a12481df4e6eb5a600be17bd4984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:06:55.635383 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-e3310115-40f5-420e-b1c4-0a341367196f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:06:55.636038 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-e3310115-40f5-420e-b1c4-0a341367196f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:06:55.637732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1181/2382] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:06:55 2022] DELETE /identity/v3/projects/9074a12481df4e6eb5a600be17bd4984 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:06:55.644258 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b78b3-c260-4574-9c3f-4a0a549aec17 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:55.644734 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b78b3-c260-4574-9c3f-4a0a549aec17 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:55.644977 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b78b3-c260-4574-9c3f-4a0a549aec17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:55.666066 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-226b78b3-c260-4574-9c3f-4a0a549aec17 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:06:55.667323 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-226b78b3-c260-4574-9c3f-4a0a549aec17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:06:55.728796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1202/2383] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:06:55.737042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc5707-6fbe-4c90-a4a4-da6c76943737 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:55.741730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc5707-6fbe-4c90-a4a4-da6c76943737 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:55.741730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc5707-6fbe-4c90-a4a4-da6c76943737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:55.760634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-f1cc5707-6fbe-4c90-a4a4-da6c76943737 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:06:55.761855 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f1cc5707-6fbe-4c90-a4a4-da6c76943737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:06:55.770127 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1182/2384] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:06:55.775594 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b78b3-c260-4574-9c3f-4a0a549aec17 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:06:55.784917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b78b3-c260-4574-9c3f-4a0a549aec17 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:06:55.790041 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f318f9-aef1-468b-b8c3-d1a6698ce445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:06:55.790690 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f318f9-aef1-468b-b8c3-d1a6698ce445 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:55.790982 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f318f9-aef1-468b-b8c3-d1a6698ce445 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:55.791263 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f318f9-aef1-468b-b8c3-d1a6698ce445 admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:55.791968 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f318f9-aef1-468b-b8c3-d1a6698ce445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:06:55.792490 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f318f9-aef1-468b-b8c3-d1a6698ce445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:06:55.794064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f318f9-aef1-468b-b8c3-d1a6698ce445 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:06:55.796400 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:55.808355 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1203/2385] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:06:55.812972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc5707-6fbe-4c90-a4a4-da6c76943737 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:06:55.823304 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc5707-6fbe-4c90-a4a4-da6c76943737 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:06:55.828157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766b7ab-2c49-4e1b-8827-8f70729ed842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:06:55.833793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766b7ab-2c49-4e1b-8827-8f70729ed842 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:55.833793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766b7ab-2c49-4e1b-8827-8f70729ed842 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:55.833793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766b7ab-2c49-4e1b-8827-8f70729ed842 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:55.833793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766b7ab-2c49-4e1b-8827-8f70729ed842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:06:55.833793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766b7ab-2c49-4e1b-8827-8f70729ed842 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:06:55.838342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:55.917417 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1183/2386] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:06:55 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:06:55.927113 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f318f9-aef1-468b-b8c3-d1a6698ce445 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:06:55.945065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f318f9-aef1-468b-b8c3-d1a6698ce445 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:06:56.020924 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b67217-d519-420f-9447-38ba53ffd8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:06:56.021646 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67217-d519-420f-9447-38ba53ffd8b9 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:56.022117 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67217-d519-420f-9447-38ba53ffd8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:56.022530 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67217-d519-420f-9447-38ba53ffd8b9 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:56.023283 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b67217-d519-420f-9447-38ba53ffd8b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:06:56.025294 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b67217-d519-420f-9447-38ba53ffd8b9 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:06:56.125663 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1204/2387] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:06:55 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:06:56.127035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766b7ab-2c49-4e1b-8827-8f70729ed842 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:06:56.138406 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766b7ab-2c49-4e1b-8827-8f70729ed842 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:06:56.145097 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124a41a-f533-45a2-9d35-67f518baa74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:06:56.145342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124a41a-f533-45a2-9d35-67f518baa74f admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:56.145626 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124a41a-f533-45a2-9d35-67f518baa74f admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:56.145901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124a41a-f533-45a2-9d35-67f518baa74f admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:56.146634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124a41a-f533-45a2-9d35-67f518baa74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:06:56.148549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124a41a-f533-45a2-9d35-67f518baa74f admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:06:56.170327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1184/2388] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:06:56.171891 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b67217-d519-420f-9447-38ba53ffd8b9 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:06:56.183703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b67217-d519-420f-9447-38ba53ffd8b9 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:06:56.189693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf66772-26fd-4580-862e-526dfdbc6d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:06:56.189693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf66772-26fd-4580-862e-526dfdbc6d25 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:56.189693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf66772-26fd-4580-862e-526dfdbc6d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:56.190049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf66772-26fd-4580-862e-526dfdbc6d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:56.190782 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf66772-26fd-4580-862e-526dfdbc6d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:06:56.192327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf66772-26fd-4580-862e-526dfdbc6d25 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:06:56.210686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1205/2389] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:06:56.216296 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124a41a-f533-45a2-9d35-67f518baa74f admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:06:56.227748 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124a41a-f533-45a2-9d35-67f518baa74f admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:06:56.232842 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3000e-31ad-4f9f-8369-2e028dda3e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:06:56.233533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3000e-31ad-4f9f-8369-2e028dda3e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:56.233818 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3000e-31ad-4f9f-8369-2e028dda3e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:56.234097 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3000e-31ad-4f9f-8369-2e028dda3e59 admin admin] PATH_INFO: `/v3/projects/2b83f7abfe2449f7aa34cd10ff578207/users/247a43c1e70e4fcab45d4c6dba0a33a7/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:56.250483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3000e-31ad-4f9f-8369-2e028dda3e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b83f7abfe2449f7aa34cd10ff578207, user_id=247a43c1e70e4fcab45d4c6dba0a33a7, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:06:56.253362 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3000e-31ad-4f9f-8369-2e028dda3e59 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:06:56.361234 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1185/2390] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:06:56 2022] PUT /identity/v3/projects/2b83f7abfe2449f7aa34cd10ff578207/users/247a43c1e70e4fcab45d4c6dba0a33a7/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:06:56.373247 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306d98c-f6d1-42d4-8608-d6108baaceaa None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:56.373602 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306d98c-f6d1-42d4-8608-d6108baaceaa None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:56.373944 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306d98c-f6d1-42d4-8608-d6108baaceaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:56.408185 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-e306d98c-f6d1-42d4-8608-d6108baaceaa None None] MFA Rules not processed for user `247a43c1e70e4fcab45d4c6dba0a33a7`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:06:56.409475 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e306d98c-f6d1-42d4-8608-d6108baaceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:06:56.506587 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1206/2391] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:06:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:06:56.514356 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3000e-31ad-4f9f-8369-2e028dda3e59 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:06:56.517566 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-3fa3000e-31ad-4f9f-8369-2e028dda3e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:06:56.604431 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3000e-31ad-4f9f-8369-2e028dda3e59 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:06:56.610846 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb879a7-3de7-448d-91b9-c3e6c6c9f92d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:06:56.614571 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb879a7-3de7-448d-91b9-c3e6c6c9f92d service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:06:56.614571 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb879a7-3de7-448d-91b9-c3e6c6c9f92d service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:06:56.614571 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb879a7-3de7-448d-91b9-c3e6c6c9f92d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:06:56.622014 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb879a7-3de7-448d-91b9-c3e6c6c9f92d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:06:56.623772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb879a7-3de7-448d-91b9-c3e6c6c9f92d service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:06:56.633432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1186/2392] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:06:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:07:02.815225 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306d98c-f6d1-42d4-8608-d6108baaceaa None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:02.880281 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306d98c-f6d1-42d4-8608-d6108baaceaa None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:02.886377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234be3c-4c9f-4343-8fbe-7ba03f0673fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:02.886995 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234be3c-4c9f-4343-8fbe-7ba03f0673fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:02.887514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234be3c-4c9f-4343-8fbe-7ba03f0673fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:02.887636 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234be3c-4c9f-4343-8fbe-7ba03f0673fa admin admin] PATH_INFO: `/v3/users/247a43c1e70e4fcab45d4c6dba0a33a7` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:02.888845 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234be3c-4c9f-4343-8fbe-7ba03f0673fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=247a43c1e70e4fcab45d4c6dba0a33a7)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:02.890862 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234be3c-4c9f-4343-8fbe-7ba03f0673fa admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:02.893257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:03.059484 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c234be3c-4c9f-4343-8fbe-7ba03f0673fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247a43c1e70e4fcab45d4c6dba0a33a7'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:03.060338 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c234be3c-4c9f-4343-8fbe-7ba03f0673fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247a43c1e70e4fcab45d4c6dba0a33a7'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:03.072745 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c234be3c-4c9f-4343-8fbe-7ba03f0673fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247a43c1e70e4fcab45d4c6dba0a33a7'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:03.172223 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c234be3c-4c9f-4343-8fbe-7ba03f0673fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247a43c1e70e4fcab45d4c6dba0a33a7'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:03.173027 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c234be3c-4c9f-4343-8fbe-7ba03f0673fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247a43c1e70e4fcab45d4c6dba0a33a7'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:03.186838 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1207/2393] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:07:02 2022] DELETE /identity/v3/users/247a43c1e70e4fcab45d4c6dba0a33a7 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:03.191660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84709da-d9d6-488c-80d6-e653d1772f7e None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:03.192162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84709da-d9d6-488c-80d6-e653d1772f7e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:03.192274 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84709da-d9d6-488c-80d6-e653d1772f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:03.212926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-b84709da-d9d6-488c-80d6-e653d1772f7e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:03.214130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b84709da-d9d6-488c-80d6-e653d1772f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:03.276190 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1187/2394] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:07:03.287788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234be3c-4c9f-4343-8fbe-7ba03f0673fa admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:03.289326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c234be3c-4c9f-4343-8fbe-7ba03f0673fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:03.349572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234be3c-4c9f-4343-8fbe-7ba03f0673fa admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:03.353520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69992632-c30f-4ae2-8be1-d35685a4b52c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:03.354140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992632-c30f-4ae2-8be1-d35685a4b52c service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:03.354447 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992632-c30f-4ae2-8be1-d35685a4b52c service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:03.354713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992632-c30f-4ae2-8be1-d35685a4b52c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:03.364474 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69992632-c30f-4ae2-8be1-d35685a4b52c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:03.366544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69992632-c30f-4ae2-8be1-d35685a4b52c service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:03.376585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1208/2395] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:07:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:07:04.091332 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84709da-d9d6-488c-80d6-e653d1772f7e None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:04.093377 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b84709da-d9d6-488c-80d6-e653d1772f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:04.107726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84709da-d9d6-488c-80d6-e653d1772f7e None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:04.114551 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24924324-e06e-44b4-89af-d4806ba20afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:04.117729 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24924324-e06e-44b4-89af-d4806ba20afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:04.118112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24924324-e06e-44b4-89af-d4806ba20afa admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:04.118425 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24924324-e06e-44b4-89af-d4806ba20afa admin admin] PATH_INFO: `/v3/projects/2b83f7abfe2449f7aa34cd10ff578207` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:04.120308 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24924324-e06e-44b4-89af-d4806ba20afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b83f7abfe2449f7aa34cd10ff578207)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:04.122448 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24924324-e06e-44b4-89af-d4806ba20afa admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:04.220789 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:04.233384 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-24924324-e06e-44b4-89af-d4806ba20afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b83f7abfe2449f7aa34cd10ff578207', 'request_id': 'req-24924324-e06e-44b4-89af-d4806ba20afa'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:04.240372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-24924324-e06e-44b4-89af-d4806ba20afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b83f7abfe2449f7aa34cd10ff578207', 'request_id': 'req-24924324-e06e-44b4-89af-d4806ba20afa'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:04.356253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-24924324-e06e-44b4-89af-d4806ba20afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b83f7abfe2449f7aa34cd10ff578207', 'request_id': 'req-24924324-e06e-44b4-89af-d4806ba20afa'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:04.368467 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-24924324-e06e-44b4-89af-d4806ba20afa admin admin] The token cache is being invalidate because project 2b83f7abfe2449f7aa34cd10ff578207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:07:04.368756 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-24924324-e06e-44b4-89af-d4806ba20afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:04.369403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-24924324-e06e-44b4-89af-d4806ba20afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:04.371018 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1188/2396] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:07:04 2022] DELETE /identity/v3/projects/2b83f7abfe2449f7aa34cd10ff578207 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:04.377013 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb2735-d821-485b-92cb-52e19cfbf519 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:04.377529 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb2735-d821-485b-92cb-52e19cfbf519 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:04.377652 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb2735-d821-485b-92cb-52e19cfbf519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:04.400304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-59eb2735-d821-485b-92cb-52e19cfbf519 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:04.402080 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-59eb2735-d821-485b-92cb-52e19cfbf519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:04.486093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1209/2397] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:07:04.494463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d7930-82a0-41ac-bc5d-2b48d0d6164c None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:04.494756 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d7930-82a0-41ac-bc5d-2b48d0d6164c None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:04.495035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d7930-82a0-41ac-bc5d-2b48d0d6164c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:04.515332 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-473d7930-82a0-41ac-bc5d-2b48d0d6164c None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:04.516308 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-473d7930-82a0-41ac-bc5d-2b48d0d6164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:04.524636 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1189/2398] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:07:04.528790 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb2735-d821-485b-92cb-52e19cfbf519 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:04.540286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb2735-d821-485b-92cb-52e19cfbf519 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:04.545401 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eebd5e-fe99-4b32-8e01-93b42408dba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:04.546021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eebd5e-fe99-4b32-8e01-93b42408dba0 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:04.546304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eebd5e-fe99-4b32-8e01-93b42408dba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:04.548315 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eebd5e-fe99-4b32-8e01-93b42408dba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:04.548473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eebd5e-fe99-4b32-8e01-93b42408dba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:07:04.548708 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eebd5e-fe99-4b32-8e01-93b42408dba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:04.550316 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eebd5e-fe99-4b32-8e01-93b42408dba0 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:04.563487 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1210/2399] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:07:04.567798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d7930-82a0-41ac-bc5d-2b48d0d6164c None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:04.577110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d7930-82a0-41ac-bc5d-2b48d0d6164c None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:04.581834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c7680-4074-408e-bcfd-fdaf594896ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:04.585533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c7680-4074-408e-bcfd-fdaf594896ea admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:04.585533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c7680-4074-408e-bcfd-fdaf594896ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:04.585533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c7680-4074-408e-bcfd-fdaf594896ea admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:04.585533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c7680-4074-408e-bcfd-fdaf594896ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:04.585905 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c7680-4074-408e-bcfd-fdaf594896ea admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:04.672629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1190/2400] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:07:04 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:07:04.676690 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eebd5e-fe99-4b32-8e01-93b42408dba0 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:04.688136 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eebd5e-fe99-4b32-8e01-93b42408dba0 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:04.696378 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:04.750165 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8392cfc-2668-473f-a198-68bb979dc2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:04.750873 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8392cfc-2668-473f-a198-68bb979dc2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:04.751816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8392cfc-2668-473f-a198-68bb979dc2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:04.751816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8392cfc-2668-473f-a198-68bb979dc2e6 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:04.752075 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8392cfc-2668-473f-a198-68bb979dc2e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:04.753996 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8392cfc-2668-473f-a198-68bb979dc2e6 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:04.835584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1211/2401] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:07:04 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:07:04.839662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c7680-4074-408e-bcfd-fdaf594896ea admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:04.861786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c7680-4074-408e-bcfd-fdaf594896ea admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:04.861786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49134c36-73b5-488a-b016-9e509e1cf1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:04.861786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49134c36-73b5-488a-b016-9e509e1cf1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:04.861786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49134c36-73b5-488a-b016-9e509e1cf1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:04.862172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49134c36-73b5-488a-b016-9e509e1cf1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:04.862172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49134c36-73b5-488a-b016-9e509e1cf1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:04.862172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49134c36-73b5-488a-b016-9e509e1cf1c4 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:04.877037 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1191/2402] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:07:04.882495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8392cfc-2668-473f-a198-68bb979dc2e6 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:04.892629 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8392cfc-2668-473f-a198-68bb979dc2e6 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:04.897965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae25f1-34ec-483d-9bf8-132a80dcb0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:04.898751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae25f1-34ec-483d-9bf8-132a80dcb0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:04.899040 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae25f1-34ec-483d-9bf8-132a80dcb0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:04.899321 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae25f1-34ec-483d-9bf8-132a80dcb0f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:04.900039 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae25f1-34ec-483d-9bf8-132a80dcb0f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:04.901679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae25f1-34ec-483d-9bf8-132a80dcb0f0 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:04.917264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1212/2403] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:07:04.918704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49134c36-73b5-488a-b016-9e509e1cf1c4 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:04.930350 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49134c36-73b5-488a-b016-9e509e1cf1c4 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:04.935536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f679f-a406-46a0-8543-92a199116a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:04.936234 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f679f-a406-46a0-8543-92a199116a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:04.936519 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f679f-a406-46a0-8543-92a199116a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:04.936799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f679f-a406-46a0-8543-92a199116a2a admin admin] PATH_INFO: `/v3/projects/c37cb18ae0e044ba92fc943b21a8c26b/users/1b40a1ccfcb645ffa69956e4b92dcc8c/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:04.954502 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f679f-a406-46a0-8543-92a199116a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37cb18ae0e044ba92fc943b21a8c26b, user_id=1b40a1ccfcb645ffa69956e4b92dcc8c, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:04.957297 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f679f-a406-46a0-8543-92a199116a2a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:05.038735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1192/2404] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:07:04 2022] PUT /identity/v3/projects/c37cb18ae0e044ba92fc943b21a8c26b/users/1b40a1ccfcb645ffa69956e4b92dcc8c/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:05.048766 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf88104-5dc5-4eb6-aed1-865d19af636e None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:05.049578 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf88104-5dc5-4eb6-aed1-865d19af636e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:05.049578 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf88104-5dc5-4eb6-aed1-865d19af636e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:05.080547 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-edf88104-5dc5-4eb6-aed1-865d19af636e None None] MFA Rules not processed for user `1b40a1ccfcb645ffa69956e4b92dcc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:05.081804 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-edf88104-5dc5-4eb6-aed1-865d19af636e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:05.159067 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1213/2405] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:07:05.163982 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f679f-a406-46a0-8543-92a199116a2a admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:05.255480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f679f-a406-46a0-8543-92a199116a2a admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:05.261261 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada47dcb-79d8-45f8-aa6f-123f93b39b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:05.261898 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada47dcb-79d8-45f8-aa6f-123f93b39b8d admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:05.262183 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada47dcb-79d8-45f8-aa6f-123f93b39b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:05.263074 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada47dcb-79d8-45f8-aa6f-123f93b39b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:05.263610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada47dcb-79d8-45f8-aa6f-123f93b39b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:05.265592 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada47dcb-79d8-45f8-aa6f-123f93b39b8d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:05.388213 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1193/2406] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:07:05 2022] POST /identity/v3/projects => generated 389 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:07:05.392542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf88104-5dc5-4eb6-aed1-865d19af636e None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:05.404302 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf88104-5dc5-4eb6-aed1-865d19af636e None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:05.467878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44c99a-b598-4d6f-9421-1b4abdf0dba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:05.468260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44c99a-b598-4d6f-9421-1b4abdf0dba3 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:05.468977 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44c99a-b598-4d6f-9421-1b4abdf0dba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:05.469265 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44c99a-b598-4d6f-9421-1b4abdf0dba3 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:05.470008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44c99a-b598-4d6f-9421-1b4abdf0dba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:05.472125 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44c99a-b598-4d6f-9421-1b4abdf0dba3 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:05.559612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1214/2407] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:07:05 2022] POST /identity/v3/users => generated 301 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:07:05.560958 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada47dcb-79d8-45f8-aa6f-123f93b39b8d admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:05.572016 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada47dcb-79d8-45f8-aa6f-123f93b39b8d admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:05.576780 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920388ba-276b-47fe-b0f0-0a9b789b7d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:05.577620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920388ba-276b-47fe-b0f0-0a9b789b7d99 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:05.577951 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920388ba-276b-47fe-b0f0-0a9b789b7d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:05.578296 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920388ba-276b-47fe-b0f0-0a9b789b7d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:05.582540 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920388ba-276b-47fe-b0f0-0a9b789b7d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:05.582540 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920388ba-276b-47fe-b0f0-0a9b789b7d99 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:05.594482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1194/2408] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:07:05.598778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44c99a-b598-4d6f-9421-1b4abdf0dba3 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:05.608945 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44c99a-b598-4d6f-9421-1b4abdf0dba3 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:05.613661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8edb1-1d24-4488-a5d5-7a6ddbcfd230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:05.614330 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8edb1-1d24-4488-a5d5-7a6ddbcfd230 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:05.614677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8edb1-1d24-4488-a5d5-7a6ddbcfd230 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:05.614958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8edb1-1d24-4488-a5d5-7a6ddbcfd230 admin admin] PATH_INFO: `/v3/projects/3dbb544d4fad415ea7aa1a45c9919d08/users/562ba9d666e54194a4fc864cfde34f90/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:05.619309 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:05.630724 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8edb1-1d24-4488-a5d5-7a6ddbcfd230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbb544d4fad415ea7aa1a45c9919d08, user_id=562ba9d666e54194a4fc864cfde34f90, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:05.634015 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8edb1-1d24-4488-a5d5-7a6ddbcfd230 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:05.722460 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1215/2409] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:07:05 2022] PUT /identity/v3/projects/3dbb544d4fad415ea7aa1a45c9919d08/users/562ba9d666e54194a4fc864cfde34f90/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:07:05.726610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920388ba-276b-47fe-b0f0-0a9b789b7d99 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:05.739030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920388ba-276b-47fe-b0f0-0a9b789b7d99 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:05.771186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:05.799126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2654f-7275-437a-8867-d6813318da5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:05.799754 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2654f-7275-437a-8867-d6813318da5a admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:05.800799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2654f-7275-437a-8867-d6813318da5a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:05.800799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2654f-7275-437a-8867-d6813318da5a admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:05.801019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2654f-7275-437a-8867-d6813318da5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:05.802611 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2654f-7275-437a-8867-d6813318da5a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:05.814129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1195/2410] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:07:05.818267 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8edb1-1d24-4488-a5d5-7a6ddbcfd230 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:05.829699 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8edb1-1d24-4488-a5d5-7a6ddbcfd230 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:05.834801 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d1ab2-4eaa-4933-91ac-8e126a133ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:05.835475 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d1ab2-4eaa-4933-91ac-8e126a133ded admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:05.835756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d1ab2-4eaa-4933-91ac-8e126a133ded admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:05.836029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d1ab2-4eaa-4933-91ac-8e126a133ded admin admin] PATH_INFO: `/v3/projects/3dbb544d4fad415ea7aa1a45c9919d08/users/562ba9d666e54194a4fc864cfde34f90/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:05.837983 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d1ab2-4eaa-4933-91ac-8e126a133ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbb544d4fad415ea7aa1a45c9919d08, user_id=562ba9d666e54194a4fc864cfde34f90, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:05.840738 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d1ab2-4eaa-4933-91ac-8e126a133ded admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:05.852620 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1216/2411] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:07:05 2022] PUT /identity/v3/projects/3dbb544d4fad415ea7aa1a45c9919d08/users/562ba9d666e54194a4fc864cfde34f90/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:05.865228 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3a458-c9ae-49ce-868b-64da88885380 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:05.865519 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3a458-c9ae-49ce-868b-64da88885380 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:05.866323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3a458-c9ae-49ce-868b-64da88885380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:05.904805 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-16a3a458-c9ae-49ce-868b-64da88885380 None None] MFA Rules not processed for user `562ba9d666e54194a4fc864cfde34f90`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:05.906066 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-16a3a458-c9ae-49ce-868b-64da88885380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:05.992032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1196/2412] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:07:06.002851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d1ab2-4eaa-4933-91ac-8e126a133ded admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:06.004596 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-df8d1ab2-4eaa-4933-91ac-8e126a133ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:06.066362 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d1ab2-4eaa-4933-91ac-8e126a133ded admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:06.070926 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440df00-6ac7-4a0c-98de-d34057f98734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:06.071427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440df00-6ac7-4a0c-98de-d34057f98734 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:06.072584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440df00-6ac7-4a0c-98de-d34057f98734 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:06.072584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440df00-6ac7-4a0c-98de-d34057f98734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:06.082690 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440df00-6ac7-4a0c-98de-d34057f98734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:06.084230 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440df00-6ac7-4a0c-98de-d34057f98734 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:06.094653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1217/2413] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:07:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:07:06.238180 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3a458-c9ae-49ce-868b-64da88885380 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:06.304313 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3a458-c9ae-49ce-868b-64da88885380 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:06.308987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b804d79-2f9e-4741-b12f-cd8d96288310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:06.309640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b804d79-2f9e-4741-b12f-cd8d96288310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:06.309927 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b804d79-2f9e-4741-b12f-cd8d96288310 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:06.310205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b804d79-2f9e-4741-b12f-cd8d96288310 admin admin] PATH_INFO: `/v3/users/1b40a1ccfcb645ffa69956e4b92dcc8c` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:06.311460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b804d79-2f9e-4741-b12f-cd8d96288310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b40a1ccfcb645ffa69956e4b92dcc8c)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:06.313423 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b804d79-2f9e-4741-b12f-cd8d96288310 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:06.493216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0b804d79-2f9e-4741-b12f-cd8d96288310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b40a1ccfcb645ffa69956e4b92dcc8c'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:06.498373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:06.500424 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0b804d79-2f9e-4741-b12f-cd8d96288310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b40a1ccfcb645ffa69956e4b92dcc8c'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:06.512968 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0b804d79-2f9e-4741-b12f-cd8d96288310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b40a1ccfcb645ffa69956e4b92dcc8c'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:06.517670 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0b804d79-2f9e-4741-b12f-cd8d96288310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b40a1ccfcb645ffa69956e4b92dcc8c'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:06.517670 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0b804d79-2f9e-4741-b12f-cd8d96288310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b40a1ccfcb645ffa69956e4b92dcc8c'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:06.600051 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1197/2414] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:07:06 2022] DELETE /identity/v3/users/1b40a1ccfcb645ffa69956e4b92dcc8c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:06.604528 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e59e2a-7698-4873-9fd8-2b051b0d1309 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:06.605021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e59e2a-7698-4873-9fd8-2b051b0d1309 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:06.605122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e59e2a-7698-4873-9fd8-2b051b0d1309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:06.624382 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-e8e59e2a-7698-4873-9fd8-2b051b0d1309 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:06.625573 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e8e59e2a-7698-4873-9fd8-2b051b0d1309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:06.685005 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1218/2415] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:07:06.695570 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b804d79-2f9e-4741-b12f-cd8d96288310 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:06.696986 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-0b804d79-2f9e-4741-b12f-cd8d96288310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:06.753881 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b804d79-2f9e-4741-b12f-cd8d96288310 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:06.758037 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98635f-56e4-40cc-a4f9-cbe997b0cb5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:06.758702 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98635f-56e4-40cc-a4f9-cbe997b0cb5a service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:06.758988 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98635f-56e4-40cc-a4f9-cbe997b0cb5a service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:06.759267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98635f-56e4-40cc-a4f9-cbe997b0cb5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:06.768175 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98635f-56e4-40cc-a4f9-cbe997b0cb5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:06.769599 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98635f-56e4-40cc-a4f9-cbe997b0cb5a service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:06.779978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1198/2416] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:07:07.179593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e59e2a-7698-4873-9fd8-2b051b0d1309 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:07.181226 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e8e59e2a-7698-4873-9fd8-2b051b0d1309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:07.193342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e59e2a-7698-4873-9fd8-2b051b0d1309 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:07.203908 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a1c29-dab9-4341-abc3-9910af47124e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:07.203908 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a1c29-dab9-4341-abc3-9910af47124e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:07.203908 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a1c29-dab9-4341-abc3-9910af47124e admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:07.203908 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a1c29-dab9-4341-abc3-9910af47124e admin admin] PATH_INFO: `/v3/projects/c37cb18ae0e044ba92fc943b21a8c26b` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:07.204833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a1c29-dab9-4341-abc3-9910af47124e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c37cb18ae0e044ba92fc943b21a8c26b)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:07.204833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a1c29-dab9-4341-abc3-9910af47124e admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:07.299425 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-ad0a1c29-dab9-4341-abc3-9910af47124e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c37cb18ae0e044ba92fc943b21a8c26b', 'request_id': 'req-ad0a1c29-dab9-4341-abc3-9910af47124e'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:07.306301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-ad0a1c29-dab9-4341-abc3-9910af47124e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c37cb18ae0e044ba92fc943b21a8c26b', 'request_id': 'req-ad0a1c29-dab9-4341-abc3-9910af47124e'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:07.312055 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-ad0a1c29-dab9-4341-abc3-9910af47124e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c37cb18ae0e044ba92fc943b21a8c26b', 'request_id': 'req-ad0a1c29-dab9-4341-abc3-9910af47124e'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:07.362327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:07.367467 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-ad0a1c29-dab9-4341-abc3-9910af47124e admin admin] The token cache is being invalidate because project c37cb18ae0e044ba92fc943b21a8c26b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:07:07.367756 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-ad0a1c29-dab9-4341-abc3-9910af47124e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:07.368386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-ad0a1c29-dab9-4341-abc3-9910af47124e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:07.369921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1219/2417] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:07:07 2022] DELETE /identity/v3/projects/c37cb18ae0e044ba92fc943b21a8c26b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:07.373962 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98635f-56e4-40cc-a4f9-cbe997b0cb5a service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:07.384155 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98635f-56e4-40cc-a4f9-cbe997b0cb5a service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:07.439728 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f71e2-9952-48d7-b30f-2e5c9af9a87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:07.440370 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f71e2-9952-48d7-b30f-2e5c9af9a87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:07.440656 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f71e2-9952-48d7-b30f-2e5c9af9a87c admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:07.440936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f71e2-9952-48d7-b30f-2e5c9af9a87c admin admin] PATH_INFO: `/v3/users/562ba9d666e54194a4fc864cfde34f90` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:07.442095 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f71e2-9952-48d7-b30f-2e5c9af9a87c admin admin] RBAC: Authorizing `identity:delete_user(user_id=562ba9d666e54194a4fc864cfde34f90)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:07.444758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f71e2-9952-48d7-b30f-2e5c9af9a87c admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:07.653418 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-820f71e2-9952-48d7-b30f-2e5c9af9a87c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562ba9d666e54194a4fc864cfde34f90'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:07.660377 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-820f71e2-9952-48d7-b30f-2e5c9af9a87c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562ba9d666e54194a4fc864cfde34f90'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:07.672775 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-820f71e2-9952-48d7-b30f-2e5c9af9a87c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562ba9d666e54194a4fc864cfde34f90'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:07.673762 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-820f71e2-9952-48d7-b30f-2e5c9af9a87c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562ba9d666e54194a4fc864cfde34f90'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:07.674168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-820f71e2-9952-48d7-b30f-2e5c9af9a87c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562ba9d666e54194a4fc864cfde34f90'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:07.676826 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:07.767411 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1199/2418] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:07:07 2022] DELETE /identity/v3/users/562ba9d666e54194a4fc864cfde34f90 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:08.238328 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a1c29-dab9-4341-abc3-9910af47124e admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:08.241362 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ad0a1c29-dab9-4341-abc3-9910af47124e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:08.256555 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a1c29-dab9-4341-abc3-9910af47124e admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:08.318318 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdd62b-0cdd-4324-b73d-77a0ec6447ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:08.319017 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdd62b-0cdd-4324-b73d-77a0ec6447ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:08.319292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdd62b-0cdd-4324-b73d-77a0ec6447ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:08.319574 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdd62b-0cdd-4324-b73d-77a0ec6447ca admin admin] PATH_INFO: `/v3/projects/3dbb544d4fad415ea7aa1a45c9919d08` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:08.320746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdd62b-0cdd-4324-b73d-77a0ec6447ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dbb544d4fad415ea7aa1a45c9919d08)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:08.322748 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdd62b-0cdd-4324-b73d-77a0ec6447ca admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:08.467121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-e7bdd62b-0cdd-4324-b73d-77a0ec6447ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dbb544d4fad415ea7aa1a45c9919d08', 'request_id': 'req-e7bdd62b-0cdd-4324-b73d-77a0ec6447ca'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:08.473729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-e7bdd62b-0cdd-4324-b73d-77a0ec6447ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dbb544d4fad415ea7aa1a45c9919d08', 'request_id': 'req-e7bdd62b-0cdd-4324-b73d-77a0ec6447ca'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:08.479992 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-e7bdd62b-0cdd-4324-b73d-77a0ec6447ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dbb544d4fad415ea7aa1a45c9919d08', 'request_id': 'req-e7bdd62b-0cdd-4324-b73d-77a0ec6447ca'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:08.547716 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-e7bdd62b-0cdd-4324-b73d-77a0ec6447ca admin admin] The token cache is being invalidate because project 3dbb544d4fad415ea7aa1a45c9919d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:07:08.548031 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-e7bdd62b-0cdd-4324-b73d-77a0ec6447ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:08.548627 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-e7bdd62b-0cdd-4324-b73d-77a0ec6447ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:08.550159 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1220/2419] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:07:08 2022] DELETE /identity/v3/projects/3dbb544d4fad415ea7aa1a45c9919d08 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:07:08.555997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67921256-01ee-4402-a8c2-9c11d621d474 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:08.556552 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67921256-01ee-4402-a8c2-9c11d621d474 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:08.556660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67921256-01ee-4402-a8c2-9c11d621d474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:08.576599 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-67921256-01ee-4402-a8c2-9c11d621d474 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:08.577825 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-67921256-01ee-4402-a8c2-9c11d621d474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:08.641187 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1200/2420] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:07:08.649912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e391c1-e86a-441f-8829-b88f4d3158d2 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:08.650258 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e391c1-e86a-441f-8829-b88f4d3158d2 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:08.650588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e391c1-e86a-441f-8829-b88f4d3158d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:08.672357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-09e391c1-e86a-441f-8829-b88f4d3158d2 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:08.673835 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-09e391c1-e86a-441f-8829-b88f4d3158d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:08.683229 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1221/2421] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:07:08.687723 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67921256-01ee-4402-a8c2-9c11d621d474 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:08.697483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67921256-01ee-4402-a8c2-9c11d621d474 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:08.702044 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9ca12-cb0e-4e21-82fe-9b0d30f5329d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:08.702697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9ca12-cb0e-4e21-82fe-9b0d30f5329d admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:08.702983 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9ca12-cb0e-4e21-82fe-9b0d30f5329d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:08.703262 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9ca12-cb0e-4e21-82fe-9b0d30f5329d admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:08.703964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9ca12-cb0e-4e21-82fe-9b0d30f5329d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:07:08.704268 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9ca12-cb0e-4e21-82fe-9b0d30f5329d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:08.705867 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9ca12-cb0e-4e21-82fe-9b0d30f5329d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:08.718012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1201/2422] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:07:08.722299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e391c1-e86a-441f-8829-b88f4d3158d2 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:08.732353 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e391c1-e86a-441f-8829-b88f4d3158d2 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:08.738119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650282ad-79fb-424a-8ed5-af8e4aa426f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:08.738119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650282ad-79fb-424a-8ed5-af8e4aa426f6 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:08.738119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650282ad-79fb-424a-8ed5-af8e4aa426f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:08.738631 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650282ad-79fb-424a-8ed5-af8e4aa426f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:08.738959 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650282ad-79fb-424a-8ed5-af8e4aa426f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:08.740874 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650282ad-79fb-424a-8ed5-af8e4aa426f6 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:08.832439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1222/2423] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:07:08 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:07:08.837047 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9ca12-cb0e-4e21-82fe-9b0d30f5329d admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:08.847254 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9ca12-cb0e-4e21-82fe-9b0d30f5329d admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:08.904515 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582c2ee-1108-47f7-a82e-0b861cfba8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:08.905129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582c2ee-1108-47f7-a82e-0b861cfba8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:08.905411 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582c2ee-1108-47f7-a82e-0b861cfba8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:08.905684 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582c2ee-1108-47f7-a82e-0b861cfba8b8 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:08.906345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582c2ee-1108-47f7-a82e-0b861cfba8b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:08.908551 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582c2ee-1108-47f7-a82e-0b861cfba8b8 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:08.973994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1202/2424] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:07:08 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:07:08.981181 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650282ad-79fb-424a-8ed5-af8e4aa426f6 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:08.991687 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650282ad-79fb-424a-8ed5-af8e4aa426f6 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:08.996358 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d54e1-98e3-4015-85cc-950a9cb60e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:08.996964 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d54e1-98e3-4015-85cc-950a9cb60e08 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:08.997249 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d54e1-98e3-4015-85cc-950a9cb60e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:08.997526 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d54e1-98e3-4015-85cc-950a9cb60e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:08.998269 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d54e1-98e3-4015-85cc-950a9cb60e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:08.999892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d54e1-98e3-4015-85cc-950a9cb60e08 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:09.010641 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1223/2425] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:07:09.014453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582c2ee-1108-47f7-a82e-0b861cfba8b8 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:09.025183 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582c2ee-1108-47f7-a82e-0b861cfba8b8 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:09.030057 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487ae11-5534-4825-a5aa-0ef7f1c500a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:09.030705 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487ae11-5534-4825-a5aa-0ef7f1c500a3 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:09.030995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487ae11-5534-4825-a5aa-0ef7f1c500a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:09.031278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487ae11-5534-4825-a5aa-0ef7f1c500a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:09.032238 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487ae11-5534-4825-a5aa-0ef7f1c500a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:09.033839 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487ae11-5534-4825-a5aa-0ef7f1c500a3 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:09.045573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1203/2426] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:07:09.049724 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d54e1-98e3-4015-85cc-950a9cb60e08 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:09.059956 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d54e1-98e3-4015-85cc-950a9cb60e08 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:09.064707 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9b76e-9cae-4494-896a-843d350fddd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:09.065389 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9b76e-9cae-4494-896a-843d350fddd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:09.065661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9b76e-9cae-4494-896a-843d350fddd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:09.065946 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9b76e-9cae-4494-896a-843d350fddd0 admin admin] PATH_INFO: `/v3/projects/ca824b254b3944dcaba8c197c57b7eab/users/68ba08494adf45aeb97dae7f54fe592b/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:09.080883 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9b76e-9cae-4494-896a-843d350fddd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca824b254b3944dcaba8c197c57b7eab, user_id=68ba08494adf45aeb97dae7f54fe592b, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:09.083666 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9b76e-9cae-4494-896a-843d350fddd0 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:09.173416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1224/2427] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:07:09 2022] PUT /identity/v3/projects/ca824b254b3944dcaba8c197c57b7eab/users/68ba08494adf45aeb97dae7f54fe592b/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:09.185154 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946aaa7-1320-456f-a9ba-b5465d8382b4 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:09.185450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946aaa7-1320-456f-a9ba-b5465d8382b4 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:09.185886 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946aaa7-1320-456f-a9ba-b5465d8382b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:09.214419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-0946aaa7-1320-456f-a9ba-b5465d8382b4 None None] MFA Rules not processed for user `68ba08494adf45aeb97dae7f54fe592b`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:09.215658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-0946aaa7-1320-456f-a9ba-b5465d8382b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:09.265340 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:09.283865 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1204/2428] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:07:09.288374 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9b76e-9cae-4494-896a-843d350fddd0 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:09.314609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:09.349241 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9b76e-9cae-4494-896a-843d350fddd0 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:09.353929 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a28f33-11c8-497d-b2b9-424fd77c9c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:09.354579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a28f33-11c8-497d-b2b9-424fd77c9c21 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:09.354865 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a28f33-11c8-497d-b2b9-424fd77c9c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:09.355142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a28f33-11c8-497d-b2b9-424fd77c9c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:09.355814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a28f33-11c8-497d-b2b9-424fd77c9c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:09.357733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a28f33-11c8-497d-b2b9-424fd77c9c21 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:09.482634 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1225/2429] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:07:09 2022] POST /identity/v3/projects => generated 381 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:07:09.486772 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946aaa7-1320-456f-a9ba-b5465d8382b4 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:09.498475 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946aaa7-1320-456f-a9ba-b5465d8382b4 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:09.554925 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93af58e-cb84-469a-93bb-e5d32f345d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:09.564691 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93af58e-cb84-469a-93bb-e5d32f345d64 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:09.564691 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93af58e-cb84-469a-93bb-e5d32f345d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:09.564691 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93af58e-cb84-469a-93bb-e5d32f345d64 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:09.564691 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93af58e-cb84-469a-93bb-e5d32f345d64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:09.564691 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93af58e-cb84-469a-93bb-e5d32f345d64 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:09.741343 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1205/2430] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:07:09 2022] POST /identity/v3/users => generated 291 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:07:09.745448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a28f33-11c8-497d-b2b9-424fd77c9c21 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:09.755913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a28f33-11c8-497d-b2b9-424fd77c9c21 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:09.762321 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90c0ca-ad3b-479e-83a5-b84be9f65eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:09.763028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90c0ca-ad3b-479e-83a5-b84be9f65eef admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:09.763315 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90c0ca-ad3b-479e-83a5-b84be9f65eef admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:09.765937 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90c0ca-ad3b-479e-83a5-b84be9f65eef admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:09.765937 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90c0ca-ad3b-479e-83a5-b84be9f65eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:09.765937 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90c0ca-ad3b-479e-83a5-b84be9f65eef admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:09.777131 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1226/2431] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:07:09.781173 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93af58e-cb84-469a-93bb-e5d32f345d64 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:09.791696 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93af58e-cb84-469a-93bb-e5d32f345d64 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:09.796463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd3f23-903e-4722-aefe-b63b7e18d31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:09.797066 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd3f23-903e-4722-aefe-b63b7e18d31e admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:09.797349 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd3f23-903e-4722-aefe-b63b7e18d31e admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:09.797624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd3f23-903e-4722-aefe-b63b7e18d31e admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:09.798310 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd3f23-903e-4722-aefe-b63b7e18d31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:09.799964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd3f23-903e-4722-aefe-b63b7e18d31e admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:09.809980 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1206/2432] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:07:09.814182 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90c0ca-ad3b-479e-83a5-b84be9f65eef admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:09.824653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90c0ca-ad3b-479e-83a5-b84be9f65eef admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:09.829106 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6f00a-1c77-4909-ad82-c1d97e98e035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:09.829762 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6f00a-1c77-4909-ad82-c1d97e98e035 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:09.830047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6f00a-1c77-4909-ad82-c1d97e98e035 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:09.830328 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6f00a-1c77-4909-ad82-c1d97e98e035 admin admin] PATH_INFO: `/v3/projects/983cc9a5bc724cc6af0b598725eacbed/users/80821b7ddac94abca7082b5a6cf374f4/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:09.855575 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6f00a-1c77-4909-ad82-c1d97e98e035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=983cc9a5bc724cc6af0b598725eacbed, user_id=80821b7ddac94abca7082b5a6cf374f4, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:09.859349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6f00a-1c77-4909-ad82-c1d97e98e035 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:09.928167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1227/2433] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:07:09 2022] PUT /identity/v3/projects/983cc9a5bc724cc6af0b598725eacbed/users/80821b7ddac94abca7082b5a6cf374f4/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:09.942318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a573ec9-657c-4d3e-b5cb-8a8ae3b34b47 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:09.942625 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a573ec9-657c-4d3e-b5cb-8a8ae3b34b47 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:09.942927 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a573ec9-657c-4d3e-b5cb-8a8ae3b34b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:09.970974 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-4a573ec9-657c-4d3e-b5cb-8a8ae3b34b47 None None] MFA Rules not processed for user `80821b7ddac94abca7082b5a6cf374f4`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:09.972193 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4a573ec9-657c-4d3e-b5cb-8a8ae3b34b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:10.038724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1207/2434] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:07:10.043769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6f00a-1c77-4909-ad82-c1d97e98e035 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:10.108104 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6f00a-1c77-4909-ad82-c1d97e98e035 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:10.112638 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7819dc-82ce-401a-8299-8f44f9ce6ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:10.113250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7819dc-82ce-401a-8299-8f44f9ce6ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:10.113539 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7819dc-82ce-401a-8299-8f44f9ce6ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:10.113816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7819dc-82ce-401a-8299-8f44f9ce6ce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:10.114566 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7819dc-82ce-401a-8299-8f44f9ce6ce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:10.117028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7819dc-82ce-401a-8299-8f44f9ce6ce7 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:10.199940 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1228/2435] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:07:10 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:07:10.204301 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a573ec9-657c-4d3e-b5cb-8a8ae3b34b47 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:10.215739 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a573ec9-657c-4d3e-b5cb-8a8ae3b34b47 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:10.277751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:10.290127 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03168585-68b6-4d02-94d5-86a6626c521a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:10.290869 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03168585-68b6-4d02-94d5-86a6626c521a admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:10.291367 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03168585-68b6-4d02-94d5-86a6626c521a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:10.291650 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03168585-68b6-4d02-94d5-86a6626c521a admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:10.292341 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03168585-68b6-4d02-94d5-86a6626c521a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:10.294322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03168585-68b6-4d02-94d5-86a6626c521a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:10.372932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1208/2436] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:07:10 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:07:10.377009 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7819dc-82ce-401a-8299-8f44f9ce6ce7 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:10.387674 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7819dc-82ce-401a-8299-8f44f9ce6ce7 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:10.392549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676da9c-2d8c-40b9-babd-09364b56dd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:10.393847 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676da9c-2d8c-40b9-babd-09364b56dd50 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:10.393847 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676da9c-2d8c-40b9-babd-09364b56dd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:10.393847 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676da9c-2d8c-40b9-babd-09364b56dd50 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:10.394595 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676da9c-2d8c-40b9-babd-09364b56dd50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:10.396204 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676da9c-2d8c-40b9-babd-09364b56dd50 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:10.407766 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1229/2437] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:07:10.411960 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03168585-68b6-4d02-94d5-86a6626c521a admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:10.422554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03168585-68b6-4d02-94d5-86a6626c521a admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:10.427163 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077c707-715b-4576-b754-4e1967e6464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:10.427825 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077c707-715b-4576-b754-4e1967e6464c admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:10.428143 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077c707-715b-4576-b754-4e1967e6464c admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:10.428395 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077c707-715b-4576-b754-4e1967e6464c admin admin] PATH_INFO: `/v3/projects/49ff4bbbe04241fe9aee28e8727e17b9/users/fe1982d126e4487385b4f247c8d0e74f/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:10.442959 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077c707-715b-4576-b754-4e1967e6464c admin admin] RBAC: Authorizing `identity:create_grant(project_id=49ff4bbbe04241fe9aee28e8727e17b9, user_id=fe1982d126e4487385b4f247c8d0e74f, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:10.445620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077c707-715b-4576-b754-4e1967e6464c admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:10.542469 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1209/2438] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:07:10 2022] PUT /identity/v3/projects/49ff4bbbe04241fe9aee28e8727e17b9/users/fe1982d126e4487385b4f247c8d0e74f/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:10.546347 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676da9c-2d8c-40b9-babd-09364b56dd50 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:10.556323 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676da9c-2d8c-40b9-babd-09364b56dd50 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:10.600990 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:10.612470 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad730d3c-4ff5-493b-9f71-21c883468de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:10.613099 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad730d3c-4ff5-493b-9f71-21c883468de9 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:10.613366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad730d3c-4ff5-493b-9f71-21c883468de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:10.613641 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad730d3c-4ff5-493b-9f71-21c883468de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:10.614329 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad730d3c-4ff5-493b-9f71-21c883468de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:10.615979 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad730d3c-4ff5-493b-9f71-21c883468de9 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:10.625863 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1230/2439] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:07:10.630054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077c707-715b-4576-b754-4e1967e6464c admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:10.641310 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077c707-715b-4576-b754-4e1967e6464c admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:10.645951 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dae0c0-c876-49a2-af9b-dee84cce7e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:10.646649 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dae0c0-c876-49a2-af9b-dee84cce7e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:10.652785 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dae0c0-c876-49a2-af9b-dee84cce7e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:10.652785 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dae0c0-c876-49a2-af9b-dee84cce7e13 admin admin] PATH_INFO: `/v3/projects/49ff4bbbe04241fe9aee28e8727e17b9/users/fe1982d126e4487385b4f247c8d0e74f/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:10.652785 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dae0c0-c876-49a2-af9b-dee84cce7e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49ff4bbbe04241fe9aee28e8727e17b9, user_id=fe1982d126e4487385b4f247c8d0e74f, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:10.652785 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dae0c0-c876-49a2-af9b-dee84cce7e13 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:10.663290 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1210/2440] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:07:10 2022] PUT /identity/v3/projects/49ff4bbbe04241fe9aee28e8727e17b9/users/fe1982d126e4487385b4f247c8d0e74f/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:10.675835 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364760bf-80e2-44ee-970b-e041ed839fce None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:10.675835 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364760bf-80e2-44ee-970b-e041ed839fce None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:10.675835 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364760bf-80e2-44ee-970b-e041ed839fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:10.702598 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-364760bf-80e2-44ee-970b-e041ed839fce None None] MFA Rules not processed for user `fe1982d126e4487385b4f247c8d0e74f`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:10.703791 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-364760bf-80e2-44ee-970b-e041ed839fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:10.771772 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1231/2441] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:07:10.783975 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dae0c0-c876-49a2-af9b-dee84cce7e13 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:10.785660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-72dae0c0-c876-49a2-af9b-dee84cce7e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:10.843215 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dae0c0-c876-49a2-af9b-dee84cce7e13 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:10.846699 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a01adb-bb1e-47bd-b341-79a54a5c8ff6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:10.847336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a01adb-bb1e-47bd-b341-79a54a5c8ff6 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:10.847618 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a01adb-bb1e-47bd-b341-79a54a5c8ff6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:10.847889 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a01adb-bb1e-47bd-b341-79a54a5c8ff6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:10.903449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a01adb-bb1e-47bd-b341-79a54a5c8ff6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:10.904863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a01adb-bb1e-47bd-b341-79a54a5c8ff6 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:10.914734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1211/2442] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:07:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:07:13.954966 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364760bf-80e2-44ee-970b-e041ed839fce None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:13.965450 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364760bf-80e2-44ee-970b-e041ed839fce None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:13.969164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8d97a-728b-44dd-8323-f1ea223fa84a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:13.969788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8d97a-728b-44dd-8323-f1ea223fa84a service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:13.970092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8d97a-728b-44dd-8323-f1ea223fa84a service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:13.970350 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8d97a-728b-44dd-8323-f1ea223fa84a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:14.033771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8d97a-728b-44dd-8323-f1ea223fa84a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:14.035252 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8d97a-728b-44dd-8323-f1ea223fa84a service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:14.044670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1232/2443] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:07:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:07:15.669657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a01adb-bb1e-47bd-b341-79a54a5c8ff6 service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:15.679029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a01adb-bb1e-47bd-b341-79a54a5c8ff6 service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:15.683210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cba93-e42b-4f2b-b751-08e20c5127c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:15.683919 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cba93-e42b-4f2b-b751-08e20c5127c5 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:15.684384 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cba93-e42b-4f2b-b751-08e20c5127c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:15.684887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cba93-e42b-4f2b-b751-08e20c5127c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:15.695821 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cba93-e42b-4f2b-b751-08e20c5127c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:15.697300 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cba93-e42b-4f2b-b751-08e20c5127c5 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:15.708427 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1212/2444] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:07:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:07:20.375320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8d97a-728b-44dd-8323-f1ea223fa84a service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:20.441142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:20.478991 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8d97a-728b-44dd-8323-f1ea223fa84a service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:20.483564 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff6128-596d-4026-8a19-9b89946c78b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:20.484208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff6128-596d-4026-8a19-9b89946c78b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:20.484491 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff6128-596d-4026-8a19-9b89946c78b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:20.484771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff6128-596d-4026-8a19-9b89946c78b2 admin admin] PATH_INFO: `/v3/users/68ba08494adf45aeb97dae7f54fe592b` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:20.485927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff6128-596d-4026-8a19-9b89946c78b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ba08494adf45aeb97dae7f54fe592b)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:20.487908 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff6128-596d-4026-8a19-9b89946c78b2 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:20.723898 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-52ff6128-596d-4026-8a19-9b89946c78b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ba08494adf45aeb97dae7f54fe592b'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:20.724552 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-52ff6128-596d-4026-8a19-9b89946c78b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ba08494adf45aeb97dae7f54fe592b'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:20.736349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-52ff6128-596d-4026-8a19-9b89946c78b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ba08494adf45aeb97dae7f54fe592b'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:20.818704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-52ff6128-596d-4026-8a19-9b89946c78b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ba08494adf45aeb97dae7f54fe592b'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:20.820295 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-52ff6128-596d-4026-8a19-9b89946c78b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ba08494adf45aeb97dae7f54fe592b'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:20.833217 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1233/2445] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:07:20 2022] DELETE /identity/v3/users/68ba08494adf45aeb97dae7f54fe592b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:20.837844 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01139827-f8b3-481a-807d-011bcc69d6e9 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:20.838324 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01139827-f8b3-481a-807d-011bcc69d6e9 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:20.838457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01139827-f8b3-481a-807d-011bcc69d6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:20.887592 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-01139827-f8b3-481a-807d-011bcc69d6e9 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:20.888809 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-01139827-f8b3-481a-807d-011bcc69d6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:20.907108 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:20.948205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1213/2446] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:07:20.961065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff6128-596d-4026-8a19-9b89946c78b2 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:20.962721 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-52ff6128-596d-4026-8a19-9b89946c78b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:21.038189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff6128-596d-4026-8a19-9b89946c78b2 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:21.041761 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c22808-805b-4168-9d0d-af42f0e873d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:21.042371 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c22808-805b-4168-9d0d-af42f0e873d0 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:21.042682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c22808-805b-4168-9d0d-af42f0e873d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:21.042960 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c22808-805b-4168-9d0d-af42f0e873d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:21.051897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c22808-805b-4168-9d0d-af42f0e873d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:21.053393 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c22808-805b-4168-9d0d-af42f0e873d0 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:21.062798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1234/2447] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:07:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:07:21.471650 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01139827-f8b3-481a-807d-011bcc69d6e9 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:21.473152 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-01139827-f8b3-481a-807d-011bcc69d6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:21.489467 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01139827-f8b3-481a-807d-011bcc69d6e9 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:21.495568 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731f38f-8a2e-461a-bdf3-0da0aa220807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:21.496384 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731f38f-8a2e-461a-bdf3-0da0aa220807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:21.496663 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731f38f-8a2e-461a-bdf3-0da0aa220807 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:21.497035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731f38f-8a2e-461a-bdf3-0da0aa220807 admin admin] PATH_INFO: `/v3/projects/ca824b254b3944dcaba8c197c57b7eab` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:21.498173 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731f38f-8a2e-461a-bdf3-0da0aa220807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca824b254b3944dcaba8c197c57b7eab)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:21.504714 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731f38f-8a2e-461a-bdf3-0da0aa220807 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:21.618262 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-1731f38f-8a2e-461a-bdf3-0da0aa220807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca824b254b3944dcaba8c197c57b7eab', 'request_id': 'req-1731f38f-8a2e-461a-bdf3-0da0aa220807'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:21.624709 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-1731f38f-8a2e-461a-bdf3-0da0aa220807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca824b254b3944dcaba8c197c57b7eab', 'request_id': 'req-1731f38f-8a2e-461a-bdf3-0da0aa220807'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:21.702543 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-1731f38f-8a2e-461a-bdf3-0da0aa220807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca824b254b3944dcaba8c197c57b7eab', 'request_id': 'req-1731f38f-8a2e-461a-bdf3-0da0aa220807'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:21.713547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-1731f38f-8a2e-461a-bdf3-0da0aa220807 admin admin] The token cache is being invalidate because project ca824b254b3944dcaba8c197c57b7eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:07:21.713838 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-1731f38f-8a2e-461a-bdf3-0da0aa220807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:21.714538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-1731f38f-8a2e-461a-bdf3-0da0aa220807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:21.727804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1214/2448] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:07:21 2022] DELETE /identity/v3/projects/ca824b254b3944dcaba8c197c57b7eab => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:21.727944 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c22808-805b-4168-9d0d-af42f0e873d0 service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:21.730652 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c22808-805b-4168-9d0d-af42f0e873d0 service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:21.761112 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:21.788180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9bf14-fde7-4c04-95eb-2d23e27cdc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:21.788888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9bf14-fde7-4c04-95eb-2d23e27cdc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:21.789264 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9bf14-fde7-4c04-95eb-2d23e27cdc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:21.789549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9bf14-fde7-4c04-95eb-2d23e27cdc88 admin admin] PATH_INFO: `/v3/users/80821b7ddac94abca7082b5a6cf374f4` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:21.790753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9bf14-fde7-4c04-95eb-2d23e27cdc88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80821b7ddac94abca7082b5a6cf374f4)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:21.792860 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9bf14-fde7-4c04-95eb-2d23e27cdc88 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:22.009673 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-80e9bf14-fde7-4c04-95eb-2d23e27cdc88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80821b7ddac94abca7082b5a6cf374f4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:22.010334 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-80e9bf14-fde7-4c04-95eb-2d23e27cdc88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80821b7ddac94abca7082b5a6cf374f4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:22.022952 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-80e9bf14-fde7-4c04-95eb-2d23e27cdc88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80821b7ddac94abca7082b5a6cf374f4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:22.108199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-80e9bf14-fde7-4c04-95eb-2d23e27cdc88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80821b7ddac94abca7082b5a6cf374f4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:22.108832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-80e9bf14-fde7-4c04-95eb-2d23e27cdc88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80821b7ddac94abca7082b5a6cf374f4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:22.122508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1235/2449] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:07:21 2022] DELETE /identity/v3/users/80821b7ddac94abca7082b5a6cf374f4 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:22.620808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731f38f-8a2e-461a-bdf3-0da0aa220807 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:22.620808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-1731f38f-8a2e-461a-bdf3-0da0aa220807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:22.628544 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731f38f-8a2e-461a-bdf3-0da0aa220807 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:22.688209 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc74fd4-3677-42e4-89c2-7c6e090e7d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:22.688867 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc74fd4-3677-42e4-89c2-7c6e090e7d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:22.689154 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc74fd4-3677-42e4-89c2-7c6e090e7d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:22.689436 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc74fd4-3677-42e4-89c2-7c6e090e7d8b admin admin] PATH_INFO: `/v3/projects/983cc9a5bc724cc6af0b598725eacbed` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:22.692472 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc74fd4-3677-42e4-89c2-7c6e090e7d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=983cc9a5bc724cc6af0b598725eacbed)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:22.694422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc74fd4-3677-42e4-89c2-7c6e090e7d8b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:22.790835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7cc74fd4-3677-42e4-89c2-7c6e090e7d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '983cc9a5bc724cc6af0b598725eacbed', 'request_id': 'req-7cc74fd4-3677-42e4-89c2-7c6e090e7d8b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:22.791922 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:22.797510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7cc74fd4-3677-42e4-89c2-7c6e090e7d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '983cc9a5bc724cc6af0b598725eacbed', 'request_id': 'req-7cc74fd4-3677-42e4-89c2-7c6e090e7d8b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:22.885797 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7cc74fd4-3677-42e4-89c2-7c6e090e7d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '983cc9a5bc724cc6af0b598725eacbed', 'request_id': 'req-7cc74fd4-3677-42e4-89c2-7c6e090e7d8b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:22.897783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7cc74fd4-3677-42e4-89c2-7c6e090e7d8b admin admin] The token cache is being invalidate because project 983cc9a5bc724cc6af0b598725eacbed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:07:22.900367 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7cc74fd4-3677-42e4-89c2-7c6e090e7d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:22.900367 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-7cc74fd4-3677-42e4-89c2-7c6e090e7d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:22.900909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1215/2450] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:07:22 2022] DELETE /identity/v3/projects/983cc9a5bc724cc6af0b598725eacbed => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:22.905569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9bf14-fde7-4c04-95eb-2d23e27cdc88 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:22.908032 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-80e9bf14-fde7-4c04-95eb-2d23e27cdc88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:22.922567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9bf14-fde7-4c04-95eb-2d23e27cdc88 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:22.979196 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f55510-4836-4950-9345-849c7f6e7c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:22.979848 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f55510-4836-4950-9345-849c7f6e7c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:22.980119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f55510-4836-4950-9345-849c7f6e7c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:22.980403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f55510-4836-4950-9345-849c7f6e7c0c admin admin] PATH_INFO: `/v3/users/fe1982d126e4487385b4f247c8d0e74f` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:22.981567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f55510-4836-4950-9345-849c7f6e7c0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe1982d126e4487385b4f247c8d0e74f)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:22.983526 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f55510-4836-4950-9345-849c7f6e7c0c admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:23.193130 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d0f55510-4836-4950-9345-849c7f6e7c0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe1982d126e4487385b4f247c8d0e74f'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:23.193699 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d0f55510-4836-4950-9345-849c7f6e7c0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe1982d126e4487385b4f247c8d0e74f'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:23.199654 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:23.206322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d0f55510-4836-4950-9345-849c7f6e7c0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe1982d126e4487385b4f247c8d0e74f'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:23.304885 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d0f55510-4836-4950-9345-849c7f6e7c0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe1982d126e4487385b4f247c8d0e74f'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:23.305561 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-d0f55510-4836-4950-9345-849c7f6e7c0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe1982d126e4487385b4f247c8d0e74f'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:23.318112 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1236/2451] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:07:22 2022] DELETE /identity/v3/users/fe1982d126e4487385b4f247c8d0e74f => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:23.716024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc74fd4-3677-42e4-89c2-7c6e090e7d8b admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:23.717463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-7cc74fd4-3677-42e4-89c2-7c6e090e7d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:23.731053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc74fd4-3677-42e4-89c2-7c6e090e7d8b admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:23.789679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0803bf-3d90-4854-94e0-19514ae41c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:23.790496 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0803bf-3d90-4854-94e0-19514ae41c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:23.790783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0803bf-3d90-4854-94e0-19514ae41c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:23.791055 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0803bf-3d90-4854-94e0-19514ae41c90 admin admin] PATH_INFO: `/v3/projects/49ff4bbbe04241fe9aee28e8727e17b9` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:23.792192 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0803bf-3d90-4854-94e0-19514ae41c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49ff4bbbe04241fe9aee28e8727e17b9)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:23.794160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0803bf-3d90-4854-94e0-19514ae41c90 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:23.908807 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ad0803bf-3d90-4854-94e0-19514ae41c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49ff4bbbe04241fe9aee28e8727e17b9', 'request_id': 'req-ad0803bf-3d90-4854-94e0-19514ae41c90'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:23.915751 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ad0803bf-3d90-4854-94e0-19514ae41c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49ff4bbbe04241fe9aee28e8727e17b9', 'request_id': 'req-ad0803bf-3d90-4854-94e0-19514ae41c90'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:23.971226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ad0803bf-3d90-4854-94e0-19514ae41c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49ff4bbbe04241fe9aee28e8727e17b9', 'request_id': 'req-ad0803bf-3d90-4854-94e0-19514ae41c90'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:23.982504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ad0803bf-3d90-4854-94e0-19514ae41c90 admin admin] The token cache is being invalidate because project 49ff4bbbe04241fe9aee28e8727e17b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:07:23.982829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ad0803bf-3d90-4854-94e0-19514ae41c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:23.983446 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ad0803bf-3d90-4854-94e0-19514ae41c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:23.984956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1216/2452] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:07:23 2022] DELETE /identity/v3/projects/49ff4bbbe04241fe9aee28e8727e17b9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:23.990196 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850e49f-9e58-478e-a866-e81ed1f438f1 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:23.990690 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850e49f-9e58-478e-a866-e81ed1f438f1 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:23.990785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850e49f-9e58-478e-a866-e81ed1f438f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:24.039435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-d850e49f-9e58-478e-a866-e81ed1f438f1 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:24.040641 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d850e49f-9e58-478e-a866-e81ed1f438f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:24.108606 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1237/2453] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:07:24.117671 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7c2f8-c09d-4c91-a853-2cc01326e4b1 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:24.118036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7c2f8-c09d-4c91-a853-2cc01326e4b1 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:24.118322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7c2f8-c09d-4c91-a853-2cc01326e4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:24.138940 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-a2c7c2f8-c09d-4c91-a853-2cc01326e4b1 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:24.140135 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-a2c7c2f8-c09d-4c91-a853-2cc01326e4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:24.148686 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1217/2454] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:07:24.152893 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850e49f-9e58-478e-a866-e81ed1f438f1 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:24.162740 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850e49f-9e58-478e-a866-e81ed1f438f1 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:24.167243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aeea3a-71b3-4574-8bb8-ba7c5eacb60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:24.167851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeea3a-71b3-4574-8bb8-ba7c5eacb60a admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:24.168132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeea3a-71b3-4574-8bb8-ba7c5eacb60a admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:24.168411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeea3a-71b3-4574-8bb8-ba7c5eacb60a admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:24.169301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aeea3a-71b3-4574-8bb8-ba7c5eacb60a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:07:24.169605 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aeea3a-71b3-4574-8bb8-ba7c5eacb60a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:24.171246 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aeea3a-71b3-4574-8bb8-ba7c5eacb60a admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:24.182786 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1238/2455] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:07:24.189275 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7c2f8-c09d-4c91-a853-2cc01326e4b1 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:24.199528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7c2f8-c09d-4c91-a853-2cc01326e4b1 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:24.204365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c21e0-b329-4d78-b602-f276b5fe974d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:24.204976 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c21e0-b329-4d78-b602-f276b5fe974d admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:24.205257 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c21e0-b329-4d78-b602-f276b5fe974d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:24.205531 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c21e0-b329-4d78-b602-f276b5fe974d admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:24.206201 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c21e0-b329-4d78-b602-f276b5fe974d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:24.208140 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c21e0-b329-4d78-b602-f276b5fe974d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:24.310474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1218/2456] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:07:24 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:07:24.314782 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aeea3a-71b3-4574-8bb8-ba7c5eacb60a admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:24.325249 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aeea3a-71b3-4574-8bb8-ba7c5eacb60a admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:24.381130 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf56c09-75aa-4ddf-bad1-1cf6b19c2357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:24.382352 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf56c09-75aa-4ddf-bad1-1cf6b19c2357 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:24.382668 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf56c09-75aa-4ddf-bad1-1cf6b19c2357 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:24.382948 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf56c09-75aa-4ddf-bad1-1cf6b19c2357 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:24.383612 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf56c09-75aa-4ddf-bad1-1cf6b19c2357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:24.385540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf56c09-75aa-4ddf-bad1-1cf6b19c2357 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:24.504867 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1239/2457] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:07:24 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:07:24.509779 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c21e0-b329-4d78-b602-f276b5fe974d admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:24.520357 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c21e0-b329-4d78-b602-f276b5fe974d admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:24.524905 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1419962-4c53-4445-be95-ac84560bb65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:24.525513 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1419962-4c53-4445-be95-ac84560bb65e admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:24.529989 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1419962-4c53-4445-be95-ac84560bb65e admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:24.529989 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1419962-4c53-4445-be95-ac84560bb65e admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:24.529989 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1419962-4c53-4445-be95-ac84560bb65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:24.529989 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1419962-4c53-4445-be95-ac84560bb65e admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:24.539078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1219/2458] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:07:24.543104 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf56c09-75aa-4ddf-bad1-1cf6b19c2357 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:24.554275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf56c09-75aa-4ddf-bad1-1cf6b19c2357 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:24.559864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17601d2-d5e7-46b5-a917-595ff9614483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:24.560424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17601d2-d5e7-46b5-a917-595ff9614483 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:24.560770 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17601d2-d5e7-46b5-a917-595ff9614483 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:24.561023 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17601d2-d5e7-46b5-a917-595ff9614483 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:24.561685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17601d2-d5e7-46b5-a917-595ff9614483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:24.563326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17601d2-d5e7-46b5-a917-595ff9614483 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:24.576351 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1240/2459] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:07:24.580774 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1419962-4c53-4445-be95-ac84560bb65e admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:24.590912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1419962-4c53-4445-be95-ac84560bb65e admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:24.595966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4a1bd-f5a7-4cf0-9370-4f4a210626c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:24.596653 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a1bd-f5a7-4cf0-9370-4f4a210626c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:24.596941 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a1bd-f5a7-4cf0-9370-4f4a210626c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:24.597227 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a1bd-f5a7-4cf0-9370-4f4a210626c6 admin admin] PATH_INFO: `/v3/projects/7dbb88f48c664cb2864f30e28f8ebd05/users/e6699651c24c4d2dac1a63122ceedd8e/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:24.613372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4a1bd-f5a7-4cf0-9370-4f4a210626c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dbb88f48c664cb2864f30e28f8ebd05, user_id=e6699651c24c4d2dac1a63122ceedd8e, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:24.616613 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4a1bd-f5a7-4cf0-9370-4f4a210626c6 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:24.704934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1220/2460] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:07:24 2022] PUT /identity/v3/projects/7dbb88f48c664cb2864f30e28f8ebd05/users/e6699651c24c4d2dac1a63122ceedd8e/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:07:24.715868 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf43f9-4bb4-4645-a531-ecc8708cf380 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:24.716163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf43f9-4bb4-4645-a531-ecc8708cf380 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:24.716496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf43f9-4bb4-4645-a531-ecc8708cf380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:24.754842 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:24.754842 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-eccf43f9-4bb4-4645-a531-ecc8708cf380 None None] MFA Rules not processed for user `e6699651c24c4d2dac1a63122ceedd8e`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:24.754842 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-eccf43f9-4bb4-4645-a531-ecc8708cf380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:24.822743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1241/2461] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:07:24.835629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4a1bd-f5a7-4cf0-9370-4f4a210626c6 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:24.837477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-86f4a1bd-f5a7-4cf0-9370-4f4a210626c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:24.844026 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:24.897288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4a1bd-f5a7-4cf0-9370-4f4a210626c6 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:24.904931 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fe470-f115-42c9-b368-72b316b7865f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:24.906271 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fe470-f115-42c9-b368-72b316b7865f service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:24.906606 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fe470-f115-42c9-b368-72b316b7865f service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:24.907104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fe470-f115-42c9-b368-72b316b7865f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:24.923986 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fe470-f115-42c9-b368-72b316b7865f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:24.925906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fe470-f115-42c9-b368-72b316b7865f service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:24.937113 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1221/2462] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:07:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:07:24.963163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf43f9-4bb4-4645-a531-ecc8708cf380 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:25.030906 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf43f9-4bb4-4645-a531-ecc8708cf380 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:25.036512 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702aa47f-1bd5-439d-92b9-7ea914da743d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:25.037474 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702aa47f-1bd5-439d-92b9-7ea914da743d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:25.038514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702aa47f-1bd5-439d-92b9-7ea914da743d admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:25.038946 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702aa47f-1bd5-439d-92b9-7ea914da743d admin admin] PATH_INFO: `/v3/users/e6699651c24c4d2dac1a63122ceedd8e` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:25.040499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702aa47f-1bd5-439d-92b9-7ea914da743d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6699651c24c4d2dac1a63122ceedd8e)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:25.042603 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702aa47f-1bd5-439d-92b9-7ea914da743d admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:25.237084 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-702aa47f-1bd5-439d-92b9-7ea914da743d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6699651c24c4d2dac1a63122ceedd8e'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:25.237724 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-702aa47f-1bd5-439d-92b9-7ea914da743d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6699651c24c4d2dac1a63122ceedd8e'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:25.251804 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-702aa47f-1bd5-439d-92b9-7ea914da743d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6699651c24c4d2dac1a63122ceedd8e'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:25.344832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-702aa47f-1bd5-439d-92b9-7ea914da743d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6699651c24c4d2dac1a63122ceedd8e'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:25.345482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-702aa47f-1bd5-439d-92b9-7ea914da743d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6699651c24c4d2dac1a63122ceedd8e'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:25.359457 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1242/2463] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:07:24 2022] DELETE /identity/v3/users/e6699651c24c4d2dac1a63122ceedd8e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:25.364070 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c7463-f4f7-4636-9f41-288f247d868c None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:25.364362 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c7463-f4f7-4636-9f41-288f247d868c None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:25.364676 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c7463-f4f7-4636-9f41-288f247d868c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:25.384915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-c78c7463-f4f7-4636-9f41-288f247d868c None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:25.387559 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-c78c7463-f4f7-4636-9f41-288f247d868c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:25.451525 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1222/2464] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:07:25.461212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702aa47f-1bd5-439d-92b9-7ea914da743d admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:25.462682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-702aa47f-1bd5-439d-92b9-7ea914da743d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:25.490407 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:25.523825 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702aa47f-1bd5-439d-92b9-7ea914da743d admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:25.527559 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60424181-63fd-47f4-873b-dc33cdd2d9f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:25.528191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60424181-63fd-47f4-873b-dc33cdd2d9f4 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:25.528492 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60424181-63fd-47f4-873b-dc33cdd2d9f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:25.528779 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60424181-63fd-47f4-873b-dc33cdd2d9f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:25.539932 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60424181-63fd-47f4-873b-dc33cdd2d9f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:25.541470 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60424181-63fd-47f4-873b-dc33cdd2d9f4 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:25.551613 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1243/2465] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:07:25.986109 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c7463-f4f7-4636-9f41-288f247d868c None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:25.988336 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-c78c7463-f4f7-4636-9f41-288f247d868c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:26.000040 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c7463-f4f7-4636-9f41-288f247d868c None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:26.005371 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf32fbc-3f50-40ff-8739-62a58c9cb954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:26.006076 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf32fbc-3f50-40ff-8739-62a58c9cb954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:26.006552 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf32fbc-3f50-40ff-8739-62a58c9cb954 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:26.006836 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf32fbc-3f50-40ff-8739-62a58c9cb954 admin admin] PATH_INFO: `/v3/projects/7dbb88f48c664cb2864f30e28f8ebd05` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:26.008734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf32fbc-3f50-40ff-8739-62a58c9cb954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dbb88f48c664cb2864f30e28f8ebd05)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:26.011211 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf32fbc-3f50-40ff-8739-62a58c9cb954 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:26.132917 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3cf32fbc-3f50-40ff-8739-62a58c9cb954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dbb88f48c664cb2864f30e28f8ebd05', 'request_id': 'req-3cf32fbc-3f50-40ff-8739-62a58c9cb954'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:26.139078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3cf32fbc-3f50-40ff-8739-62a58c9cb954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dbb88f48c664cb2864f30e28f8ebd05', 'request_id': 'req-3cf32fbc-3f50-40ff-8739-62a58c9cb954'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:26.230029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3cf32fbc-3f50-40ff-8739-62a58c9cb954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dbb88f48c664cb2864f30e28f8ebd05', 'request_id': 'req-3cf32fbc-3f50-40ff-8739-62a58c9cb954'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:26.241091 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3cf32fbc-3f50-40ff-8739-62a58c9cb954 admin admin] The token cache is being invalidate because project 7dbb88f48c664cb2864f30e28f8ebd05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:07:26.241382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3cf32fbc-3f50-40ff-8739-62a58c9cb954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:26.241996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3cf32fbc-3f50-40ff-8739-62a58c9cb954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:26.243564 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1223/2466] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:07:25 2022] DELETE /identity/v3/projects/7dbb88f48c664cb2864f30e28f8ebd05 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:26.248561 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e42af-3b9c-465d-b235-2dd4c767e399 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:26.249058 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e42af-3b9c-465d-b235-2dd4c767e399 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:26.249164 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e42af-3b9c-465d-b235-2dd4c767e399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:26.270381 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-de3e42af-3b9c-465d-b235-2dd4c767e399 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:26.271605 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-de3e42af-3b9c-465d-b235-2dd4c767e399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:26.351886 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1244/2467] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:07:26.360697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198be9e-ed70-40a1-8289-bef8c0a38615 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:26.361042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198be9e-ed70-40a1-8289-bef8c0a38615 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:26.361327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198be9e-ed70-40a1-8289-bef8c0a38615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:26.509853 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-a198be9e-ed70-40a1-8289-bef8c0a38615 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:26.511102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-a198be9e-ed70-40a1-8289-bef8c0a38615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:26.520324 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1224/2468] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:07:26.524942 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e42af-3b9c-465d-b235-2dd4c767e399 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:26.535775 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e42af-3b9c-465d-b235-2dd4c767e399 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:26.549571 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969c624-0d05-455c-9a93-cc4bf4de6b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:26.551648 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969c624-0d05-455c-9a93-cc4bf4de6b89 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:26.551648 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969c624-0d05-455c-9a93-cc4bf4de6b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:26.551648 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969c624-0d05-455c-9a93-cc4bf4de6b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:26.551648 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969c624-0d05-455c-9a93-cc4bf4de6b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:07:26.552011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969c624-0d05-455c-9a93-cc4bf4de6b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:26.553848 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969c624-0d05-455c-9a93-cc4bf4de6b89 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:26.570305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1245/2469] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:07:26.574839 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198be9e-ed70-40a1-8289-bef8c0a38615 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:26.585216 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198be9e-ed70-40a1-8289-bef8c0a38615 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:26.593460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132f78d-c45b-4d47-aedf-423d0274aae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:26.594178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132f78d-c45b-4d47-aedf-423d0274aae0 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:26.594562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132f78d-c45b-4d47-aedf-423d0274aae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:26.594840 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132f78d-c45b-4d47-aedf-423d0274aae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:26.595589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132f78d-c45b-4d47-aedf-423d0274aae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:26.597591 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132f78d-c45b-4d47-aedf-423d0274aae0 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:26.709703 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1225/2470] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:07:26 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:07:26.715280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969c624-0d05-455c-9a93-cc4bf4de6b89 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:26.722105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969c624-0d05-455c-9a93-cc4bf4de6b89 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:26.784306 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8642349-d531-48b8-8d8f-bd3211f67a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:26.784850 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8642349-d531-48b8-8d8f-bd3211f67a30 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:26.785144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8642349-d531-48b8-8d8f-bd3211f67a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:26.785434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8642349-d531-48b8-8d8f-bd3211f67a30 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:26.786104 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8642349-d531-48b8-8d8f-bd3211f67a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:26.788385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8642349-d531-48b8-8d8f-bd3211f67a30 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:26.904149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1246/2471] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:07:26 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:07:26.908181 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132f78d-c45b-4d47-aedf-423d0274aae0 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:26.914209 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:26.919800 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132f78d-c45b-4d47-aedf-423d0274aae0 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:26.925520 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ade63-a4a4-41a9-b1e9-4721ce678f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:26.926279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ade63-a4a4-41a9-b1e9-4721ce678f67 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:26.926594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ade63-a4a4-41a9-b1e9-4721ce678f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:26.926870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ade63-a4a4-41a9-b1e9-4721ce678f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:26.927584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ade63-a4a4-41a9-b1e9-4721ce678f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:26.929738 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ade63-a4a4-41a9-b1e9-4721ce678f67 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:26.941291 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1226/2472] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:07:26.945850 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8642349-d531-48b8-8d8f-bd3211f67a30 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:26.958026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8642349-d531-48b8-8d8f-bd3211f67a30 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:26.962822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd83664-3e23-4d8e-8edb-06dfe38b6c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:26.963445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd83664-3e23-4d8e-8edb-06dfe38b6c55 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:26.963757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd83664-3e23-4d8e-8edb-06dfe38b6c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:26.964038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd83664-3e23-4d8e-8edb-06dfe38b6c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:26.964748 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd83664-3e23-4d8e-8edb-06dfe38b6c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:26.966673 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd83664-3e23-4d8e-8edb-06dfe38b6c55 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:26.978623 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1247/2473] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:07:26.982613 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ade63-a4a4-41a9-b1e9-4721ce678f67 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:26.993239 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ade63-a4a4-41a9-b1e9-4721ce678f67 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:26.998002 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613812d-4356-4d24-b818-b432b43cdc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:26.998709 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613812d-4356-4d24-b818-b432b43cdc27 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:26.999108 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613812d-4356-4d24-b818-b432b43cdc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:26.999394 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613812d-4356-4d24-b818-b432b43cdc27 admin admin] PATH_INFO: `/v3/projects/50beb2160ff54d7cbd1e525e351ea94e/users/c9df9c4431b44308ad275489277d17dd/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:27.015071 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613812d-4356-4d24-b818-b432b43cdc27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50beb2160ff54d7cbd1e525e351ea94e, user_id=c9df9c4431b44308ad275489277d17dd, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:27.018642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613812d-4356-4d24-b818-b432b43cdc27 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:27.104212 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1227/2474] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:07:26 2022] PUT /identity/v3/projects/50beb2160ff54d7cbd1e525e351ea94e/users/c9df9c4431b44308ad275489277d17dd/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:27.184486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c04c6e-9c38-4ae5-8795-82b58447bd54 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:27.184676 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c04c6e-9c38-4ae5-8795-82b58447bd54 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:27.184941 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c04c6e-9c38-4ae5-8795-82b58447bd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:27.216084 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-74c04c6e-9c38-4ae5-8795-82b58447bd54 None None] MFA Rules not processed for user `c9df9c4431b44308ad275489277d17dd`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:27.217501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-74c04c6e-9c38-4ae5-8795-82b58447bd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:27.237819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:27.284658 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1248/2475] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:07:27.301651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613812d-4356-4d24-b818-b432b43cdc27 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:27.303402 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4613812d-4356-4d24-b818-b432b43cdc27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:27.361706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613812d-4356-4d24-b818-b432b43cdc27 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:27.365215 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b668fc0-72ce-4f67-9768-88622b16abed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:27.366695 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b668fc0-72ce-4f67-9768-88622b16abed service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:27.366985 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b668fc0-72ce-4f67-9768-88622b16abed service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:27.367257 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b668fc0-72ce-4f67-9768-88622b16abed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:27.375593 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b668fc0-72ce-4f67-9768-88622b16abed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:27.377054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b668fc0-72ce-4f67-9768-88622b16abed service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:27.386521 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1228/2476] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:07:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:07:37.381689 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=40,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:37.510134 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=18 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:41.214916 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c04c6e-9c38-4ae5-8795-82b58447bd54 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:41.281301 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c04c6e-9c38-4ae5-8795-82b58447bd54 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:41.286445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d86ab-8317-4c2f-a026-399b19be629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:41.287087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d86ab-8317-4c2f-a026-399b19be629b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:41.287369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d86ab-8317-4c2f-a026-399b19be629b admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:41.287644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d86ab-8317-4c2f-a026-399b19be629b admin admin] PATH_INFO: `/v3/users/c9df9c4431b44308ad275489277d17dd` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:41.288798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d86ab-8317-4c2f-a026-399b19be629b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9df9c4431b44308ad275489277d17dd)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:41.290912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d86ab-8317-4c2f-a026-399b19be629b admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:41.586921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9c1d86ab-8317-4c2f-a026-399b19be629b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9df9c4431b44308ad275489277d17dd'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:41.587494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9c1d86ab-8317-4c2f-a026-399b19be629b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9df9c4431b44308ad275489277d17dd'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:41.600925 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9c1d86ab-8317-4c2f-a026-399b19be629b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9df9c4431b44308ad275489277d17dd'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:41.676093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9c1d86ab-8317-4c2f-a026-399b19be629b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9df9c4431b44308ad275489277d17dd'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:41.676715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9c1d86ab-8317-4c2f-a026-399b19be629b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9df9c4431b44308ad275489277d17dd'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:41.695654 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1249/2477] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:07:41 2022] DELETE /identity/v3/users/c9df9c4431b44308ad275489277d17dd => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:41.700032 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd751f-0d9d-4e1b-996e-c776b24760f0 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:41.700659 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd751f-0d9d-4e1b-996e-c776b24760f0 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:41.700659 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd751f-0d9d-4e1b-996e-c776b24760f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:41.720963 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-cbcd751f-0d9d-4e1b-996e-c776b24760f0 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:41.722183 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-cbcd751f-0d9d-4e1b-996e-c776b24760f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:41.790545 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1229/2478] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:07:41.808722 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d86ab-8317-4c2f-a026-399b19be629b admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:41.811248 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-9c1d86ab-8317-4c2f-a026-399b19be629b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:41.906107 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d86ab-8317-4c2f-a026-399b19be629b admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:41.910498 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d7c01-c77d-4a7a-9a75-deb729c48557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:41.911186 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d7c01-c77d-4a7a-9a75-deb729c48557 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:41.911537 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d7c01-c77d-4a7a-9a75-deb729c48557 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:41.911879 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d7c01-c77d-4a7a-9a75-deb729c48557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:41.922709 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d7c01-c77d-4a7a-9a75-deb729c48557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:41.924224 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d7c01-c77d-4a7a-9a75-deb729c48557 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:41.934645 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1250/2479] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:07:42.434753 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd751f-0d9d-4e1b-996e-c776b24760f0 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:42.436186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-cbcd751f-0d9d-4e1b-996e-c776b24760f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:42.448899 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd751f-0d9d-4e1b-996e-c776b24760f0 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:42.453699 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d837e9-5f64-4608-9e89-499e03739826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:42.454346 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d837e9-5f64-4608-9e89-499e03739826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:42.454657 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d837e9-5f64-4608-9e89-499e03739826 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:42.454932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d837e9-5f64-4608-9e89-499e03739826 admin admin] PATH_INFO: `/v3/projects/50beb2160ff54d7cbd1e525e351ea94e` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:42.456083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d837e9-5f64-4608-9e89-499e03739826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50beb2160ff54d7cbd1e525e351ea94e)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:42.458076 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d837e9-5f64-4608-9e89-499e03739826 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:42.569177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-88d837e9-5f64-4608-9e89-499e03739826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50beb2160ff54d7cbd1e525e351ea94e', 'request_id': 'req-88d837e9-5f64-4608-9e89-499e03739826'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:42.580978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-88d837e9-5f64-4608-9e89-499e03739826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50beb2160ff54d7cbd1e525e351ea94e', 'request_id': 'req-88d837e9-5f64-4608-9e89-499e03739826'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:42.636678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-88d837e9-5f64-4608-9e89-499e03739826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50beb2160ff54d7cbd1e525e351ea94e', 'request_id': 'req-88d837e9-5f64-4608-9e89-499e03739826'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:42.647799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-88d837e9-5f64-4608-9e89-499e03739826 admin admin] The token cache is being invalidate because project 50beb2160ff54d7cbd1e525e351ea94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:07:42.648085 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-88d837e9-5f64-4608-9e89-499e03739826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:42.648695 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-88d837e9-5f64-4608-9e89-499e03739826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:07:42.650202 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1230/2480] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:07:42 2022] DELETE /identity/v3/projects/50beb2160ff54d7cbd1e525e351ea94e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:07:51.709712 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126fc13-e14a-4af6-86f7-4d0a5975c534 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:51.710168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126fc13-e14a-4af6-86f7-4d0a5975c534 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:51.710273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126fc13-e14a-4af6-86f7-4d0a5975c534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:51.725217 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:51.751560 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-c126fc13-e14a-4af6-86f7-4d0a5975c534 None None] MFA Rules not processed for user `0834be7405cd4c968763099251d37154`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:07:51.752805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c126fc13-e14a-4af6-86f7-4d0a5975c534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:51.826445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1251/2481] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jul 26 15:07:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:07:51.960119 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d837e9-5f64-4608-9e89-499e03739826 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:07:51.961540 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-88d837e9-5f64-4608-9e89-499e03739826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:07:52.031315 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d837e9-5f64-4608-9e89-499e03739826 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:07:52.036775 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26a437-6fdc-473e-97df-f638d50de61d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '462ecbb85c6b4a17a952fb74fa2de65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:07:52.037401 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26a437-6fdc-473e-97df-f638d50de61d service swift] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:07:52.037712 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26a437-6fdc-473e-97df-f638d50de61d service swift] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:07:52.037992 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26a437-6fdc-473e-97df-f638d50de61d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:07:52.048031 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26a437-6fdc-473e-97df-f638d50de61d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:07:52.049611 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26a437-6fdc-473e-97df-f638d50de61d service swift] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:07:52.057812 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1231/2482] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jul 26 15:07:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:08:01.858934 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=31 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:02.054808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:09.293524 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126fc13-e14a-4af6-86f7-4d0a5975c534 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:08:09.295167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c126fc13-e14a-4af6-86f7-4d0a5975c534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:08:09.384938 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126fc13-e14a-4af6-86f7-4d0a5975c534 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:08:09.390190 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ee25b-694e-4f0b-a95e-69ddbc55d13e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fab620bc5d044479746d8ea17615a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:08:09.390842 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee25b-694e-4f0b-a95e-69ddbc55d13e service placement] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:08:09.391126 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee25b-694e-4f0b-a95e-69ddbc55d13e service placement] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:08:09.391407 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee25b-694e-4f0b-a95e-69ddbc55d13e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:08:09.393175 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-756ee25b-694e-4f0b-a95e-69ddbc55d13e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:08:09.405084 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ee25b-694e-4f0b-a95e-69ddbc55d13e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:08:09.406690 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ee25b-694e-4f0b-a95e-69ddbc55d13e service placement] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:08:09.416825 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1252/2483] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:08:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:08:12.676617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589d5da-7265-4c35-9ed5-15d941e67080 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:08:12.677059 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589d5da-7265-4c35-9ed5-15d941e67080 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:08:12.677175 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589d5da-7265-4c35-9ed5-15d941e67080 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:08:12.682183 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1232/2484] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jul 26 15:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:08:12.684552 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb677cb-3ca5-4d82-be96-e96315a8804a None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:08:12.685004 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb677cb-3ca5-4d82-be96-e96315a8804a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:08:12.685101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb677cb-3ca5-4d82-be96-e96315a8804a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:08:12.719605 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-fcb677cb-3ca5-4d82-be96-e96315a8804a None None] MFA Rules not processed for user `d12fc26e640f4337b4a4da60cc4d9adc`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:08:12.720822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-fcb677cb-3ca5-4d82-be96-e96315a8804a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:08:12.798180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1253/2485] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jul 26 15:08:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:08:12.809528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589d5da-7265-4c35-9ed5-15d941e67080 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:08:12.811237 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-7589d5da-7265-4c35-9ed5-15d941e67080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:08:12.870949 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589d5da-7265-4c35-9ed5-15d941e67080 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:08:12.874558 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f54d18-9ac9-42bb-9996-67b1a2c52b70 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa31ecab10a6499f92da49bc7abb403a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:08:12.875176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f54d18-9ac9-42bb-9996-67b1a2c52b70 service glance] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:08:12.875459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f54d18-9ac9-42bb-9996-67b1a2c52b70 service glance] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:08:12.875739 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f54d18-9ac9-42bb-9996-67b1a2c52b70 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:08:12.885590 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f54d18-9ac9-42bb-9996-67b1a2c52b70 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:08:12.887058 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f54d18-9ac9-42bb-9996-67b1a2c52b70 service glance] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:08:12.898148 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1233/2486] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:08:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:08:13.151599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ccfb0-bb6a-43ef-9b49-49375f767784 None None] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:08:13.151816 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ccfb0-bb6a-43ef-9b49-49375f767784 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:08:13.152082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ccfb0-bb6a-43ef-9b49-49375f767784 None None] PATH_INFO: `/` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:08:13.153653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1254/2487] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jul 26 15:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:08:13.158738 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf006a-0f8a-47c5-a103-b1e49f442632 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:08:13.159299 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf006a-0f8a-47c5-a103-b1e49f442632 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:08:13.159580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf006a-0f8a-47c5-a103-b1e49f442632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:08:13.179596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-addf006a-0f8a-47c5-a103-b1e49f442632 None None] MFA Rules not processed for user `e71086ec00454e26b24337e0876bfe89`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:08:13.180813 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-addf006a-0f8a-47c5-a103-b1e49f442632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:08:13.231218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1234/2488] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jul 26 15:08:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:08:13.243237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ccfb0-bb6a-43ef-9b49-49375f767784 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:08:13.244927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-b13ccfb0-bb6a-43ef-9b49-49375f767784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:08:13.258339 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ccfb0-bb6a-43ef-9b49-49375f767784 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:08:13.261785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7da62b-f107-422d-a621-fbd84d83d099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:08:13.262418 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7da62b-f107-422d-a621-fbd84d83d099 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:08:13.262695 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7da62b-f107-422d-a621-fbd84d83d099 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:08:13.263080 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7da62b-f107-422d-a621-fbd84d83d099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:08:13.270500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7da62b-f107-422d-a621-fbd84d83d099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:08:13.271907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7da62b-f107-422d-a621-fbd84d83d099 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:08:13.279433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1255/2489] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:08:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:08:13.359765 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee36bf1-37c6-45d8-b996-b5bd079fa198 None None] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:08:13.360056 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee36bf1-37c6-45d8-b996-b5bd079fa198 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:08:13.360335 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee36bf1-37c6-45d8-b996-b5bd079fa198 None None] PATH_INFO: `/` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:08:13.361733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1235/2490] 10.222.0.86 () {54 vars in 921 bytes} [Tue Jul 26 15:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 15:08:13.367385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541f040-ff76-4298-8112-4d57524a95cb None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:08:13.367672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541f040-ff76-4298-8112-4d57524a95cb None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:08:13.367949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541f040-ff76-4298-8112-4d57524a95cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:08:13.388037 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-9541f040-ff76-4298-8112-4d57524a95cb None None] MFA Rules not processed for user `d12fc26e640f4337b4a4da60cc4d9adc`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:08:13.389231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-9541f040-ff76-4298-8112-4d57524a95cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:08:13.398682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1256/2491] 10.222.0.86 () {58 vars in 1018 bytes} [Tue Jul 26 15:08:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:08:13.409447 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee36bf1-37c6-45d8-b996-b5bd079fa198 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:08:13.420754 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee36bf1-37c6-45d8-b996-b5bd079fa198 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:08:13.424299 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a5aa5-479f-44b1-968a-91441a2e4de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:08:13.424921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a5aa5-479f-44b1-968a-91441a2e4de3 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:08:13.425199 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a5aa5-479f-44b1-968a-91441a2e4de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:08:13.425499 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a5aa5-479f-44b1-968a-91441a2e4de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:08:13.435470 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a5aa5-479f-44b1-968a-91441a2e4de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:08:13.437574 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a5aa5-479f-44b1-968a-91441a2e4de3 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:08:13.448033 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1236/2492] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:08:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:08:15.919386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38198c6a-9b77-44a6-825e-61571e3bf597 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:08:15.919852 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38198c6a-9b77-44a6-825e-61571e3bf597 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:08:15.920019 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38198c6a-9b77-44a6-825e-61571e3bf597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:08:15.940235 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-38198c6a-9b77-44a6-825e-61571e3bf597 None None] MFA Rules not processed for user `0834be7405cd4c968763099251d37154`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:08:15.941467 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-38198c6a-9b77-44a6-825e-61571e3bf597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:08:15.949252 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1257/2493] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jul 26 15:08:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:08:15.961119 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a5aa5-479f-44b1-968a-91441a2e4de3 service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:08:15.973905 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a5aa5-479f-44b1-968a-91441a2e4de3 service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:08:15.979386 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6d46f-9c9c-487c-9daf-935b796af9ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '462ecbb85c6b4a17a952fb74fa2de65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:08:15.980150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6d46f-9c9c-487c-9daf-935b796af9ee service swift] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:08:15.980497 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6d46f-9c9c-487c-9daf-935b796af9ee service swift] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:08:15.980823 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6d46f-9c9c-487c-9daf-935b796af9ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:08:15.990227 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6d46f-9c9c-487c-9daf-935b796af9ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:08:15.991821 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6d46f-9c9c-487c-9daf-935b796af9ee service swift] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:08:16.000540 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1237/2494] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jul 26 15:08:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:08:25.967797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=93 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:25.996893 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=61 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:38.854881 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6ef75-65c7-416d-a386-d1e75aa57ab3 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:08:38.855376 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6ef75-65c7-416d-a386-d1e75aa57ab3 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:08:38.855469 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6ef75-65c7-416d-a386-d1e75aa57ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:08:38.874290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-04a6ef75-65c7-416d-a386-d1e75aa57ab3 None None] MFA Rules not processed for user `0834be7405cd4c968763099251d37154`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:08:38.875509 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-04a6ef75-65c7-416d-a386-d1e75aa57ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:08:38.882688 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1258/2495] 10.222.0.86 () {58 vars in 967 bytes} [Tue Jul 26 15:08:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:08:38.897082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6d46f-9c9c-487c-9daf-935b796af9ee service swift] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:08:38.908146 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6d46f-9c9c-487c-9daf-935b796af9ee service swift] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:08:38.913395 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cccc88-a506-4b21-931f-91161692b3d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '462ecbb85c6b4a17a952fb74fa2de65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:08:38.913978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cccc88-a506-4b21-931f-91161692b3d3 service swift] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:08:38.914319 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cccc88-a506-4b21-931f-91161692b3d3 service swift] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:08:38.914552 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cccc88-a506-4b21-931f-91161692b3d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:08:38.923114 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cccc88-a506-4b21-931f-91161692b3d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:08:38.924666 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cccc88-a506-4b21-931f-91161692b3d3 service swift] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:08:38.932660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1238/2496] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jul 26 15:08:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 15:08:48.869198 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:48.929469 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=6 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:55.615698 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798966f-70a2-4fe2-910d-f0998d390be2 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:08:55.616277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798966f-70a2-4fe2-910d-f0998d390be2 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:08:55.616981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798966f-70a2-4fe2-910d-f0998d390be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:08:55.637464 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-5798966f-70a2-4fe2-910d-f0998d390be2 None None] MFA Rules not processed for user `d7dbcd204d864ad6914aca2c3594089c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:08:55.639003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5798966f-70a2-4fe2-910d-f0998d390be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:08:55.718485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1259/2497] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:08:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:03.154841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cccc88-a506-4b21-931f-91161692b3d3 service swift] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:03.156308 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b5cccc88-a506-4b21-931f-91161692b3d3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:03.168546 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cccc88-a506-4b21-931f-91161692b3d3 service swift] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:03.172142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb175e9-8ac3-44ea-a96e-594762309194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:03.172737 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb175e9-8ac3-44ea-a96e-594762309194 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:03.173018 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb175e9-8ac3-44ea-a96e-594762309194 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:03.173291 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb175e9-8ac3-44ea-a96e-594762309194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:03.174988 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-9bb175e9-8ac3-44ea-a96e-594762309194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:03.237043 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb175e9-8ac3-44ea-a96e-594762309194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:03.239134 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb175e9-8ac3-44ea-a96e-594762309194 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:03.248770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1239/2498] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:05.711170 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=25 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:07.007322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798966f-70a2-4fe2-910d-f0998d390be2 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:07.009444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5798966f-70a2-4fe2-910d-f0998d390be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:07.025851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798966f-70a2-4fe2-910d-f0998d390be2 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:07.032556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544ae7f-b9ab-4be4-8e5e-0d32836f34d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fab620bc5d044479746d8ea17615a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:07.033298 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544ae7f-b9ab-4be4-8e5e-0d32836f34d5 service placement] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:07.033796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544ae7f-b9ab-4be4-8e5e-0d32836f34d5 service placement] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:07.034159 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544ae7f-b9ab-4be4-8e5e-0d32836f34d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:07.036466 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2544ae7f-b9ab-4be4-8e5e-0d32836f34d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:07.050255 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544ae7f-b9ab-4be4-8e5e-0d32836f34d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:07.052362 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544ae7f-b9ab-4be4-8e5e-0d32836f34d5 service placement] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:07.074044 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1260/2499] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:07.154846 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb175e9-8ac3-44ea-a96e-594762309194 service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:07.159305 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-9bb175e9-8ac3-44ea-a96e-594762309194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:07.173357 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb175e9-8ac3-44ea-a96e-594762309194 service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:07.180445 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8146287-3a3f-4d89-acbb-514465499442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:07.181358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8146287-3a3f-4d89-acbb-514465499442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:07.181855 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8146287-3a3f-4d89-acbb-514465499442 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:07.182323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8146287-3a3f-4d89-acbb-514465499442 admin admin] PATH_INFO: `/v3/users/23f8fb537ff1459b8061b78f689b56fb` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:07.183746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8146287-3a3f-4d89-acbb-514465499442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f8fb537ff1459b8061b78f689b56fb)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:07.186827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8146287-3a3f-4d89-acbb-514465499442 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:07.376382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a8146287-3a3f-4d89-acbb-514465499442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f8fb537ff1459b8061b78f689b56fb'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:07.384091 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a8146287-3a3f-4d89-acbb-514465499442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f8fb537ff1459b8061b78f689b56fb'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:07.397730 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a8146287-3a3f-4d89-acbb-514465499442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f8fb537ff1459b8061b78f689b56fb'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:07.398482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a8146287-3a3f-4d89-acbb-514465499442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f8fb537ff1459b8061b78f689b56fb'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:07.399096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a8146287-3a3f-4d89-acbb-514465499442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f8fb537ff1459b8061b78f689b56fb'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:07.498515 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1240/2500] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:09:07 2022] DELETE /identity/v3/users/23f8fb537ff1459b8061b78f689b56fb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:07.769434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544ae7f-b9ab-4be4-8e5e-0d32836f34d5 service placement] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:07.783782 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544ae7f-b9ab-4be4-8e5e-0d32836f34d5 service placement] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:07.843729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bddc94-a720-48ab-89e4-fe45016d06ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:07.844377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bddc94-a720-48ab-89e4-fe45016d06ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:07.844665 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bddc94-a720-48ab-89e4-fe45016d06ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:07.844985 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bddc94-a720-48ab-89e4-fe45016d06ac admin admin] PATH_INFO: `/v3/projects/4fad395737274c84b69d4040fbc9310f` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:07.846186 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bddc94-a720-48ab-89e4-fe45016d06ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fad395737274c84b69d4040fbc9310f)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:07.848211 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bddc94-a720-48ab-89e4-fe45016d06ac admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:07.956299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-f1bddc94-a720-48ab-89e4-fe45016d06ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fad395737274c84b69d4040fbc9310f', 'request_id': 'req-f1bddc94-a720-48ab-89e4-fe45016d06ac'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:07.963066 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-f1bddc94-a720-48ab-89e4-fe45016d06ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fad395737274c84b69d4040fbc9310f', 'request_id': 'req-f1bddc94-a720-48ab-89e4-fe45016d06ac'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:07.968704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-f1bddc94-a720-48ab-89e4-fe45016d06ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fad395737274c84b69d4040fbc9310f', 'request_id': 'req-f1bddc94-a720-48ab-89e4-fe45016d06ac'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:08.058032 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-f1bddc94-a720-48ab-89e4-fe45016d06ac admin admin] The token cache is being invalidate because project 4fad395737274c84b69d4040fbc9310f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:09:08.058700 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-f1bddc94-a720-48ab-89e4-fe45016d06ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:08.059211 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-f1bddc94-a720-48ab-89e4-fe45016d06ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:08.060661 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1261/2501] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:09:07 2022] DELETE /identity/v3/projects/4fad395737274c84b69d4040fbc9310f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:08.065651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a0d55-afc0-47e6-87e5-6efc09b5fbe5 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:08.065944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a0d55-afc0-47e6-87e5-6efc09b5fbe5 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:08.066322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a0d55-afc0-47e6-87e5-6efc09b5fbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:08.086332 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-091a0d55-afc0-47e6-87e5-6efc09b5fbe5 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:08.087558 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-091a0d55-afc0-47e6-87e5-6efc09b5fbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:08.146608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1241/2502] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:08.154290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c79bdc-d2b1-4a0a-bf96-b84972dbd1c7 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:08.154616 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c79bdc-d2b1-4a0a-bf96-b84972dbd1c7 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:08.154922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c79bdc-d2b1-4a0a-bf96-b84972dbd1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:08.176311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-d4c79bdc-d2b1-4a0a-bf96-b84972dbd1c7 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:08.177513 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d4c79bdc-d2b1-4a0a-bf96-b84972dbd1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:08.185294 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1262/2503] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:08.189563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a0d55-afc0-47e6-87e5-6efc09b5fbe5 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:08.199732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a0d55-afc0-47e6-87e5-6efc09b5fbe5 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:08.204249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dd307-8ef2-4341-b327-33fc02ebf9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:08.204852 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dd307-8ef2-4341-b327-33fc02ebf9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:08.205129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dd307-8ef2-4341-b327-33fc02ebf9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:08.205401 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dd307-8ef2-4341-b327-33fc02ebf9d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:08.206085 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dd307-8ef2-4341-b327-33fc02ebf9d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:09:08.206467 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dd307-8ef2-4341-b327-33fc02ebf9d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:08.208291 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dd307-8ef2-4341-b327-33fc02ebf9d4 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:08.209798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:08.220604 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1242/2504] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:09:08.224772 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c79bdc-d2b1-4a0a-bf96-b84972dbd1c7 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:08.234103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c79bdc-d2b1-4a0a-bf96-b84972dbd1c7 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:08.239485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365f24b-17e8-4a82-9811-5c2b92dfd7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:08.240101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365f24b-17e8-4a82-9811-5c2b92dfd7cb admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:08.240387 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365f24b-17e8-4a82-9811-5c2b92dfd7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:08.240666 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365f24b-17e8-4a82-9811-5c2b92dfd7cb admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:08.241338 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365f24b-17e8-4a82-9811-5c2b92dfd7cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:08.243306 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365f24b-17e8-4a82-9811-5c2b92dfd7cb admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:08.338909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1263/2505] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:09:08 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:09:08.340030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dd307-8ef2-4341-b327-33fc02ebf9d4 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:08.350631 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dd307-8ef2-4341-b327-33fc02ebf9d4 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:08.408433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8e3d1-15c6-486c-853e-d617c422d710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:08.409086 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8e3d1-15c6-486c-853e-d617c422d710 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:08.409370 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8e3d1-15c6-486c-853e-d617c422d710 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:08.409647 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8e3d1-15c6-486c-853e-d617c422d710 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:08.411129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8e3d1-15c6-486c-853e-d617c422d710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:08.413022 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8e3d1-15c6-486c-853e-d617c422d710 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:08.504073 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1243/2506] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:09:08 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:09:08.508413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365f24b-17e8-4a82-9811-5c2b92dfd7cb admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:08.518944 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365f24b-17e8-4a82-9811-5c2b92dfd7cb admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:08.523849 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ab735-b9df-4df0-a26d-dcca73107a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:08.524459 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ab735-b9df-4df0-a26d-dcca73107a86 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:08.524739 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ab735-b9df-4df0-a26d-dcca73107a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:08.525014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ab735-b9df-4df0-a26d-dcca73107a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:08.525700 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ab735-b9df-4df0-a26d-dcca73107a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:08.527335 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ab735-b9df-4df0-a26d-dcca73107a86 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:08.538251 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1264/2507] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:09:08.542292 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8e3d1-15c6-486c-853e-d617c422d710 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:08.552790 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8e3d1-15c6-486c-853e-d617c422d710 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:08.557579 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890d1bb-a63a-4430-a8c8-02271ef4a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:08.568027 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890d1bb-a63a-4430-a8c8-02271ef4a08c admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:08.568027 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890d1bb-a63a-4430-a8c8-02271ef4a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:08.568027 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890d1bb-a63a-4430-a8c8-02271ef4a08c admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:08.568027 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890d1bb-a63a-4430-a8c8-02271ef4a08c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:08.568027 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890d1bb-a63a-4430-a8c8-02271ef4a08c admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:08.571510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1244/2508] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:09:08.575815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ab735-b9df-4df0-a26d-dcca73107a86 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:08.585886 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ab735-b9df-4df0-a26d-dcca73107a86 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:08.596733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97df36-dedb-4e84-a4e2-b81fb52c9d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:08.596733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97df36-dedb-4e84-a4e2-b81fb52c9d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:08.596733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97df36-dedb-4e84-a4e2-b81fb52c9d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:08.596733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97df36-dedb-4e84-a4e2-b81fb52c9d24 admin admin] PATH_INFO: `/v3/projects/8d8b1aa714e24754b2c8836dc385b606/users/79e0594405e3437186c2aa75baab9930/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:08.607373 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97df36-dedb-4e84-a4e2-b81fb52c9d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d8b1aa714e24754b2c8836dc385b606, user_id=79e0594405e3437186c2aa75baab9930, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:08.610030 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97df36-dedb-4e84-a4e2-b81fb52c9d24 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:08.699420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1265/2509] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:09:08 2022] PUT /identity/v3/projects/8d8b1aa714e24754b2c8836dc385b606/users/79e0594405e3437186c2aa75baab9930/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:08.711249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024828a-9842-4dc8-bdb6-fad1e360f8c0 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:08.711536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024828a-9842-4dc8-bdb6-fad1e360f8c0 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:08.711815 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024828a-9842-4dc8-bdb6-fad1e360f8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:08.739645 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-0024828a-9842-4dc8-bdb6-fad1e360f8c0 None None] MFA Rules not processed for user `79e0594405e3437186c2aa75baab9930`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:08.740917 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-0024828a-9842-4dc8-bdb6-fad1e360f8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:08.806695 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1245/2510] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:08.818621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97df36-dedb-4e84-a4e2-b81fb52c9d24 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:08.820327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-8e97df36-dedb-4e84-a4e2-b81fb52c9d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:08.836156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:08.896771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97df36-dedb-4e84-a4e2-b81fb52c9d24 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:08.902901 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007214b-f858-4efa-9af9-8baf6c8568c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:08.903518 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007214b-f858-4efa-9af9-8baf6c8568c5 service nova] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:08.903800 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007214b-f858-4efa-9af9-8baf6c8568c5 service nova] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:08.904075 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007214b-f858-4efa-9af9-8baf6c8568c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:08.911959 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007214b-f858-4efa-9af9-8baf6c8568c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:08.913541 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007214b-f858-4efa-9af9-8baf6c8568c5 service nova] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:08.923124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1266/2511] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:09.137418 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024828a-9842-4dc8-bdb6-fad1e360f8c0 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:09.200697 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024828a-9842-4dc8-bdb6-fad1e360f8c0 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:09.205204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b679e-70e1-40cb-9331-e8fda06bf06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:09.205837 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b679e-70e1-40cb-9331-e8fda06bf06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:09.206117 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b679e-70e1-40cb-9331-e8fda06bf06a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:09.206399 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b679e-70e1-40cb-9331-e8fda06bf06a admin admin] PATH_INFO: `/v3/users/79e0594405e3437186c2aa75baab9930` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:09.207558 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b679e-70e1-40cb-9331-e8fda06bf06a admin admin] RBAC: Authorizing `identity:delete_user(user_id=79e0594405e3437186c2aa75baab9930)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:09.209481 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b679e-70e1-40cb-9331-e8fda06bf06a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:09.211735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:09.432921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6e6b679e-70e1-40cb-9331-e8fda06bf06a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79e0594405e3437186c2aa75baab9930'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:09.440178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6e6b679e-70e1-40cb-9331-e8fda06bf06a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79e0594405e3437186c2aa75baab9930'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:09.452055 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6e6b679e-70e1-40cb-9331-e8fda06bf06a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79e0594405e3437186c2aa75baab9930'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:09.452777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6e6b679e-70e1-40cb-9331-e8fda06bf06a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79e0594405e3437186c2aa75baab9930'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:09.453399 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-6e6b679e-70e1-40cb-9331-e8fda06bf06a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79e0594405e3437186c2aa75baab9930'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:09.555542 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1246/2512] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:09:09 2022] DELETE /identity/v3/users/79e0594405e3437186c2aa75baab9930 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:09.560251 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065526b4-7939-4856-b415-073eed469b03 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:09.560691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065526b4-7939-4856-b415-073eed469b03 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:09.560797 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065526b4-7939-4856-b415-073eed469b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:09.587048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-065526b4-7939-4856-b415-073eed469b03 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:09.588253 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-065526b4-7939-4856-b415-073eed469b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:09.654119 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1267/2513] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:09:09.665230 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b679e-70e1-40cb-9331-e8fda06bf06a admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:09.666733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-6e6b679e-70e1-40cb-9331-e8fda06bf06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:09.737785 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b679e-70e1-40cb-9331-e8fda06bf06a admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:09.741364 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdcc62-d1b2-4e7a-87af-e86836b45fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:09.741972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdcc62-d1b2-4e7a-87af-e86836b45fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:09.742253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdcc62-d1b2-4e7a-87af-e86836b45fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:09.742556 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdcc62-d1b2-4e7a-87af-e86836b45fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:09.751349 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdcc62-d1b2-4e7a-87af-e86836b45fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:09.752759 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdcc62-d1b2-4e7a-87af-e86836b45fa6 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:09.761949 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1247/2514] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:10.180436 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065526b4-7939-4856-b415-073eed469b03 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:10.181876 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-065526b4-7939-4856-b415-073eed469b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:10.195072 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065526b4-7939-4856-b415-073eed469b03 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:10.203087 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39e657-e9f3-4349-8d62-1c7b28013c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:10.203785 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39e657-e9f3-4349-8d62-1c7b28013c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:10.204146 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39e657-e9f3-4349-8d62-1c7b28013c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:10.204330 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39e657-e9f3-4349-8d62-1c7b28013c70 admin admin] PATH_INFO: `/v3/projects/8d8b1aa714e24754b2c8836dc385b606` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:10.205611 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39e657-e9f3-4349-8d62-1c7b28013c70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d8b1aa714e24754b2c8836dc385b606)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:10.207556 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39e657-e9f3-4349-8d62-1c7b28013c70 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:10.304218 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fb39e657-e9f3-4349-8d62-1c7b28013c70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d8b1aa714e24754b2c8836dc385b606', 'request_id': 'req-fb39e657-e9f3-4349-8d62-1c7b28013c70'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:10.310469 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fb39e657-e9f3-4349-8d62-1c7b28013c70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d8b1aa714e24754b2c8836dc385b606', 'request_id': 'req-fb39e657-e9f3-4349-8d62-1c7b28013c70'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:10.315928 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fb39e657-e9f3-4349-8d62-1c7b28013c70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d8b1aa714e24754b2c8836dc385b606', 'request_id': 'req-fb39e657-e9f3-4349-8d62-1c7b28013c70'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:10.377232 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fb39e657-e9f3-4349-8d62-1c7b28013c70 admin admin] The token cache is being invalidate because project 8d8b1aa714e24754b2c8836dc385b606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:09:10.377519 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fb39e657-e9f3-4349-8d62-1c7b28013c70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:10.378141 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-fb39e657-e9f3-4349-8d62-1c7b28013c70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:10.380171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1268/2515] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:09:10 2022] DELETE /identity/v3/projects/8d8b1aa714e24754b2c8836dc385b606 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:10.385343 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdaf26-2a43-4c26-83ef-bcc077709d7e None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:10.385829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdaf26-2a43-4c26-83ef-bcc077709d7e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:10.385966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdaf26-2a43-4c26-83ef-bcc077709d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:10.406210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-4ebdaf26-2a43-4c26-83ef-bcc077709d7e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:10.407453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4ebdaf26-2a43-4c26-83ef-bcc077709d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:10.466866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1248/2516] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:10.474734 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ed940-408a-481a-b0b4-f8c5e7b1424e None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:10.475027 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ed940-408a-481a-b0b4-f8c5e7b1424e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:10.475306 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ed940-408a-481a-b0b4-f8c5e7b1424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:10.495170 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-a82ed940-408a-481a-b0b4-f8c5e7b1424e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:10.496367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a82ed940-408a-481a-b0b4-f8c5e7b1424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:10.504540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1269/2517] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:10.509281 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdaf26-2a43-4c26-83ef-bcc077709d7e None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:10.518955 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdaf26-2a43-4c26-83ef-bcc077709d7e None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:10.523524 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b60bb7-7c4f-46f9-80d9-fbc89701e874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:10.525866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b60bb7-7c4f-46f9-80d9-fbc89701e874 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:10.525866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b60bb7-7c4f-46f9-80d9-fbc89701e874 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:10.525866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b60bb7-7c4f-46f9-80d9-fbc89701e874 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:10.525866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b60bb7-7c4f-46f9-80d9-fbc89701e874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:09:10.525866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b60bb7-7c4f-46f9-80d9-fbc89701e874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:10.527239 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b60bb7-7c4f-46f9-80d9-fbc89701e874 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:10.539446 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1249/2518] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:09:10.543805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ed940-408a-481a-b0b4-f8c5e7b1424e None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:10.553855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ed940-408a-481a-b0b4-f8c5e7b1424e None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:10.558718 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b5b4f-f968-4c59-bb2c-b81426556db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:10.559340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b5b4f-f968-4c59-bb2c-b81426556db4 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:10.559774 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b5b4f-f968-4c59-bb2c-b81426556db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:10.560059 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b5b4f-f968-4c59-bb2c-b81426556db4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:10.560729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b5b4f-f968-4c59-bb2c-b81426556db4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:10.562745 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b5b4f-f968-4c59-bb2c-b81426556db4 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:10.577942 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:10.661535 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1270/2519] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:09:10 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:09:10.667477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b60bb7-7c4f-46f9-80d9-fbc89701e874 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:10.687712 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b60bb7-7c4f-46f9-80d9-fbc89701e874 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:10.696214 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:10.744744 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096e76a-c3d7-4a80-a528-0052ab539c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:10.745368 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096e76a-c3d7-4a80-a528-0052ab539c03 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:10.745700 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096e76a-c3d7-4a80-a528-0052ab539c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:10.745907 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096e76a-c3d7-4a80-a528-0052ab539c03 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:10.746616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096e76a-c3d7-4a80-a528-0052ab539c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:10.748654 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096e76a-c3d7-4a80-a528-0052ab539c03 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:10.830110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1250/2520] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:09:10 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:09:10.834295 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b5b4f-f968-4c59-bb2c-b81426556db4 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:10.845195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b5b4f-f968-4c59-bb2c-b81426556db4 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:10.850629 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c9f9f-79e0-4171-a871-6d988b971864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:10.851601 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c9f9f-79e0-4171-a871-6d988b971864 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:10.851601 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c9f9f-79e0-4171-a871-6d988b971864 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:10.851828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c9f9f-79e0-4171-a871-6d988b971864 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:10.852461 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c9f9f-79e0-4171-a871-6d988b971864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:10.854105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c9f9f-79e0-4171-a871-6d988b971864 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:10.874954 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1271/2521] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:09:10.876145 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096e76a-c3d7-4a80-a528-0052ab539c03 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:10.885990 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096e76a-c3d7-4a80-a528-0052ab539c03 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:10.890581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba375b-f509-45f1-b0e7-8ad3ba6c1ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:10.891200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba375b-f509-45f1-b0e7-8ad3ba6c1ffa admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:10.891699 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba375b-f509-45f1-b0e7-8ad3ba6c1ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:10.892153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba375b-f509-45f1-b0e7-8ad3ba6c1ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:10.893306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba375b-f509-45f1-b0e7-8ad3ba6c1ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:10.895004 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba375b-f509-45f1-b0e7-8ad3ba6c1ffa admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:10.906532 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1251/2522] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:09:10.911155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c9f9f-79e0-4171-a871-6d988b971864 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:10.921880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c9f9f-79e0-4171-a871-6d988b971864 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:10.926563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26a168-9c2f-4295-8269-2e31b2ff5e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:10.927266 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26a168-9c2f-4295-8269-2e31b2ff5e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:10.927553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26a168-9c2f-4295-8269-2e31b2ff5e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:10.927849 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26a168-9c2f-4295-8269-2e31b2ff5e18 admin admin] PATH_INFO: `/v3/projects/1f24a54e3d724d7c94141a09b4608c6e/users/6c77d81281b24136a676b0c63afa51a9/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:10.942889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26a168-9c2f-4295-8269-2e31b2ff5e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f24a54e3d724d7c94141a09b4608c6e, user_id=6c77d81281b24136a676b0c63afa51a9, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:10.945836 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26a168-9c2f-4295-8269-2e31b2ff5e18 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:11.030046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1272/2523] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:09:10 2022] PUT /identity/v3/projects/1f24a54e3d724d7c94141a09b4608c6e/users/6c77d81281b24136a676b0c63afa51a9/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:11.047891 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0048a05-1a2b-43eb-96b1-2b8b77717819 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:11.048294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0048a05-1a2b-43eb-96b1-2b8b77717819 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:11.048640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0048a05-1a2b-43eb-96b1-2b8b77717819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:11.076154 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-b0048a05-1a2b-43eb-96b1-2b8b77717819 None None] MFA Rules not processed for user `6c77d81281b24136a676b0c63afa51a9`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:11.077367 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b0048a05-1a2b-43eb-96b1-2b8b77717819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:11.142665 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1252/2524] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:11.147619 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26a168-9c2f-4295-8269-2e31b2ff5e18 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:11.210464 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26a168-9c2f-4295-8269-2e31b2ff5e18 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:11.215283 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f064fa3-55b7-4621-a393-1ac21acd9a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:11.215896 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f064fa3-55b7-4621-a393-1ac21acd9a3e admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:11.216184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f064fa3-55b7-4621-a393-1ac21acd9a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:11.216461 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f064fa3-55b7-4621-a393-1ac21acd9a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:11.217124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f064fa3-55b7-4621-a393-1ac21acd9a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:11.219075 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f064fa3-55b7-4621-a393-1ac21acd9a3e admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:11.326371 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1273/2525] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:09:11 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:09:11.327514 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0048a05-1a2b-43eb-96b1-2b8b77717819 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:11.338896 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0048a05-1a2b-43eb-96b1-2b8b77717819 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:11.394546 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eebe8d-3dd1-4023-b267-f1b112072a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:11.395248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eebe8d-3dd1-4023-b267-f1b112072a09 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:11.395428 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eebe8d-3dd1-4023-b267-f1b112072a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:11.395734 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eebe8d-3dd1-4023-b267-f1b112072a09 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:11.396953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eebe8d-3dd1-4023-b267-f1b112072a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:11.398880 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eebe8d-3dd1-4023-b267-f1b112072a09 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:11.518801 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1253/2526] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:09:11 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:09:11.520086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f064fa3-55b7-4621-a393-1ac21acd9a3e admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:11.531807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f064fa3-55b7-4621-a393-1ac21acd9a3e admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:11.536927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a562a-13b1-4033-8836-036472690f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:11.537552 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a562a-13b1-4033-8836-036472690f47 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:11.537848 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a562a-13b1-4033-8836-036472690f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:11.538129 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a562a-13b1-4033-8836-036472690f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:11.538870 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a562a-13b1-4033-8836-036472690f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:11.540512 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a562a-13b1-4033-8836-036472690f47 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:11.556019 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1274/2527] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:09:11.557117 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eebe8d-3dd1-4023-b267-f1b112072a09 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:11.569204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eebe8d-3dd1-4023-b267-f1b112072a09 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:11.573920 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1cb89-4ab2-472e-aaea-a30b3bca9bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:11.574645 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1cb89-4ab2-472e-aaea-a30b3bca9bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:11.574929 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1cb89-4ab2-472e-aaea-a30b3bca9bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:11.575213 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1cb89-4ab2-472e-aaea-a30b3bca9bc0 admin admin] PATH_INFO: `/v3/projects/033b85ab169f4fc09c3a9499e047339f/users/38f9f52ac7474067bb9ab6df5c375bb3/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:11.578617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:11.591796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1cb89-4ab2-472e-aaea-a30b3bca9bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=033b85ab169f4fc09c3a9499e047339f, user_id=38f9f52ac7474067bb9ab6df5c375bb3, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:11.594489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1cb89-4ab2-472e-aaea-a30b3bca9bc0 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:11.738775 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1254/2528] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:09:11 2022] PUT /identity/v3/projects/033b85ab169f4fc09c3a9499e047339f/users/38f9f52ac7474067bb9ab6df5c375bb3/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:09:11.743532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a562a-13b1-4033-8836-036472690f47 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:11.754327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a562a-13b1-4033-8836-036472690f47 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:11.815039 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a457cb-3a6d-4394-bcfb-0d49690229a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:11.815699 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a457cb-3a6d-4394-bcfb-0d49690229a3 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:11.815988 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a457cb-3a6d-4394-bcfb-0d49690229a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:11.816268 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a457cb-3a6d-4394-bcfb-0d49690229a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:11.817342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a457cb-3a6d-4394-bcfb-0d49690229a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:11.819534 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a457cb-3a6d-4394-bcfb-0d49690229a3 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:11.831757 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1275/2529] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:09:11.835863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1cb89-4ab2-472e-aaea-a30b3bca9bc0 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:11.846859 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1cb89-4ab2-472e-aaea-a30b3bca9bc0 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:11.854583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16f0c1-d7a4-4309-9746-14f1d0a5716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:11.855458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16f0c1-d7a4-4309-9746-14f1d0a5716e admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:11.855852 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16f0c1-d7a4-4309-9746-14f1d0a5716e admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:11.856485 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16f0c1-d7a4-4309-9746-14f1d0a5716e admin admin] PATH_INFO: `/v3/projects/033b85ab169f4fc09c3a9499e047339f/users/38f9f52ac7474067bb9ab6df5c375bb3/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:11.858757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16f0c1-d7a4-4309-9746-14f1d0a5716e admin admin] RBAC: Authorizing `identity:create_grant(project_id=033b85ab169f4fc09c3a9499e047339f, user_id=38f9f52ac7474067bb9ab6df5c375bb3, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:11.861150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16f0c1-d7a4-4309-9746-14f1d0a5716e admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:11.873446 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1255/2530] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:09:11 2022] PUT /identity/v3/projects/033b85ab169f4fc09c3a9499e047339f/users/38f9f52ac7474067bb9ab6df5c375bb3/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:11.885934 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aec06-b4ac-423d-b3c5-917422084936 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:11.886228 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aec06-b4ac-423d-b3c5-917422084936 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:11.886546 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aec06-b4ac-423d-b3c5-917422084936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:11.915325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-119aec06-b4ac-423d-b3c5-917422084936 None None] MFA Rules not processed for user `38f9f52ac7474067bb9ab6df5c375bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:11.916560 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-119aec06-b4ac-423d-b3c5-917422084936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:11.935286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:11.997048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1276/2531] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:12.008640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16f0c1-d7a4-4309-9746-14f1d0a5716e admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:12.012744 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2e16f0c1-d7a4-4309-9746-14f1d0a5716e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:12.110120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16f0c1-d7a4-4309-9746-14f1d0a5716e admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:12.113779 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429736b-03e4-4975-a360-f7c28d6989da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:12.114415 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429736b-03e4-4975-a360-f7c28d6989da service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:12.114735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429736b-03e4-4975-a360-f7c28d6989da service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:12.115018 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429736b-03e4-4975-a360-f7c28d6989da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:12.181150 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429736b-03e4-4975-a360-f7c28d6989da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:12.182638 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429736b-03e4-4975-a360-f7c28d6989da service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:12.192466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1256/2532] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:14.148799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119aec06-b4ac-423d-b3c5-917422084936 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:14.150302 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-119aec06-b4ac-423d-b3c5-917422084936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:14.162567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119aec06-b4ac-423d-b3c5-917422084936 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:14.166979 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c12f7c-01ca-4a47-8767-017b27ecf5af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:14.167699 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c12f7c-01ca-4a47-8767-017b27ecf5af service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:14.168054 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c12f7c-01ca-4a47-8767-017b27ecf5af service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:14.168401 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c12f7c-01ca-4a47-8767-017b27ecf5af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:14.191385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c12f7c-01ca-4a47-8767-017b27ecf5af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:14.192861 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c12f7c-01ca-4a47-8767-017b27ecf5af service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:14.203565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1277/2533] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:18.405505 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429736b-03e4-4975-a360-f7c28d6989da service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:18.467257 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429736b-03e4-4975-a360-f7c28d6989da service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:18.471682 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc9737-e87c-413e-9dfc-689b295744bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:18.472312 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc9737-e87c-413e-9dfc-689b295744bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:18.472594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc9737-e87c-413e-9dfc-689b295744bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:18.472868 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc9737-e87c-413e-9dfc-689b295744bc admin admin] PATH_INFO: `/v3/users/6c77d81281b24136a676b0c63afa51a9` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:18.474004 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc9737-e87c-413e-9dfc-689b295744bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c77d81281b24136a676b0c63afa51a9)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:18.475925 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc9737-e87c-413e-9dfc-689b295744bc admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:18.481510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:18.666410 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f9bc9737-e87c-413e-9dfc-689b295744bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c77d81281b24136a676b0c63afa51a9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:18.674513 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f9bc9737-e87c-413e-9dfc-689b295744bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c77d81281b24136a676b0c63afa51a9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:18.686761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f9bc9737-e87c-413e-9dfc-689b295744bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c77d81281b24136a676b0c63afa51a9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:18.687473 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f9bc9737-e87c-413e-9dfc-689b295744bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c77d81281b24136a676b0c63afa51a9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:18.688071 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-f9bc9737-e87c-413e-9dfc-689b295744bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c77d81281b24136a676b0c63afa51a9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:18.737965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1257/2534] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:09:18 2022] DELETE /identity/v3/users/6c77d81281b24136a676b0c63afa51a9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:18.742489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e80a97-855a-46f0-b897-d209c3a7d66f None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:18.742960 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e80a97-855a-46f0-b897-d209c3a7d66f None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:18.744162 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e80a97-855a-46f0-b897-d209c3a7d66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:18.764593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-90e80a97-855a-46f0-b897-d209c3a7d66f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:18.765811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-90e80a97-855a-46f0-b897-d209c3a7d66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:18.827150 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1278/2535] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:18.836748 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc9737-e87c-413e-9dfc-689b295744bc admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:18.838151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f9bc9737-e87c-413e-9dfc-689b295744bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:18.894885 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc9737-e87c-413e-9dfc-689b295744bc admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:18.898442 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba466cc3-b1c2-423f-889a-122abb5c164c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:18.899053 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba466cc3-b1c2-423f-889a-122abb5c164c service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:18.899330 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba466cc3-b1c2-423f-889a-122abb5c164c service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:18.899601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba466cc3-b1c2-423f-889a-122abb5c164c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:18.908483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba466cc3-b1c2-423f-889a-122abb5c164c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:18.909971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba466cc3-b1c2-423f-889a-122abb5c164c service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:18.920874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1258/2536] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:19.343822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e80a97-855a-46f0-b897-d209c3a7d66f None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:19.345386 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-90e80a97-855a-46f0-b897-d209c3a7d66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:19.361159 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e80a97-855a-46f0-b897-d209c3a7d66f None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:19.368503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881743e6-2229-452e-865f-0a3969b8a6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:19.369278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881743e6-2229-452e-865f-0a3969b8a6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:19.369567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881743e6-2229-452e-865f-0a3969b8a6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:19.369854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881743e6-2229-452e-865f-0a3969b8a6c4 admin admin] PATH_INFO: `/v3/projects/1f24a54e3d724d7c94141a09b4608c6e` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:19.371170 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881743e6-2229-452e-865f-0a3969b8a6c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f24a54e3d724d7c94141a09b4608c6e)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:19.373279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881743e6-2229-452e-865f-0a3969b8a6c4 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:19.472994 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-881743e6-2229-452e-865f-0a3969b8a6c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f24a54e3d724d7c94141a09b4608c6e', 'request_id': 'req-881743e6-2229-452e-865f-0a3969b8a6c4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:19.479165 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-881743e6-2229-452e-865f-0a3969b8a6c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f24a54e3d724d7c94141a09b4608c6e', 'request_id': 'req-881743e6-2229-452e-865f-0a3969b8a6c4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:19.486555 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-881743e6-2229-452e-865f-0a3969b8a6c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f24a54e3d724d7c94141a09b4608c6e', 'request_id': 'req-881743e6-2229-452e-865f-0a3969b8a6c4'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:19.538574 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-881743e6-2229-452e-865f-0a3969b8a6c4 admin admin] The token cache is being invalidate because project 1f24a54e3d724d7c94141a09b4608c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:09:19.538865 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-881743e6-2229-452e-865f-0a3969b8a6c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:19.539565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-881743e6-2229-452e-865f-0a3969b8a6c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:19.541325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1279/2537] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:09:19 2022] DELETE /identity/v3/projects/1f24a54e3d724d7c94141a09b4608c6e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:19.545242 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba466cc3-b1c2-423f-889a-122abb5c164c service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:19.555060 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba466cc3-b1c2-423f-889a-122abb5c164c service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:19.620725 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748e3e2-05f4-4be8-8932-4508ae33c0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:19.621375 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748e3e2-05f4-4be8-8932-4508ae33c0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:19.621663 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748e3e2-05f4-4be8-8932-4508ae33c0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:19.621947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748e3e2-05f4-4be8-8932-4508ae33c0b0 admin admin] PATH_INFO: `/v3/users/38f9f52ac7474067bb9ab6df5c375bb3` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:19.623170 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748e3e2-05f4-4be8-8932-4508ae33c0b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f9f52ac7474067bb9ab6df5c375bb3)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:19.625194 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748e3e2-05f4-4be8-8932-4508ae33c0b0 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:19.755422 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:19.769105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-c748e3e2-05f4-4be8-8932-4508ae33c0b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f9f52ac7474067bb9ab6df5c375bb3'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:19.777977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-c748e3e2-05f4-4be8-8932-4508ae33c0b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f9f52ac7474067bb9ab6df5c375bb3'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:19.791269 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-c748e3e2-05f4-4be8-8932-4508ae33c0b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f9f52ac7474067bb9ab6df5c375bb3'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:19.791994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-c748e3e2-05f4-4be8-8932-4508ae33c0b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f9f52ac7474067bb9ab6df5c375bb3'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:19.792658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-c748e3e2-05f4-4be8-8932-4508ae33c0b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f9f52ac7474067bb9ab6df5c375bb3'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:19.864792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1259/2538] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:09:19 2022] DELETE /identity/v3/users/38f9f52ac7474067bb9ab6df5c375bb3 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:20.242666 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881743e6-2229-452e-865f-0a3969b8a6c4 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:20.244511 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-881743e6-2229-452e-865f-0a3969b8a6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:20.259434 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881743e6-2229-452e-865f-0a3969b8a6c4 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:20.280998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:20.317917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b155aa-0f57-4181-8901-ec96c01b8a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:20.318595 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b155aa-0f57-4181-8901-ec96c01b8a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:20.318876 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b155aa-0f57-4181-8901-ec96c01b8a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:20.319153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b155aa-0f57-4181-8901-ec96c01b8a3d admin admin] PATH_INFO: `/v3/projects/033b85ab169f4fc09c3a9499e047339f` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:20.320378 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b155aa-0f57-4181-8901-ec96c01b8a3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=033b85ab169f4fc09c3a9499e047339f)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:20.322353 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b155aa-0f57-4181-8901-ec96c01b8a3d admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:20.406116 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-62b155aa-0f57-4181-8901-ec96c01b8a3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033b85ab169f4fc09c3a9499e047339f', 'request_id': 'req-62b155aa-0f57-4181-8901-ec96c01b8a3d'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:20.412813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-62b155aa-0f57-4181-8901-ec96c01b8a3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033b85ab169f4fc09c3a9499e047339f', 'request_id': 'req-62b155aa-0f57-4181-8901-ec96c01b8a3d'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:20.418421 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-62b155aa-0f57-4181-8901-ec96c01b8a3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033b85ab169f4fc09c3a9499e047339f', 'request_id': 'req-62b155aa-0f57-4181-8901-ec96c01b8a3d'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:20.491852 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-62b155aa-0f57-4181-8901-ec96c01b8a3d admin admin] The token cache is being invalidate because project 033b85ab169f4fc09c3a9499e047339f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:09:20.492127 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-62b155aa-0f57-4181-8901-ec96c01b8a3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:20.492801 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-62b155aa-0f57-4181-8901-ec96c01b8a3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:20.494323 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1280/2539] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:09:20 2022] DELETE /identity/v3/projects/033b85ab169f4fc09c3a9499e047339f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:20.499900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace912e1-f79f-4b6a-a120-c48381d8d4ce None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:20.500193 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace912e1-f79f-4b6a-a120-c48381d8d4ce None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:20.500476 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace912e1-f79f-4b6a-a120-c48381d8d4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:20.520733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-ace912e1-f79f-4b6a-a120-c48381d8d4ce None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:20.521867 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ace912e1-f79f-4b6a-a120-c48381d8d4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:20.582765 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1260/2540] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:20.590754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907f76f-e893-4812-8d94-31e2d0ffce2e None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:20.591046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907f76f-e893-4812-8d94-31e2d0ffce2e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:20.591329 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907f76f-e893-4812-8d94-31e2d0ffce2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:20.610682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-2907f76f-e893-4812-8d94-31e2d0ffce2e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:20.611921 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2907f76f-e893-4812-8d94-31e2d0ffce2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:20.619807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1281/2541] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:20.624566 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace912e1-f79f-4b6a-a120-c48381d8d4ce None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:20.634179 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace912e1-f79f-4b6a-a120-c48381d8d4ce None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:20.639396 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710c965-7f95-4fa7-97f2-cf3d50c3c055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:20.639996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710c965-7f95-4fa7-97f2-cf3d50c3c055 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:20.640275 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710c965-7f95-4fa7-97f2-cf3d50c3c055 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:20.640549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710c965-7f95-4fa7-97f2-cf3d50c3c055 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:20.641232 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710c965-7f95-4fa7-97f2-cf3d50c3c055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:09:20.641534 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710c965-7f95-4fa7-97f2-cf3d50c3c055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:20.643223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710c965-7f95-4fa7-97f2-cf3d50c3c055 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:20.659417 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1261/2542] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:09:20.660271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907f76f-e893-4812-8d94-31e2d0ffce2e None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:20.670150 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907f76f-e893-4812-8d94-31e2d0ffce2e None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:20.675124 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60542554-d707-4e37-bd48-885cd766090b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:20.675748 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60542554-d707-4e37-bd48-885cd766090b admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:20.676033 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60542554-d707-4e37-bd48-885cd766090b admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:20.676312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60542554-d707-4e37-bd48-885cd766090b admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:20.676983 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60542554-d707-4e37-bd48-885cd766090b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:20.679023 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60542554-d707-4e37-bd48-885cd766090b admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:20.757455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1282/2543] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:09:20 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:09:20.761539 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710c965-7f95-4fa7-97f2-cf3d50c3c055 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:20.773985 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710c965-7f95-4fa7-97f2-cf3d50c3c055 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:20.833009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f98ad2-af2e-42fc-92fe-f88151edb56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:20.833623 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f98ad2-af2e-42fc-92fe-f88151edb56e admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:20.833904 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f98ad2-af2e-42fc-92fe-f88151edb56e admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:20.834178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f98ad2-af2e-42fc-92fe-f88151edb56e admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:20.834869 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f98ad2-af2e-42fc-92fe-f88151edb56e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:20.836761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f98ad2-af2e-42fc-92fe-f88151edb56e admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:20.921675 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1262/2544] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:09:20 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:09:20.925926 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60542554-d707-4e37-bd48-885cd766090b admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:20.937415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60542554-d707-4e37-bd48-885cd766090b admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:20.942256 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1772cf-41ca-4e58-98ec-2f99ff64f23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:20.942909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1772cf-41ca-4e58-98ec-2f99ff64f23b admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:20.943198 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1772cf-41ca-4e58-98ec-2f99ff64f23b admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:20.943478 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1772cf-41ca-4e58-98ec-2f99ff64f23b admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:20.944177 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1772cf-41ca-4e58-98ec-2f99ff64f23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:20.945784 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1772cf-41ca-4e58-98ec-2f99ff64f23b admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:20.956024 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1283/2545] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:09:20.960091 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f98ad2-af2e-42fc-92fe-f88151edb56e admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:20.970036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f98ad2-af2e-42fc-92fe-f88151edb56e admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:20.974660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709625c-2dd9-4609-9dce-5dcb9d98a51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:20.975259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709625c-2dd9-4609-9dce-5dcb9d98a51b admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:20.975541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709625c-2dd9-4609-9dce-5dcb9d98a51b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:20.975820 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709625c-2dd9-4609-9dce-5dcb9d98a51b admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:20.976816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709625c-2dd9-4609-9dce-5dcb9d98a51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:20.978423 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709625c-2dd9-4609-9dce-5dcb9d98a51b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:20.991072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1263/2546] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:09:20.995326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1772cf-41ca-4e58-98ec-2f99ff64f23b admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:21.006322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1772cf-41ca-4e58-98ec-2f99ff64f23b admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:21.010969 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb70ab0-4a5e-4943-b7b0-2e786d35e7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:21.011626 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb70ab0-4a5e-4943-b7b0-2e786d35e7b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:21.011907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb70ab0-4a5e-4943-b7b0-2e786d35e7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:21.012184 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb70ab0-4a5e-4943-b7b0-2e786d35e7b6 admin admin] PATH_INFO: `/v3/projects/a9cfb301f6e545c18f5d4f929f66fc11/users/5828a02b11764055bdb09189db5ffea2/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:21.026525 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb70ab0-4a5e-4943-b7b0-2e786d35e7b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9cfb301f6e545c18f5d4f929f66fc11, user_id=5828a02b11764055bdb09189db5ffea2, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:21.029186 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb70ab0-4a5e-4943-b7b0-2e786d35e7b6 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:21.127919 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1284/2547] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:09:20 2022] PUT /identity/v3/projects/a9cfb301f6e545c18f5d4f929f66fc11/users/5828a02b11764055bdb09189db5ffea2/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:21.139720 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4027d75-0552-4f6c-a6e7-2ce306a8448c None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:21.140015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4027d75-0552-4f6c-a6e7-2ce306a8448c None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:21.140289 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4027d75-0552-4f6c-a6e7-2ce306a8448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:21.165234 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:21.168202 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-c4027d75-0552-4f6c-a6e7-2ce306a8448c None None] MFA Rules not processed for user `5828a02b11764055bdb09189db5ffea2`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:21.169408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-c4027d75-0552-4f6c-a6e7-2ce306a8448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:21.233192 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1264/2548] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:21.237655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb70ab0-4a5e-4943-b7b0-2e786d35e7b6 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:21.288938 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:21.300057 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb70ab0-4a5e-4943-b7b0-2e786d35e7b6 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:21.304772 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34865f6e-e645-42d9-8ef9-7b80010ffba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:21.305382 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34865f6e-e645-42d9-8ef9-7b80010ffba4 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:21.305670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34865f6e-e645-42d9-8ef9-7b80010ffba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:21.305945 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34865f6e-e645-42d9-8ef9-7b80010ffba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:21.306655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34865f6e-e645-42d9-8ef9-7b80010ffba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:21.308544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34865f6e-e645-42d9-8ef9-7b80010ffba4 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:21.430174 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1285/2549] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:09:21 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:09:21.434455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4027d75-0552-4f6c-a6e7-2ce306a8448c None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:21.445444 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4027d75-0552-4f6c-a6e7-2ce306a8448c None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:21.500874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a839f97-ca2f-4e69-8217-875fc18f0ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:21.501483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a839f97-ca2f-4e69-8217-875fc18f0ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:21.501770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a839f97-ca2f-4e69-8217-875fc18f0ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:21.502048 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a839f97-ca2f-4e69-8217-875fc18f0ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:21.502748 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a839f97-ca2f-4e69-8217-875fc18f0ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:21.504664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a839f97-ca2f-4e69-8217-875fc18f0ef7 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:21.629690 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1265/2550] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:09:21 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:09:21.633607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34865f6e-e645-42d9-8ef9-7b80010ffba4 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:21.645364 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34865f6e-e645-42d9-8ef9-7b80010ffba4 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:21.649856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4352262-c89c-4004-9c10-4152623122e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:21.650512 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4352262-c89c-4004-9c10-4152623122e5 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:21.650798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4352262-c89c-4004-9c10-4152623122e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:21.651189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4352262-c89c-4004-9c10-4152623122e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:21.651911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4352262-c89c-4004-9c10-4152623122e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:21.653499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4352262-c89c-4004-9c10-4152623122e5 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:21.664451 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1286/2551] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:09:21.668546 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a839f97-ca2f-4e69-8217-875fc18f0ef7 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:21.678903 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a839f97-ca2f-4e69-8217-875fc18f0ef7 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:21.683873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c722416-e0ae-45a6-8ba0-bfaf8c76a012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:21.684664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c722416-e0ae-45a6-8ba0-bfaf8c76a012 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:21.684966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c722416-e0ae-45a6-8ba0-bfaf8c76a012 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:21.685264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c722416-e0ae-45a6-8ba0-bfaf8c76a012 admin admin] PATH_INFO: `/v3/projects/f69e3f00a2404146b782f338c54e41a1/users/74175d3e35ec4e47ad02a8b57fad659b/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:21.700024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c722416-e0ae-45a6-8ba0-bfaf8c76a012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f69e3f00a2404146b782f338c54e41a1, user_id=74175d3e35ec4e47ad02a8b57fad659b, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:21.703174 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c722416-e0ae-45a6-8ba0-bfaf8c76a012 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:21.783706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1266/2552] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:09:21 2022] PUT /identity/v3/projects/f69e3f00a2404146b782f338c54e41a1/users/74175d3e35ec4e47ad02a8b57fad659b/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:21.787922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4352262-c89c-4004-9c10-4152623122e5 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:21.798130 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4352262-c89c-4004-9c10-4152623122e5 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:21.854940 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc55ff-b313-46d9-a248-f57b4628b803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:21.855554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc55ff-b313-46d9-a248-f57b4628b803 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:21.855836 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc55ff-b313-46d9-a248-f57b4628b803 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:21.856111 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc55ff-b313-46d9-a248-f57b4628b803 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:21.856796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc55ff-b313-46d9-a248-f57b4628b803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:21.858432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc55ff-b313-46d9-a248-f57b4628b803 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:21.867912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1287/2553] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:09:21.872260 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c722416-e0ae-45a6-8ba0-bfaf8c76a012 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:21.882499 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c722416-e0ae-45a6-8ba0-bfaf8c76a012 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:21.886907 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dae55d-4cab-4a0d-92c0-e300f1edfda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:21.887585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dae55d-4cab-4a0d-92c0-e300f1edfda2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:21.887867 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dae55d-4cab-4a0d-92c0-e300f1edfda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:21.888644 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dae55d-4cab-4a0d-92c0-e300f1edfda2 admin admin] PATH_INFO: `/v3/projects/f69e3f00a2404146b782f338c54e41a1/users/74175d3e35ec4e47ad02a8b57fad659b/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:21.890729 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dae55d-4cab-4a0d-92c0-e300f1edfda2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f69e3f00a2404146b782f338c54e41a1, user_id=74175d3e35ec4e47ad02a8b57fad659b, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:21.893349 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dae55d-4cab-4a0d-92c0-e300f1edfda2 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:21.903266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1267/2554] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:09:21 2022] PUT /identity/v3/projects/f69e3f00a2404146b782f338c54e41a1/users/74175d3e35ec4e47ad02a8b57fad659b/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:21.914244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75fff1-ec1e-41de-94fa-6d31b9a0dc1b None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:21.914575 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75fff1-ec1e-41de-94fa-6d31b9a0dc1b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:21.914854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75fff1-ec1e-41de-94fa-6d31b9a0dc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:21.941867 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-bf75fff1-ec1e-41de-94fa-6d31b9a0dc1b None None] MFA Rules not processed for user `74175d3e35ec4e47ad02a8b57fad659b`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:21.943257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-bf75fff1-ec1e-41de-94fa-6d31b9a0dc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:22.014749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1288/2555] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:22.025452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dae55d-4cab-4a0d-92c0-e300f1edfda2 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:22.027245 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d5dae55d-4cab-4a0d-92c0-e300f1edfda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:22.084378 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dae55d-4cab-4a0d-92c0-e300f1edfda2 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:22.087972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6ef86-00fe-40df-9cc0-74a2b1fae05c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:22.088578 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6ef86-00fe-40df-9cc0-74a2b1fae05c service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:22.088856 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6ef86-00fe-40df-9cc0-74a2b1fae05c service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:22.089129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6ef86-00fe-40df-9cc0-74a2b1fae05c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:22.098500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6ef86-00fe-40df-9cc0-74a2b1fae05c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:22.099903 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6ef86-00fe-40df-9cc0-74a2b1fae05c service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:22.103683 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:22.111337 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1268/2556] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:22.221189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75fff1-ec1e-41de-94fa-6d31b9a0dc1b None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:22.230803 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75fff1-ec1e-41de-94fa-6d31b9a0dc1b None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:22.234889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649626e5-4285-42fd-8ce9-cc56c6062f82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:22.235498 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649626e5-4285-42fd-8ce9-cc56c6062f82 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:22.235783 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649626e5-4285-42fd-8ce9-cc56c6062f82 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:22.236062 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649626e5-4285-42fd-8ce9-cc56c6062f82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:22.280145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:22.292892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649626e5-4285-42fd-8ce9-cc56c6062f82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:22.295117 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649626e5-4285-42fd-8ce9-cc56c6062f82 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:22.304093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1289/2557] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:25.460083 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6ef86-00fe-40df-9cc0-74a2b1fae05c service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:25.521241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6ef86-00fe-40df-9cc0-74a2b1fae05c service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:25.525924 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fee13-c187-4433-8ad3-cff4f80c2d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:25.526591 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fee13-c187-4433-8ad3-cff4f80c2d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:25.526878 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fee13-c187-4433-8ad3-cff4f80c2d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:25.527153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fee13-c187-4433-8ad3-cff4f80c2d29 admin admin] PATH_INFO: `/v3/users/5828a02b11764055bdb09189db5ffea2` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:25.528301 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5fee13-c187-4433-8ad3-cff4f80c2d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5828a02b11764055bdb09189db5ffea2)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:25.530372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5fee13-c187-4433-8ad3-cff4f80c2d29 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:25.717472 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ee5fee13-c187-4433-8ad3-cff4f80c2d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5828a02b11764055bdb09189db5ffea2'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:25.724982 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ee5fee13-c187-4433-8ad3-cff4f80c2d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5828a02b11764055bdb09189db5ffea2'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:25.737175 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ee5fee13-c187-4433-8ad3-cff4f80c2d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5828a02b11764055bdb09189db5ffea2'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:25.737839 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ee5fee13-c187-4433-8ad3-cff4f80c2d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5828a02b11764055bdb09189db5ffea2'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:25.738477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ee5fee13-c187-4433-8ad3-cff4f80c2d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5828a02b11764055bdb09189db5ffea2'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:25.824185 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1269/2558] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:09:25 2022] DELETE /identity/v3/users/5828a02b11764055bdb09189db5ffea2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:25.829006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5f222-e4fb-4b6b-9982-5ce488b5f681 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:25.829457 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5f222-e4fb-4b6b-9982-5ce488b5f681 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:25.829616 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5f222-e4fb-4b6b-9982-5ce488b5f681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:25.849193 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-fbe5f222-e4fb-4b6b-9982-5ce488b5f681 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:25.850427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-fbe5f222-e4fb-4b6b-9982-5ce488b5f681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:25.908652 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1290/2559] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:25.918662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fee13-c187-4433-8ad3-cff4f80c2d29 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:25.920070 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ee5fee13-c187-4433-8ad3-cff4f80c2d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:25.980756 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fee13-c187-4433-8ad3-cff4f80c2d29 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:25.985090 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d64ce-5ae4-4277-a6ed-a7a3d00cea4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:25.985709 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d64ce-5ae4-4277-a6ed-a7a3d00cea4a service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:25.985994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d64ce-5ae4-4277-a6ed-a7a3d00cea4a service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:25.986272 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d64ce-5ae4-4277-a6ed-a7a3d00cea4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:25.995228 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d64ce-5ae4-4277-a6ed-a7a3d00cea4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:25.996656 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d64ce-5ae4-4277-a6ed-a7a3d00cea4a service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:26.006080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1270/2560] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:26.399860 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5f222-e4fb-4b6b-9982-5ce488b5f681 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:26.401299 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-fbe5f222-e4fb-4b6b-9982-5ce488b5f681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:26.413932 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5f222-e4fb-4b6b-9982-5ce488b5f681 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:26.418874 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48262f89-2e77-405c-a7c8-da26079549b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:26.419531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48262f89-2e77-405c-a7c8-da26079549b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:26.419822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48262f89-2e77-405c-a7c8-da26079549b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:26.420107 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48262f89-2e77-405c-a7c8-da26079549b1 admin admin] PATH_INFO: `/v3/projects/a9cfb301f6e545c18f5d4f929f66fc11` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:26.422672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48262f89-2e77-405c-a7c8-da26079549b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9cfb301f6e545c18f5d4f929f66fc11)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:26.424628 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48262f89-2e77-405c-a7c8-da26079549b1 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:26.516085 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-48262f89-2e77-405c-a7c8-da26079549b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9cfb301f6e545c18f5d4f929f66fc11', 'request_id': 'req-48262f89-2e77-405c-a7c8-da26079549b1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:26.522317 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-48262f89-2e77-405c-a7c8-da26079549b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9cfb301f6e545c18f5d4f929f66fc11', 'request_id': 'req-48262f89-2e77-405c-a7c8-da26079549b1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:26.528158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-48262f89-2e77-405c-a7c8-da26079549b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9cfb301f6e545c18f5d4f929f66fc11', 'request_id': 'req-48262f89-2e77-405c-a7c8-da26079549b1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:26.617956 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-48262f89-2e77-405c-a7c8-da26079549b1 admin admin] The token cache is being invalidate because project a9cfb301f6e545c18f5d4f929f66fc11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:09:26.618243 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-48262f89-2e77-405c-a7c8-da26079549b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:26.618902 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-48262f89-2e77-405c-a7c8-da26079549b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:26.620416 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1291/2561] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:09:26 2022] DELETE /identity/v3/projects/a9cfb301f6e545c18f5d4f929f66fc11 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:26.624457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d64ce-5ae4-4277-a6ed-a7a3d00cea4a service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:26.634153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d64ce-5ae4-4277-a6ed-a7a3d00cea4a service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:26.650678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:26.690994 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b1855-046f-4227-bee9-a5b65e869891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:26.691636 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b1855-046f-4227-bee9-a5b65e869891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:26.691918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b1855-046f-4227-bee9-a5b65e869891 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:26.692194 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b1855-046f-4227-bee9-a5b65e869891 admin admin] PATH_INFO: `/v3/users/74175d3e35ec4e47ad02a8b57fad659b` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:26.693349 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b1855-046f-4227-bee9-a5b65e869891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74175d3e35ec4e47ad02a8b57fad659b)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:26.695288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b1855-046f-4227-bee9-a5b65e869891 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:26.854679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-181b1855-046f-4227-bee9-a5b65e869891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74175d3e35ec4e47ad02a8b57fad659b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:26.861539 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-181b1855-046f-4227-bee9-a5b65e869891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74175d3e35ec4e47ad02a8b57fad659b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:26.873156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-181b1855-046f-4227-bee9-a5b65e869891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74175d3e35ec4e47ad02a8b57fad659b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:26.873822 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-181b1855-046f-4227-bee9-a5b65e869891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74175d3e35ec4e47ad02a8b57fad659b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:26.874461 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-181b1855-046f-4227-bee9-a5b65e869891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74175d3e35ec4e47ad02a8b57fad659b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:26.937808 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1271/2562] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:09:26 2022] DELETE /identity/v3/users/74175d3e35ec4e47ad02a8b57fad659b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:27.322307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48262f89-2e77-405c-a7c8-da26079549b1 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:27.323957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-48262f89-2e77-405c-a7c8-da26079549b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:27.337748 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48262f89-2e77-405c-a7c8-da26079549b1 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:27.397424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d662f-8f15-45d4-a0b9-6e2a4ac52097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:27.398065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d662f-8f15-45d4-a0b9-6e2a4ac52097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:27.398348 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d662f-8f15-45d4-a0b9-6e2a4ac52097 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:27.398682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d662f-8f15-45d4-a0b9-6e2a4ac52097 admin admin] PATH_INFO: `/v3/projects/f69e3f00a2404146b782f338c54e41a1` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:27.399822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d662f-8f15-45d4-a0b9-6e2a4ac52097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f69e3f00a2404146b782f338c54e41a1)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:27.401740 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d662f-8f15-45d4-a0b9-6e2a4ac52097 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:27.413359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:27.504330 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-517d662f-8f15-45d4-a0b9-6e2a4ac52097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f69e3f00a2404146b782f338c54e41a1', 'request_id': 'req-517d662f-8f15-45d4-a0b9-6e2a4ac52097'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:27.510602 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-517d662f-8f15-45d4-a0b9-6e2a4ac52097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f69e3f00a2404146b782f338c54e41a1', 'request_id': 'req-517d662f-8f15-45d4-a0b9-6e2a4ac52097'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:27.517411 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-517d662f-8f15-45d4-a0b9-6e2a4ac52097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f69e3f00a2404146b782f338c54e41a1', 'request_id': 'req-517d662f-8f15-45d4-a0b9-6e2a4ac52097'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:27.629981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-517d662f-8f15-45d4-a0b9-6e2a4ac52097 admin admin] The token cache is being invalidate because project f69e3f00a2404146b782f338c54e41a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:09:27.630180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-517d662f-8f15-45d4-a0b9-6e2a4ac52097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:27.630890 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-517d662f-8f15-45d4-a0b9-6e2a4ac52097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:27.632394 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1292/2563] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:09:27 2022] DELETE /identity/v3/projects/f69e3f00a2404146b782f338c54e41a1 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:27.637362 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eb607-eabe-4910-85e0-804e2edbd88e None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:27.637811 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eb607-eabe-4910-85e0-804e2edbd88e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:27.638071 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eb607-eabe-4910-85e0-804e2edbd88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:27.657361 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-f53eb607-eabe-4910-85e0-804e2edbd88e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:27.658581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f53eb607-eabe-4910-85e0-804e2edbd88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:27.718929 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1272/2564] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:27.726679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859917e9-d04b-4ebd-a13b-8c32a6634eb2 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:27.727068 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859917e9-d04b-4ebd-a13b-8c32a6634eb2 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:27.727438 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859917e9-d04b-4ebd-a13b-8c32a6634eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:27.747439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-859917e9-d04b-4ebd-a13b-8c32a6634eb2 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:27.748625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-859917e9-d04b-4ebd-a13b-8c32a6634eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:27.757042 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1293/2565] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:27.761178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eb607-eabe-4910-85e0-804e2edbd88e None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:27.770928 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eb607-eabe-4910-85e0-804e2edbd88e None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:27.775506 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce406c45-5a10-4d03-b673-fabd0ed81af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:27.776112 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce406c45-5a10-4d03-b673-fabd0ed81af6 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:27.776399 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce406c45-5a10-4d03-b673-fabd0ed81af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:27.776678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce406c45-5a10-4d03-b673-fabd0ed81af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:27.777374 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce406c45-5a10-4d03-b673-fabd0ed81af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:09:27.777762 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce406c45-5a10-4d03-b673-fabd0ed81af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:27.779416 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce406c45-5a10-4d03-b673-fabd0ed81af6 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:27.790999 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1273/2566] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:09:27.795229 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859917e9-d04b-4ebd-a13b-8c32a6634eb2 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:27.805011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859917e9-d04b-4ebd-a13b-8c32a6634eb2 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:27.809765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c6cc9-2d50-4d8e-894e-54cab9acb9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:27.810401 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c6cc9-2d50-4d8e-894e-54cab9acb9d8 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:27.810702 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c6cc9-2d50-4d8e-894e-54cab9acb9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:27.810982 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c6cc9-2d50-4d8e-894e-54cab9acb9d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:27.811753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c6cc9-2d50-4d8e-894e-54cab9acb9d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:27.814205 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c6cc9-2d50-4d8e-894e-54cab9acb9d8 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:27.934321 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1294/2567] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:09:27 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:09:27.939197 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce406c45-5a10-4d03-b673-fabd0ed81af6 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:27.949300 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce406c45-5a10-4d03-b673-fabd0ed81af6 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:27.973770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:28.005968 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ea538-8f26-4281-8c3c-17ec51f736bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:28.006607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ea538-8f26-4281-8c3c-17ec51f736bb admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:28.006895 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ea538-8f26-4281-8c3c-17ec51f736bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:28.007167 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ea538-8f26-4281-8c3c-17ec51f736bb admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:28.007813 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ea538-8f26-4281-8c3c-17ec51f736bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:28.009753 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ea538-8f26-4281-8c3c-17ec51f736bb admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:28.098343 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1274/2568] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:09:27 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:09:28.102554 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c6cc9-2d50-4d8e-894e-54cab9acb9d8 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:28.113597 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c6cc9-2d50-4d8e-894e-54cab9acb9d8 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:28.118479 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54cfc1-6909-4b32-8feb-434f6c5e6088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:28.119094 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54cfc1-6909-4b32-8feb-434f6c5e6088 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:28.119381 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54cfc1-6909-4b32-8feb-434f6c5e6088 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:28.119677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54cfc1-6909-4b32-8feb-434f6c5e6088 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:28.120354 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54cfc1-6909-4b32-8feb-434f6c5e6088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:28.121957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54cfc1-6909-4b32-8feb-434f6c5e6088 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:28.132704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1295/2569] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:09:28.136733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ea538-8f26-4281-8c3c-17ec51f736bb admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:28.147121 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ea538-8f26-4281-8c3c-17ec51f736bb admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:28.151915 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac0e74-c818-4df9-9761-a83d83ae585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:28.152620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac0e74-c818-4df9-9761-a83d83ae585a admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:28.152896 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac0e74-c818-4df9-9761-a83d83ae585a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:28.153180 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac0e74-c818-4df9-9761-a83d83ae585a admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:28.153989 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac0e74-c818-4df9-9761-a83d83ae585a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:28.155719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac0e74-c818-4df9-9761-a83d83ae585a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:28.166827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1275/2570] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:09:28.170973 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54cfc1-6909-4b32-8feb-434f6c5e6088 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:28.182311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54cfc1-6909-4b32-8feb-434f6c5e6088 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:28.187059 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b4227-fa0a-468e-8435-969085b8060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:28.187675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b4227-fa0a-468e-8435-969085b8060a admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:28.187964 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b4227-fa0a-468e-8435-969085b8060a admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:28.188247 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b4227-fa0a-468e-8435-969085b8060a admin admin] PATH_INFO: `/v3/projects/125faae0ebb7462b845e833e1c295bb9/users/83763931145f4fdbbfeb773bd1fb264b/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:28.202806 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b4227-fa0a-468e-8435-969085b8060a admin admin] RBAC: Authorizing `identity:create_grant(project_id=125faae0ebb7462b845e833e1c295bb9, user_id=83763931145f4fdbbfeb773bd1fb264b, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:28.205545 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b4227-fa0a-468e-8435-969085b8060a admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:28.280573 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1296/2571] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:09:28 2022] PUT /identity/v3/projects/125faae0ebb7462b845e833e1c295bb9/users/83763931145f4fdbbfeb773bd1fb264b/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:28.292644 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcedf36-a0b3-4c7b-96b4-0af822a1f33c None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:28.292938 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcedf36-a0b3-4c7b-96b4-0af822a1f33c None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:28.293222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcedf36-a0b3-4c7b-96b4-0af822a1f33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:28.320855 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-7dcedf36-a0b3-4c7b-96b4-0af822a1f33c None None] MFA Rules not processed for user `83763931145f4fdbbfeb773bd1fb264b`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:28.322087 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-7dcedf36-a0b3-4c7b-96b4-0af822a1f33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:28.384683 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1276/2572] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:28.396197 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b4227-fa0a-468e-8435-969085b8060a admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:28.397890 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-cd9b4227-fa0a-468e-8435-969085b8060a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:28.453688 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b4227-fa0a-468e-8435-969085b8060a admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:28.457247 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135156f3-3faa-4e88-9779-9cc6e045a8e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:28.457856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135156f3-3faa-4e88-9779-9cc6e045a8e8 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:28.458140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135156f3-3faa-4e88-9779-9cc6e045a8e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:28.458442 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135156f3-3faa-4e88-9779-9cc6e045a8e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:28.466546 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135156f3-3faa-4e88-9779-9cc6e045a8e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:28.467980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135156f3-3faa-4e88-9779-9cc6e045a8e8 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:28.477093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1297/2573] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:28.495459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcedf36-a0b3-4c7b-96b4-0af822a1f33c None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:28.576233 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcedf36-a0b3-4c7b-96b4-0af822a1f33c None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:28.581528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ed89e-76de-4340-b47c-cb2ffc913b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:28.582204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ed89e-76de-4340-b47c-cb2ffc913b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:28.582513 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ed89e-76de-4340-b47c-cb2ffc913b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:28.582788 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ed89e-76de-4340-b47c-cb2ffc913b84 admin admin] PATH_INFO: `/v3/users/83763931145f4fdbbfeb773bd1fb264b` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:28.583955 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ed89e-76de-4340-b47c-cb2ffc913b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83763931145f4fdbbfeb773bd1fb264b)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:28.585852 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ed89e-76de-4340-b47c-cb2ffc913b84 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:28.767085 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:28.775365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-197ed89e-76de-4340-b47c-cb2ffc913b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83763931145f4fdbbfeb773bd1fb264b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:28.782479 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-197ed89e-76de-4340-b47c-cb2ffc913b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83763931145f4fdbbfeb773bd1fb264b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:28.794117 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-197ed89e-76de-4340-b47c-cb2ffc913b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83763931145f4fdbbfeb773bd1fb264b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:28.794869 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-197ed89e-76de-4340-b47c-cb2ffc913b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83763931145f4fdbbfeb773bd1fb264b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:28.795505 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-197ed89e-76de-4340-b47c-cb2ffc913b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83763931145f4fdbbfeb773bd1fb264b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:28.869394 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1277/2574] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:09:28 2022] DELETE /identity/v3/users/83763931145f4fdbbfeb773bd1fb264b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:09:28.873930 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc8e0b-1834-4a45-8861-cd451fdb4a78 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:28.874223 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc8e0b-1834-4a45-8861-cd451fdb4a78 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:28.874548 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc8e0b-1834-4a45-8861-cd451fdb4a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:28.894609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-49fc8e0b-1834-4a45-8861-cd451fdb4a78 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:28.895832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-49fc8e0b-1834-4a45-8861-cd451fdb4a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:28.931121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:28.958829 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1298/2575] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:28.968691 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ed89e-76de-4340-b47c-cb2ffc913b84 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:28.970134 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-197ed89e-76de-4340-b47c-cb2ffc913b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:29.028113 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ed89e-76de-4340-b47c-cb2ffc913b84 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:29.031627 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2af2b-c2ff-4f97-abcc-767840ce5a83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:29.032234 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2af2b-c2ff-4f97-abcc-767840ce5a83 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:29.032515 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2af2b-c2ff-4f97-abcc-767840ce5a83 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:29.032787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2af2b-c2ff-4f97-abcc-767840ce5a83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:29.042279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2af2b-c2ff-4f97-abcc-767840ce5a83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:29.043844 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2af2b-c2ff-4f97-abcc-767840ce5a83 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:29.055544 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1278/2576] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:29.489249 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc8e0b-1834-4a45-8861-cd451fdb4a78 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:29.490748 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-49fc8e0b-1834-4a45-8861-cd451fdb4a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:29.506074 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc8e0b-1834-4a45-8861-cd451fdb4a78 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:29.511505 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607a85c-4cea-4c95-abe3-18eb011af5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:29.512159 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a85c-4cea-4c95-abe3-18eb011af5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:29.512546 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a85c-4cea-4c95-abe3-18eb011af5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:29.512693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a85c-4cea-4c95-abe3-18eb011af5ed admin admin] PATH_INFO: `/v3/projects/125faae0ebb7462b845e833e1c295bb9` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:29.513896 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607a85c-4cea-4c95-abe3-18eb011af5ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=125faae0ebb7462b845e833e1c295bb9)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:29.515859 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607a85c-4cea-4c95-abe3-18eb011af5ed admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:29.842761 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9607a85c-4cea-4c95-abe3-18eb011af5ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '125faae0ebb7462b845e833e1c295bb9', 'request_id': 'req-9607a85c-4cea-4c95-abe3-18eb011af5ed'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:29.849518 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9607a85c-4cea-4c95-abe3-18eb011af5ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '125faae0ebb7462b845e833e1c295bb9', 'request_id': 'req-9607a85c-4cea-4c95-abe3-18eb011af5ed'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:29.855145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9607a85c-4cea-4c95-abe3-18eb011af5ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '125faae0ebb7462b845e833e1c295bb9', 'request_id': 'req-9607a85c-4cea-4c95-abe3-18eb011af5ed'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:29.977670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9607a85c-4cea-4c95-abe3-18eb011af5ed admin admin] The token cache is being invalidate because project 125faae0ebb7462b845e833e1c295bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:09:29.977902 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9607a85c-4cea-4c95-abe3-18eb011af5ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:29.978570 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9607a85c-4cea-4c95-abe3-18eb011af5ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:29.980108 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1299/2577] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:09:29 2022] DELETE /identity/v3/projects/125faae0ebb7462b845e833e1c295bb9 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:29.984960 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d61e6-8356-4a9d-9824-4f3d39cbe54d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:29.985446 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d61e6-8356-4a9d-9824-4f3d39cbe54d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:29.985551 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d61e6-8356-4a9d-9824-4f3d39cbe54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:30.004852 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-ea2d61e6-8356-4a9d-9824-4f3d39cbe54d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:30.007033 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ea2d61e6-8356-4a9d-9824-4f3d39cbe54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:30.066537 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1279/2578] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:30.074367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed7401-ac1c-4cde-9d96-d7842fa1928d None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:30.074685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed7401-ac1c-4cde-9d96-d7842fa1928d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:30.075141 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed7401-ac1c-4cde-9d96-d7842fa1928d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:30.096250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-a9ed7401-ac1c-4cde-9d96-d7842fa1928d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:30.097439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a9ed7401-ac1c-4cde-9d96-d7842fa1928d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:30.105226 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1300/2579] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:30.109493 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d61e6-8356-4a9d-9824-4f3d39cbe54d None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:30.119479 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d61e6-8356-4a9d-9824-4f3d39cbe54d None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:30.124142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226ea23-b07a-4607-8700-89615dce3629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:30.124753 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226ea23-b07a-4607-8700-89615dce3629 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:30.125039 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226ea23-b07a-4607-8700-89615dce3629 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:30.125318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226ea23-b07a-4607-8700-89615dce3629 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:30.126072 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226ea23-b07a-4607-8700-89615dce3629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:09:30.126381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226ea23-b07a-4607-8700-89615dce3629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:30.127988 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226ea23-b07a-4607-8700-89615dce3629 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:30.139816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1280/2580] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:09:30.144652 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed7401-ac1c-4cde-9d96-d7842fa1928d None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:30.154180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed7401-ac1c-4cde-9d96-d7842fa1928d None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:30.159681 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f18c9-46b0-4778-bae3-ead3cd23301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:30.160287 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f18c9-46b0-4778-bae3-ead3cd23301e admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:30.160567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f18c9-46b0-4778-bae3-ead3cd23301e admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:30.160843 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f18c9-46b0-4778-bae3-ead3cd23301e admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:30.161760 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f18c9-46b0-4778-bae3-ead3cd23301e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:30.163702 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f18c9-46b0-4778-bae3-ead3cd23301e admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:30.253917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1301/2581] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:09:30 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:09:30.258343 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226ea23-b07a-4607-8700-89615dce3629 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:30.269344 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226ea23-b07a-4607-8700-89615dce3629 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:30.309503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:30.324776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71547f97-bbb4-4354-904c-c0cd9358667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:30.325510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71547f97-bbb4-4354-904c-c0cd9358667d admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:30.325798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71547f97-bbb4-4354-904c-c0cd9358667d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:30.326078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71547f97-bbb4-4354-904c-c0cd9358667d admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:30.326790 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71547f97-bbb4-4354-904c-c0cd9358667d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:30.329368 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71547f97-bbb4-4354-904c-c0cd9358667d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:30.401151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1281/2582] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:09:30 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:09:30.405246 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f18c9-46b0-4778-bae3-ead3cd23301e admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:30.416338 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f18c9-46b0-4778-bae3-ead3cd23301e admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:30.420930 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b180c7-4fd1-464c-b134-1510a2755b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:30.421531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b180c7-4fd1-464c-b134-1510a2755b69 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:30.421862 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b180c7-4fd1-464c-b134-1510a2755b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:30.422140 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b180c7-4fd1-464c-b134-1510a2755b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:30.422865 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b180c7-4fd1-464c-b134-1510a2755b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:30.424455 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b180c7-4fd1-464c-b134-1510a2755b69 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:30.434308 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1302/2583] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:09:30.438813 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71547f97-bbb4-4354-904c-c0cd9358667d admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:30.448758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71547f97-bbb4-4354-904c-c0cd9358667d admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:30.454514 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37d5ef-c444-4285-93b5-92349658716b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:30.455156 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37d5ef-c444-4285-93b5-92349658716b admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:30.455440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37d5ef-c444-4285-93b5-92349658716b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:30.455717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37d5ef-c444-4285-93b5-92349658716b admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:30.456463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37d5ef-c444-4285-93b5-92349658716b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:30.458040 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37d5ef-c444-4285-93b5-92349658716b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:30.468617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1282/2584] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:09:30.472653 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b180c7-4fd1-464c-b134-1510a2755b69 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:30.482690 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b180c7-4fd1-464c-b134-1510a2755b69 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:30.487335 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc563f-545f-46fe-a11e-20c58e8120c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:30.488000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc563f-545f-46fe-a11e-20c58e8120c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:30.488288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc563f-545f-46fe-a11e-20c58e8120c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:30.488572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc563f-545f-46fe-a11e-20c58e8120c2 admin admin] PATH_INFO: `/v3/projects/aa25d9516b7c49429db41d4191335c5d/users/185708ecc98c433fb6f6b4dd83a822a8/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:30.503746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc563f-545f-46fe-a11e-20c58e8120c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa25d9516b7c49429db41d4191335c5d, user_id=185708ecc98c433fb6f6b4dd83a822a8, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:30.506515 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc563f-545f-46fe-a11e-20c58e8120c2 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:30.577884 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1303/2585] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:09:30 2022] PUT /identity/v3/projects/aa25d9516b7c49429db41d4191335c5d/users/185708ecc98c433fb6f6b4dd83a822a8/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:30.588239 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59ebf9-3674-4618-b1df-c0f1c4fd5ca0 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:30.588532 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59ebf9-3674-4618-b1df-c0f1c4fd5ca0 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:30.588814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59ebf9-3674-4618-b1df-c0f1c4fd5ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:30.616181 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-2b59ebf9-3674-4618-b1df-c0f1c4fd5ca0 None None] MFA Rules not processed for user `185708ecc98c433fb6f6b4dd83a822a8`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:30.617385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2b59ebf9-3674-4618-b1df-c0f1c4fd5ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:30.681466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1283/2586] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:30.693552 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc563f-545f-46fe-a11e-20c58e8120c2 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:30.695445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c9dc563f-545f-46fe-a11e-20c58e8120c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:30.747935 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:30.752039 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc563f-545f-46fe-a11e-20c58e8120c2 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:30.755711 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a2038-ccc0-4624-bdfa-da0d3955ee45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:30.758466 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a2038-ccc0-4624-bdfa-da0d3955ee45 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:30.758466 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a2038-ccc0-4624-bdfa-da0d3955ee45 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:30.758466 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a2038-ccc0-4624-bdfa-da0d3955ee45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:30.765801 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a2038-ccc0-4624-bdfa-da0d3955ee45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:30.767320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a2038-ccc0-4624-bdfa-da0d3955ee45 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:30.776444 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1304/2587] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:30.798231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59ebf9-3674-4618-b1df-c0f1c4fd5ca0 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:30.867062 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59ebf9-3674-4618-b1df-c0f1c4fd5ca0 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:30.874454 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531cb7c-2863-4aee-9f2c-f0833bb2d56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:30.876210 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531cb7c-2863-4aee-9f2c-f0833bb2d56c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:30.876703 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531cb7c-2863-4aee-9f2c-f0833bb2d56c admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:30.877198 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531cb7c-2863-4aee-9f2c-f0833bb2d56c admin admin] PATH_INFO: `/v3/users/185708ecc98c433fb6f6b4dd83a822a8` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:30.879267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531cb7c-2863-4aee-9f2c-f0833bb2d56c admin admin] RBAC: Authorizing `identity:delete_user(user_id=185708ecc98c433fb6f6b4dd83a822a8)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:30.883010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531cb7c-2863-4aee-9f2c-f0833bb2d56c admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:31.049434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-1531cb7c-2863-4aee-9f2c-f0833bb2d56c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '185708ecc98c433fb6f6b4dd83a822a8'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:31.054514 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:31.057009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-1531cb7c-2863-4aee-9f2c-f0833bb2d56c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '185708ecc98c433fb6f6b4dd83a822a8'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:31.068906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-1531cb7c-2863-4aee-9f2c-f0833bb2d56c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '185708ecc98c433fb6f6b4dd83a822a8'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:31.070085 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-1531cb7c-2863-4aee-9f2c-f0833bb2d56c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '185708ecc98c433fb6f6b4dd83a822a8'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:31.070209 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-1531cb7c-2863-4aee-9f2c-f0833bb2d56c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '185708ecc98c433fb6f6b4dd83a822a8'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:31.154766 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1284/2588] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:09:30 2022] DELETE /identity/v3/users/185708ecc98c433fb6f6b4dd83a822a8 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:31.159864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a2428-1a8d-4726-a6d4-06a6a59aca49 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:31.160155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a2428-1a8d-4726-a6d4-06a6a59aca49 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:31.160432 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a2428-1a8d-4726-a6d4-06a6a59aca49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:31.180002 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-178a2428-1a8d-4726-a6d4-06a6a59aca49 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:31.181199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-178a2428-1a8d-4726-a6d4-06a6a59aca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:31.246280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1305/2589] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:31.255953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531cb7c-2863-4aee-9f2c-f0833bb2d56c admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:31.257435 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-1531cb7c-2863-4aee-9f2c-f0833bb2d56c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:31.319779 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531cb7c-2863-4aee-9f2c-f0833bb2d56c admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:31.323294 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a1a89-a37a-43c8-b446-85670aeb2820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:31.323913 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a1a89-a37a-43c8-b446-85670aeb2820 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:31.324196 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a1a89-a37a-43c8-b446-85670aeb2820 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:31.324471 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a1a89-a37a-43c8-b446-85670aeb2820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:31.333856 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a1a89-a37a-43c8-b446-85670aeb2820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:31.335304 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a1a89-a37a-43c8-b446-85670aeb2820 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:31.345268 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1285/2590] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:31.779225 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a2428-1a8d-4726-a6d4-06a6a59aca49 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:31.780708 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-178a2428-1a8d-4726-a6d4-06a6a59aca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:31.794270 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a2428-1a8d-4726-a6d4-06a6a59aca49 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:31.799076 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c1445-c5da-4d8f-a811-dba0f6616712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:31.801465 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c1445-c5da-4d8f-a811-dba0f6616712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:31.801465 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c1445-c5da-4d8f-a811-dba0f6616712 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:31.801465 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c1445-c5da-4d8f-a811-dba0f6616712 admin admin] PATH_INFO: `/v3/projects/aa25d9516b7c49429db41d4191335c5d` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:31.801465 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c1445-c5da-4d8f-a811-dba0f6616712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa25d9516b7c49429db41d4191335c5d)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:31.803498 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c1445-c5da-4d8f-a811-dba0f6616712 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:31.922773 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-6c4c1445-c5da-4d8f-a811-dba0f6616712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa25d9516b7c49429db41d4191335c5d', 'request_id': 'req-6c4c1445-c5da-4d8f-a811-dba0f6616712'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:31.928908 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-6c4c1445-c5da-4d8f-a811-dba0f6616712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa25d9516b7c49429db41d4191335c5d', 'request_id': 'req-6c4c1445-c5da-4d8f-a811-dba0f6616712'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:31.934663 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-6c4c1445-c5da-4d8f-a811-dba0f6616712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa25d9516b7c49429db41d4191335c5d', 'request_id': 'req-6c4c1445-c5da-4d8f-a811-dba0f6616712'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:32.028761 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-6c4c1445-c5da-4d8f-a811-dba0f6616712 admin admin] The token cache is being invalidate because project aa25d9516b7c49429db41d4191335c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:09:32.029077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-6c4c1445-c5da-4d8f-a811-dba0f6616712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:32.029689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-6c4c1445-c5da-4d8f-a811-dba0f6616712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:32.031355 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1306/2591] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:09:31 2022] DELETE /identity/v3/projects/aa25d9516b7c49429db41d4191335c5d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:32.038105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc1fa1-a5a1-4ad2-8eb8-c94f24c7c266 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:32.041527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc1fa1-a5a1-4ad2-8eb8-c94f24c7c266 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:32.041527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc1fa1-a5a1-4ad2-8eb8-c94f24c7c266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:32.060927 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-36fc1fa1-a5a1-4ad2-8eb8-c94f24c7c266 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:32.064582 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-36fc1fa1-a5a1-4ad2-8eb8-c94f24c7c266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:32.122785 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1286/2592] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:32.130922 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2dc4c1-28e6-4830-9750-ec219f66615a None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:32.131215 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2dc4c1-28e6-4830-9750-ec219f66615a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:32.131494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2dc4c1-28e6-4830-9750-ec219f66615a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:32.151855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-ea2dc4c1-28e6-4830-9750-ec219f66615a None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:32.153101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ea2dc4c1-28e6-4830-9750-ec219f66615a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:32.161501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1307/2593] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:32.165698 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc1fa1-a5a1-4ad2-8eb8-c94f24c7c266 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:32.176014 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc1fa1-a5a1-4ad2-8eb8-c94f24c7c266 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:32.180612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5f71f-2c23-481c-af33-24a84545d853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:32.182239 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5f71f-2c23-481c-af33-24a84545d853 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:32.182239 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5f71f-2c23-481c-af33-24a84545d853 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:32.182239 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5f71f-2c23-481c-af33-24a84545d853 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:32.182740 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5f71f-2c23-481c-af33-24a84545d853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:09:32.183052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5f71f-2c23-481c-af33-24a84545d853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:32.184672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5f71f-2c23-481c-af33-24a84545d853 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:32.198690 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1287/2594] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:09:32.202990 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2dc4c1-28e6-4830-9750-ec219f66615a None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:32.212180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2dc4c1-28e6-4830-9750-ec219f66615a None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:32.216962 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4419b-99e9-42ab-89c9-a482804131b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:32.217584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4419b-99e9-42ab-89c9-a482804131b9 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:32.217864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4419b-99e9-42ab-89c9-a482804131b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:32.218507 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4419b-99e9-42ab-89c9-a482804131b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:32.218858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4419b-99e9-42ab-89c9-a482804131b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:32.220870 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4419b-99e9-42ab-89c9-a482804131b9 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:32.322623 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1308/2595] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:09:32 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:09:32.327204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5f71f-2c23-481c-af33-24a84545d853 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:32.337450 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5f71f-2c23-481c-af33-24a84545d853 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:32.395317 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62847bf1-a0e7-4c74-92b1-2ed655dae611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:32.395946 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62847bf1-a0e7-4c74-92b1-2ed655dae611 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:32.396231 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62847bf1-a0e7-4c74-92b1-2ed655dae611 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:32.396509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62847bf1-a0e7-4c74-92b1-2ed655dae611 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:32.397179 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62847bf1-a0e7-4c74-92b1-2ed655dae611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:32.399117 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62847bf1-a0e7-4c74-92b1-2ed655dae611 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:32.408565 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:32.496478 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1288/2596] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:09:32 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:09:32.497798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4419b-99e9-42ab-89c9-a482804131b9 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:32.508726 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4419b-99e9-42ab-89c9-a482804131b9 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:32.513512 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30037345-6dce-48da-a73b-2a241f4e14ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:32.514201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30037345-6dce-48da-a73b-2a241f4e14ee admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:32.514627 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30037345-6dce-48da-a73b-2a241f4e14ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:32.514997 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30037345-6dce-48da-a73b-2a241f4e14ee admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:32.515795 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30037345-6dce-48da-a73b-2a241f4e14ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:32.517696 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30037345-6dce-48da-a73b-2a241f4e14ee admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:32.528448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1309/2597] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:09:32.533275 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62847bf1-a0e7-4c74-92b1-2ed655dae611 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:32.543617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62847bf1-a0e7-4c74-92b1-2ed655dae611 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:32.548900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56579cf-1cac-45b0-987d-19be7ca5e96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:32.549509 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56579cf-1cac-45b0-987d-19be7ca5e96a admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:32.549791 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56579cf-1cac-45b0-987d-19be7ca5e96a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:32.550069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56579cf-1cac-45b0-987d-19be7ca5e96a admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:32.550794 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56579cf-1cac-45b0-987d-19be7ca5e96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:32.552380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56579cf-1cac-45b0-987d-19be7ca5e96a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:32.563789 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1289/2598] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:09:32.567519 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30037345-6dce-48da-a73b-2a241f4e14ee admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:32.577532 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30037345-6dce-48da-a73b-2a241f4e14ee admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:32.582219 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9751aa-6a3d-40ec-9cad-10e41a64cb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:32.582918 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9751aa-6a3d-40ec-9cad-10e41a64cb39 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:32.583197 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9751aa-6a3d-40ec-9cad-10e41a64cb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:32.583473 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9751aa-6a3d-40ec-9cad-10e41a64cb39 admin admin] PATH_INFO: `/v3/projects/3eff7c9ff331468988b2eb7a930c97c7/users/fc73ff29f2a945188b2ad92f571c9d2b/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:32.599155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9751aa-6a3d-40ec-9cad-10e41a64cb39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eff7c9ff331468988b2eb7a930c97c7, user_id=fc73ff29f2a945188b2ad92f571c9d2b, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:32.601874 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9751aa-6a3d-40ec-9cad-10e41a64cb39 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:32.670481 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1310/2599] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:09:32 2022] PUT /identity/v3/projects/3eff7c9ff331468988b2eb7a930c97c7/users/fc73ff29f2a945188b2ad92f571c9d2b/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:32.683054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1f9ae-6745-46a8-8692-2a5d228d05d3 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:32.683256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1f9ae-6745-46a8-8692-2a5d228d05d3 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:32.683505 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1f9ae-6745-46a8-8692-2a5d228d05d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:32.710434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-8ee1f9ae-6745-46a8-8692-2a5d228d05d3 None None] MFA Rules not processed for user `fc73ff29f2a945188b2ad92f571c9d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:32.711629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8ee1f9ae-6745-46a8-8692-2a5d228d05d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:32.775928 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1290/2600] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:32.787712 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9751aa-6a3d-40ec-9cad-10e41a64cb39 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:32.789504 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ad9751aa-6a3d-40ec-9cad-10e41a64cb39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:32.804105 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:32.851889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9751aa-6a3d-40ec-9cad-10e41a64cb39 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:32.855553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988ff30-c0f7-443d-aead-bd141d1d3800 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:32.856219 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988ff30-c0f7-443d-aead-bd141d1d3800 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:32.856662 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988ff30-c0f7-443d-aead-bd141d1d3800 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:32.856938 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988ff30-c0f7-443d-aead-bd141d1d3800 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:32.865329 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988ff30-c0f7-443d-aead-bd141d1d3800 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:32.866803 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988ff30-c0f7-443d-aead-bd141d1d3800 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:32.876357 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1311/2601] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:39.340761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1f9ae-6745-46a8-8692-2a5d228d05d3 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:39.405233 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1f9ae-6745-46a8-8692-2a5d228d05d3 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:39.412969 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8becdcb-b161-4eff-b1d4-97c55ff0e964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:39.413615 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8becdcb-b161-4eff-b1d4-97c55ff0e964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:39.413898 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8becdcb-b161-4eff-b1d4-97c55ff0e964 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:39.414174 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8becdcb-b161-4eff-b1d4-97c55ff0e964 admin admin] PATH_INFO: `/v3/users/fc73ff29f2a945188b2ad92f571c9d2b` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:39.415378 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8becdcb-b161-4eff-b1d4-97c55ff0e964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc73ff29f2a945188b2ad92f571c9d2b)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:39.417287 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8becdcb-b161-4eff-b1d4-97c55ff0e964 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:39.581408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-d8becdcb-b161-4eff-b1d4-97c55ff0e964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc73ff29f2a945188b2ad92f571c9d2b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:39.588324 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-d8becdcb-b161-4eff-b1d4-97c55ff0e964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc73ff29f2a945188b2ad92f571c9d2b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:39.599760 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:39.600997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-d8becdcb-b161-4eff-b1d4-97c55ff0e964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc73ff29f2a945188b2ad92f571c9d2b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:39.601660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-d8becdcb-b161-4eff-b1d4-97c55ff0e964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc73ff29f2a945188b2ad92f571c9d2b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:39.602264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-d8becdcb-b161-4eff-b1d4-97c55ff0e964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc73ff29f2a945188b2ad92f571c9d2b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:39.680935 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1291/2602] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:09:39 2022] DELETE /identity/v3/users/fc73ff29f2a945188b2ad92f571c9d2b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:39.685775 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464bb51-e321-49bc-8b65-ddfe2013647e None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:39.686231 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464bb51-e321-49bc-8b65-ddfe2013647e None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:39.686346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464bb51-e321-49bc-8b65-ddfe2013647e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:39.705574 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-4464bb51-e321-49bc-8b65-ddfe2013647e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:39.706804 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4464bb51-e321-49bc-8b65-ddfe2013647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:39.768325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1312/2603] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:39.781343 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8becdcb-b161-4eff-b1d4-97c55ff0e964 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:39.783691 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d8becdcb-b161-4eff-b1d4-97c55ff0e964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:39.848006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8becdcb-b161-4eff-b1d4-97c55ff0e964 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:39.851554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47880fa2-7084-41a3-b4f9-08a88e25cf80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:39.852172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47880fa2-7084-41a3-b4f9-08a88e25cf80 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:39.852459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47880fa2-7084-41a3-b4f9-08a88e25cf80 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:39.852738 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47880fa2-7084-41a3-b4f9-08a88e25cf80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:39.861674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47880fa2-7084-41a3-b4f9-08a88e25cf80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:39.863139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47880fa2-7084-41a3-b4f9-08a88e25cf80 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:39.872746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1292/2604] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:09:40.311155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464bb51-e321-49bc-8b65-ddfe2013647e None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:40.317314 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4464bb51-e321-49bc-8b65-ddfe2013647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:40.325830 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464bb51-e321-49bc-8b65-ddfe2013647e None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:40.330574 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9cdbb-9bf5-4166-a1ba-9641cec95e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:40.331275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9cdbb-9bf5-4166-a1ba-9641cec95e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:40.331613 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9cdbb-9bf5-4166-a1ba-9641cec95e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:40.331899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9cdbb-9bf5-4166-a1ba-9641cec95e6a admin admin] PATH_INFO: `/v3/projects/3eff7c9ff331468988b2eb7a930c97c7` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:40.333066 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9cdbb-9bf5-4166-a1ba-9641cec95e6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eff7c9ff331468988b2eb7a930c97c7)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:40.335071 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9cdbb-9bf5-4166-a1ba-9641cec95e6a admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:40.442131 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-4cc9cdbb-9bf5-4166-a1ba-9641cec95e6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eff7c9ff331468988b2eb7a930c97c7', 'request_id': 'req-4cc9cdbb-9bf5-4166-a1ba-9641cec95e6a'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:40.448670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-4cc9cdbb-9bf5-4166-a1ba-9641cec95e6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eff7c9ff331468988b2eb7a930c97c7', 'request_id': 'req-4cc9cdbb-9bf5-4166-a1ba-9641cec95e6a'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:40.454273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-4cc9cdbb-9bf5-4166-a1ba-9641cec95e6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eff7c9ff331468988b2eb7a930c97c7', 'request_id': 'req-4cc9cdbb-9bf5-4166-a1ba-9641cec95e6a'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:40.549356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-4cc9cdbb-9bf5-4166-a1ba-9641cec95e6a admin admin] The token cache is being invalidate because project 3eff7c9ff331468988b2eb7a930c97c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:09:40.549642 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-4cc9cdbb-9bf5-4166-a1ba-9641cec95e6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:40.550257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-4cc9cdbb-9bf5-4166-a1ba-9641cec95e6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:40.551799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1313/2605] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:09:40 2022] DELETE /identity/v3/projects/3eff7c9ff331468988b2eb7a930c97c7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:40.556621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05468c42-7c59-4a6b-b41b-1ca38c904a0f None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:40.557070 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05468c42-7c59-4a6b-b41b-1ca38c904a0f None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:40.557162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05468c42-7c59-4a6b-b41b-1ca38c904a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:40.577159 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-05468c42-7c59-4a6b-b41b-1ca38c904a0f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:40.578488 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-05468c42-7c59-4a6b-b41b-1ca38c904a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:40.636607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1293/2606] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:40.645368 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c797a1-442a-4deb-890b-a9b02d46d301 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:40.645750 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c797a1-442a-4deb-890b-a9b02d46d301 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:40.646051 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c797a1-442a-4deb-890b-a9b02d46d301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:40.667064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-d8c797a1-442a-4deb-890b-a9b02d46d301 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:40.668272 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d8c797a1-442a-4deb-890b-a9b02d46d301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:40.676855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1314/2607] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:40.681103 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05468c42-7c59-4a6b-b41b-1ca38c904a0f None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:40.691656 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05468c42-7c59-4a6b-b41b-1ca38c904a0f None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:40.696338 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a860303-3de8-4849-a515-271d0ab2ea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:40.696896 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a860303-3de8-4849-a515-271d0ab2ea97 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:40.697181 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a860303-3de8-4849-a515-271d0ab2ea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:40.697457 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a860303-3de8-4849-a515-271d0ab2ea97 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:40.698152 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a860303-3de8-4849-a515-271d0ab2ea97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:09:40.698502 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a860303-3de8-4849-a515-271d0ab2ea97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:40.700129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a860303-3de8-4849-a515-271d0ab2ea97 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:40.712448 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1294/2608] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:09:40.717020 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c797a1-442a-4deb-890b-a9b02d46d301 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:40.726639 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c797a1-442a-4deb-890b-a9b02d46d301 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:40.735803 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb32532-229b-4d4a-9efe-ac3216603e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:40.735803 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb32532-229b-4d4a-9efe-ac3216603e48 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:40.735803 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb32532-229b-4d4a-9efe-ac3216603e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:40.735803 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb32532-229b-4d4a-9efe-ac3216603e48 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:40.736273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb32532-229b-4d4a-9efe-ac3216603e48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:40.736641 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb32532-229b-4d4a-9efe-ac3216603e48 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:40.836981 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1315/2609] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:09:40 2022] POST /identity/v3/projects => generated 361 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:09:40.848546 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a860303-3de8-4849-a515-271d0ab2ea97 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:40.851054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a860303-3de8-4849-a515-271d0ab2ea97 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:40.907267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194137b-40e4-46fd-a947-e9bc064eb933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:40.907884 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194137b-40e4-46fd-a947-e9bc064eb933 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:40.908169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194137b-40e4-46fd-a947-e9bc064eb933 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:40.908449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194137b-40e4-46fd-a947-e9bc064eb933 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:40.909114 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194137b-40e4-46fd-a947-e9bc064eb933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:40.911059 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194137b-40e4-46fd-a947-e9bc064eb933 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:41.042094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1295/2610] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:09:40 2022] POST /identity/v3/users => generated 281 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:09:41.046132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb32532-229b-4d4a-9efe-ac3216603e48 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:41.057051 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb32532-229b-4d4a-9efe-ac3216603e48 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:41.061859 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8f97c-d0bc-4cca-8ff6-9244487faab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:41.062346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8f97c-d0bc-4cca-8ff6-9244487faab8 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:41.062663 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8f97c-d0bc-4cca-8ff6-9244487faab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:41.062935 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8f97c-d0bc-4cca-8ff6-9244487faab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:41.063637 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8f97c-d0bc-4cca-8ff6-9244487faab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:41.065936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8f97c-d0bc-4cca-8ff6-9244487faab8 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:41.068433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:41.077122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1316/2611] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:09:41.083190 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194137b-40e4-46fd-a947-e9bc064eb933 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:41.091485 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194137b-40e4-46fd-a947-e9bc064eb933 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:41.096071 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78188c2d-f6e3-4f42-a61b-a9196e84edd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:41.096792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78188c2d-f6e3-4f42-a61b-a9196e84edd2 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:41.097085 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78188c2d-f6e3-4f42-a61b-a9196e84edd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:41.097365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78188c2d-f6e3-4f42-a61b-a9196e84edd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:41.098085 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78188c2d-f6e3-4f42-a61b-a9196e84edd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:41.099712 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78188c2d-f6e3-4f42-a61b-a9196e84edd2 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:41.101770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:41.112365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1296/2612] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:09:41.120794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8f97c-d0bc-4cca-8ff6-9244487faab8 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:41.132008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8f97c-d0bc-4cca-8ff6-9244487faab8 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:41.136568 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b3dd4-59cf-4576-95b4-fc8b1fed3247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:41.137326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b3dd4-59cf-4576-95b4-fc8b1fed3247 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:41.137610 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b3dd4-59cf-4576-95b4-fc8b1fed3247 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:41.137891 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b3dd4-59cf-4576-95b4-fc8b1fed3247 admin admin] PATH_INFO: `/v3/projects/d4d05939c2dd49979f135e0517444723/users/ecbca158c5af401b8fdbfc91d8c4beaf/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:41.153163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b3dd4-59cf-4576-95b4-fc8b1fed3247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d05939c2dd49979f135e0517444723, user_id=ecbca158c5af401b8fdbfc91d8c4beaf, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:41.155902 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b3dd4-59cf-4576-95b4-fc8b1fed3247 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:41.218433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1317/2613] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:09:41 2022] PUT /identity/v3/projects/d4d05939c2dd49979f135e0517444723/users/ecbca158c5af401b8fdbfc91d8c4beaf/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:41.288418 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742ed19-2f37-45cd-b614-7231e2482db6 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:41.288703 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742ed19-2f37-45cd-b614-7231e2482db6 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:41.288976 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742ed19-2f37-45cd-b614-7231e2482db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:41.316700 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-2742ed19-2f37-45cd-b614-7231e2482db6 None None] MFA Rules not processed for user `ecbca158c5af401b8fdbfc91d8c4beaf`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:41.317823 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2742ed19-2f37-45cd-b614-7231e2482db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:41.379672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1297/2614] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:41.412975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b3dd4-59cf-4576-95b4-fc8b1fed3247 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:41.414713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-566b3dd4-59cf-4576-95b4-fc8b1fed3247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:41.473722 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b3dd4-59cf-4576-95b4-fc8b1fed3247 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:41.477448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d3cd4-5428-47d1-bacc-e50d5a1c335a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:41.478054 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d3cd4-5428-47d1-bacc-e50d5a1c335a service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:41.478337 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d3cd4-5428-47d1-bacc-e50d5a1c335a service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:41.478643 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d3cd4-5428-47d1-bacc-e50d5a1c335a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:41.487543 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d3cd4-5428-47d1-bacc-e50d5a1c335a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:41.488969 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d3cd4-5428-47d1-bacc-e50d5a1c335a service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:41.497664 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1318/2615] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:41.513617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742ed19-2f37-45cd-b614-7231e2482db6 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:41.575777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742ed19-2f37-45cd-b614-7231e2482db6 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:41.580346 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd33e2-6b42-4ad7-b433-1b565b162738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:41.580979 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd33e2-6b42-4ad7-b433-1b565b162738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:41.581259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd33e2-6b42-4ad7-b433-1b565b162738 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:41.581530 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd33e2-6b42-4ad7-b433-1b565b162738 admin admin] PATH_INFO: `/v3/users/ecbca158c5af401b8fdbfc91d8c4beaf` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:41.582731 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd33e2-6b42-4ad7-b433-1b565b162738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecbca158c5af401b8fdbfc91d8c4beaf)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:41.584620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd33e2-6b42-4ad7-b433-1b565b162738 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:41.762163 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-71dd33e2-6b42-4ad7-b433-1b565b162738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecbca158c5af401b8fdbfc91d8c4beaf'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:41.769679 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-71dd33e2-6b42-4ad7-b433-1b565b162738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecbca158c5af401b8fdbfc91d8c4beaf'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:41.781170 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-71dd33e2-6b42-4ad7-b433-1b565b162738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecbca158c5af401b8fdbfc91d8c4beaf'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:41.781834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-71dd33e2-6b42-4ad7-b433-1b565b162738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecbca158c5af401b8fdbfc91d8c4beaf'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:41.782460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-71dd33e2-6b42-4ad7-b433-1b565b162738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecbca158c5af401b8fdbfc91d8c4beaf'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:41.846602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1298/2616] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:09:41 2022] DELETE /identity/v3/users/ecbca158c5af401b8fdbfc91d8c4beaf => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:41.851047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12646543-c813-4344-bbed-093238410f11 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:41.851525 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12646543-c813-4344-bbed-093238410f11 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:41.851626 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12646543-c813-4344-bbed-093238410f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:41.870267 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-12646543-c813-4344-bbed-093238410f11 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:41.871498 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-12646543-c813-4344-bbed-093238410f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:41.928930 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1319/2617] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:41.938609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd33e2-6b42-4ad7-b433-1b565b162738 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:41.940007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-71dd33e2-6b42-4ad7-b433-1b565b162738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:41.951380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:41.999271 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd33e2-6b42-4ad7-b433-1b565b162738 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:42.002964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f3c06-fbfc-4c7f-91d3-a48ff586853e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:42.003586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f3c06-fbfc-4c7f-91d3-a48ff586853e service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:42.003870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f3c06-fbfc-4c7f-91d3-a48ff586853e service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:42.004145 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f3c06-fbfc-4c7f-91d3-a48ff586853e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:42.013139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f3c06-fbfc-4c7f-91d3-a48ff586853e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:42.014646 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f3c06-fbfc-4c7f-91d3-a48ff586853e service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:42.025144 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1299/2618] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:42.436460 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12646543-c813-4344-bbed-093238410f11 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:42.437968 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-12646543-c813-4344-bbed-093238410f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:42.450139 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12646543-c813-4344-bbed-093238410f11 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:42.454768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7c34c-4ebf-42f2-9f3b-09476652b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:42.455418 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7c34c-4ebf-42f2-9f3b-09476652b850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:42.455698 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7c34c-4ebf-42f2-9f3b-09476652b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:42.455971 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7c34c-4ebf-42f2-9f3b-09476652b850 admin admin] PATH_INFO: `/v3/projects/d4d05939c2dd49979f135e0517444723` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:42.457153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7c34c-4ebf-42f2-9f3b-09476652b850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4d05939c2dd49979f135e0517444723)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:42.459122 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7c34c-4ebf-42f2-9f3b-09476652b850 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:42.567028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-54f7c34c-4ebf-42f2-9f3b-09476652b850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4d05939c2dd49979f135e0517444723', 'request_id': 'req-54f7c34c-4ebf-42f2-9f3b-09476652b850'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:42.573250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-54f7c34c-4ebf-42f2-9f3b-09476652b850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4d05939c2dd49979f135e0517444723', 'request_id': 'req-54f7c34c-4ebf-42f2-9f3b-09476652b850'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:42.579068 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-54f7c34c-4ebf-42f2-9f3b-09476652b850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4d05939c2dd49979f135e0517444723', 'request_id': 'req-54f7c34c-4ebf-42f2-9f3b-09476652b850'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:42.653771 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:42.657575 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-54f7c34c-4ebf-42f2-9f3b-09476652b850 admin admin] The token cache is being invalidate because project d4d05939c2dd49979f135e0517444723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:09:42.658593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-54f7c34c-4ebf-42f2-9f3b-09476652b850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:42.659222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-54f7c34c-4ebf-42f2-9f3b-09476652b850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:09:42.660767 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1320/2619] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:09:42 2022] DELETE /identity/v3/projects/d4d05939c2dd49979f135e0517444723 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:42.666063 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdd717-7223-47fa-a4cf-a597a061f646 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:42.666580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdd717-7223-47fa-a4cf-a597a061f646 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:42.666688 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdd717-7223-47fa-a4cf-a597a061f646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:42.687086 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-26bdd717-7223-47fa-a4cf-a597a061f646 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:42.688204 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-26bdd717-7223-47fa-a4cf-a597a061f646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:42.747804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1300/2620] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:42.755696 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98893c-60c6-483f-be1a-a2063d965d56 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:42.755991 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98893c-60c6-483f-be1a-a2063d965d56 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:42.756306 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98893c-60c6-483f-be1a-a2063d965d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:42.776596 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-ca98893c-60c6-483f-be1a-a2063d965d56 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:42.777806 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ca98893c-60c6-483f-be1a-a2063d965d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:42.786932 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1321/2621] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:42.791248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdd717-7223-47fa-a4cf-a597a061f646 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:42.803981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdd717-7223-47fa-a4cf-a597a061f646 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:42.806141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babedb7-00a3-48d9-941d-9f064469476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:42.806825 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babedb7-00a3-48d9-941d-9f064469476f admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:42.807111 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babedb7-00a3-48d9-941d-9f064469476f admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:42.807389 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babedb7-00a3-48d9-941d-9f064469476f admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:42.808089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babedb7-00a3-48d9-941d-9f064469476f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:09:42.808398 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babedb7-00a3-48d9-941d-9f064469476f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:42.809997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babedb7-00a3-48d9-941d-9f064469476f admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:42.822249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1301/2622] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:09:42.826651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98893c-60c6-483f-be1a-a2063d965d56 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:42.836641 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98893c-60c6-483f-be1a-a2063d965d56 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:42.841312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d22229-81b7-4756-8549-568b84248626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:42.841919 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d22229-81b7-4756-8549-568b84248626 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:42.842206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d22229-81b7-4756-8549-568b84248626 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:42.842517 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d22229-81b7-4756-8549-568b84248626 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:42.843187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d22229-81b7-4756-8549-568b84248626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:42.845098 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d22229-81b7-4756-8549-568b84248626 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:42.933419 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1322/2623] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:09:42 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:09:42.937517 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babedb7-00a3-48d9-941d-9f064469476f admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:42.948060 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babedb7-00a3-48d9-941d-9f064469476f admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:43.004275 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644a410-b0d3-4f87-9694-a95608bbf09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:43.007380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644a410-b0d3-4f87-9694-a95608bbf09f admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:43.007674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644a410-b0d3-4f87-9694-a95608bbf09f admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:43.007959 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644a410-b0d3-4f87-9694-a95608bbf09f admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:43.009747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644a410-b0d3-4f87-9694-a95608bbf09f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:43.011795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644a410-b0d3-4f87-9694-a95608bbf09f admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:43.109611 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1302/2624] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:09:42 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:09:43.114008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d22229-81b7-4756-8549-568b84248626 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:43.124291 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d22229-81b7-4756-8549-568b84248626 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:43.129501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45773498-4567-483a-92b5-df7d64bf1761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:43.130290 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45773498-4567-483a-92b5-df7d64bf1761 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:43.130624 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45773498-4567-483a-92b5-df7d64bf1761 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:43.130902 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45773498-4567-483a-92b5-df7d64bf1761 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:43.131641 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45773498-4567-483a-92b5-df7d64bf1761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:43.133205 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45773498-4567-483a-92b5-df7d64bf1761 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:43.143827 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1323/2625] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:09:43.147980 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644a410-b0d3-4f87-9694-a95608bbf09f admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:43.158722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644a410-b0d3-4f87-9694-a95608bbf09f admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:43.163540 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbff2d-9d2c-4d73-9e64-c16876c3fdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:43.164152 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbff2d-9d2c-4d73-9e64-c16876c3fdab admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:43.164429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbff2d-9d2c-4d73-9e64-c16876c3fdab admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:43.164703 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbff2d-9d2c-4d73-9e64-c16876c3fdab admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:43.165731 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbff2d-9d2c-4d73-9e64-c16876c3fdab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:43.168695 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbff2d-9d2c-4d73-9e64-c16876c3fdab admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:43.182919 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1303/2626] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:09:43.187050 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45773498-4567-483a-92b5-df7d64bf1761 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:43.196939 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45773498-4567-483a-92b5-df7d64bf1761 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:43.201592 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402ef18-7f3d-43ee-9c5b-68c7ece04df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:43.208130 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402ef18-7f3d-43ee-9c5b-68c7ece04df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:43.208130 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402ef18-7f3d-43ee-9c5b-68c7ece04df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:43.208130 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402ef18-7f3d-43ee-9c5b-68c7ece04df3 admin admin] PATH_INFO: `/v3/projects/afc6c6d2070a4e39ac4579ac7b2382d4/users/b769a01bcf7e4f47bc978aeb04c45a32/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:43.217412 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402ef18-7f3d-43ee-9c5b-68c7ece04df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afc6c6d2070a4e39ac4579ac7b2382d4, user_id=b769a01bcf7e4f47bc978aeb04c45a32, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:43.220129 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402ef18-7f3d-43ee-9c5b-68c7ece04df3 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:43.343744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1324/2627] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:09:43 2022] PUT /identity/v3/projects/afc6c6d2070a4e39ac4579ac7b2382d4/users/b769a01bcf7e4f47bc978aeb04c45a32/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:09:43.349429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8bad7-2451-4b5a-bca8-e67ac3c489a8 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:43.349765 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8bad7-2451-4b5a-bca8-e67ac3c489a8 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:43.350047 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8bad7-2451-4b5a-bca8-e67ac3c489a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:43.368569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-f8a8bad7-2451-4b5a-bca8-e67ac3c489a8 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:43.369758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f8a8bad7-2451-4b5a-bca8-e67ac3c489a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:43.378860 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:43.431248 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1304/2628] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:43.440866 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402ef18-7f3d-43ee-9c5b-68c7ece04df3 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:43.442615 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-1402ef18-7f3d-43ee-9c5b-68c7ece04df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:43.499366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402ef18-7f3d-43ee-9c5b-68c7ece04df3 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:43.503045 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb30900-c67d-438b-b101-faac51209ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:43.503659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb30900-c67d-438b-b101-faac51209ede service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:43.503941 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb30900-c67d-438b-b101-faac51209ede service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:43.504223 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb30900-c67d-438b-b101-faac51209ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:43.513147 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb30900-c67d-438b-b101-faac51209ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:43.514608 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb30900-c67d-438b-b101-faac51209ede service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:43.524703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1325/2629] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:43.583508 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8bad7-2451-4b5a-bca8-e67ac3c489a8 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:43.593735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8bad7-2451-4b5a-bca8-e67ac3c489a8 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:43.598029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f14da8-30ff-495f-a9ed-117a8cb95734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:43.598674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f14da8-30ff-495f-a9ed-117a8cb95734 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:43.598953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f14da8-30ff-495f-a9ed-117a8cb95734 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:43.599227 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f14da8-30ff-495f-a9ed-117a8cb95734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:43.600968 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-78f14da8-30ff-495f-a9ed-117a8cb95734 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:43.663885 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f14da8-30ff-495f-a9ed-117a8cb95734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:43.665328 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f14da8-30ff-495f-a9ed-117a8cb95734 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:43.676077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1305/2630] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:44.958095 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59906850-64bb-4f2f-9b81-02c30324bd9c None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:44.961917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59906850-64bb-4f2f-9b81-02c30324bd9c None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:44.961917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59906850-64bb-4f2f-9b81-02c30324bd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:44.990789 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-59906850-64bb-4f2f-9b81-02c30324bd9c None None] MFA Rules not processed for user `b769a01bcf7e4f47bc978aeb04c45a32`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:44.992167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-59906850-64bb-4f2f-9b81-02c30324bd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:45.132552 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1326/2631] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:09:45.143878 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f14da8-30ff-495f-a9ed-117a8cb95734 service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:45.147571 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-78f14da8-30ff-495f-a9ed-117a8cb95734 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:45.212669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f14da8-30ff-495f-a9ed-117a8cb95734 service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:45.216314 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab76f5-01f2-4757-96dc-ee1bbbfa788c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:45.216944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab76f5-01f2-4757-96dc-ee1bbbfa788c service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:45.217223 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab76f5-01f2-4757-96dc-ee1bbbfa788c service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:45.217634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab76f5-01f2-4757-96dc-ee1bbbfa788c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:45.226601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab76f5-01f2-4757-96dc-ee1bbbfa788c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:45.228187 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab76f5-01f2-4757-96dc-ee1bbbfa788c service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:45.237874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1306/2632] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:45.575161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59906850-64bb-4f2f-9b81-02c30324bd9c None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:45.585478 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59906850-64bb-4f2f-9b81-02c30324bd9c None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:45.589321 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f38c6-7798-47f0-bcbb-fbf26730ed33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:45.590014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f38c6-7798-47f0-bcbb-fbf26730ed33 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:45.590498 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f38c6-7798-47f0-bcbb-fbf26730ed33 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:45.590961 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f38c6-7798-47f0-bcbb-fbf26730ed33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:45.592834 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-975f38c6-7798-47f0-bcbb-fbf26730ed33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:45.621435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:45.667961 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f38c6-7798-47f0-bcbb-fbf26730ed33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:45.669415 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f38c6-7798-47f0-bcbb-fbf26730ed33 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:45.681692 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1327/2633] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:46.910752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab76f5-01f2-4757-96dc-ee1bbbfa788c service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:46.912519 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-50ab76f5-01f2-4757-96dc-ee1bbbfa788c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:46.925087 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab76f5-01f2-4757-96dc-ee1bbbfa788c service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:46.928918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a831a8-c026-4a63-b453-a6df55792da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:46.929566 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a831a8-c026-4a63-b453-a6df55792da1 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:46.929849 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a831a8-c026-4a63-b453-a6df55792da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:46.930122 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a831a8-c026-4a63-b453-a6df55792da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:46.931903 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-15a831a8-c026-4a63-b453-a6df55792da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:46.945834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a831a8-c026-4a63-b453-a6df55792da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:46.947280 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a831a8-c026-4a63-b453-a6df55792da1 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:46.958584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1307/2634] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:09:47.074477 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38b4c4-8013-43b4-85cc-791b69d7b971 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:47.075000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38b4c4-8013-43b4-85cc-791b69d7b971 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:47.075551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38b4c4-8013-43b4-85cc-791b69d7b971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:47.108369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-8e38b4c4-8013-43b4-85cc-791b69d7b971 None None] MFA Rules not processed for user `b769a01bcf7e4f47bc978aeb04c45a32`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:09:47.109588 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-8e38b4c4-8013-43b4-85cc-791b69d7b971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:47.116958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1328/2635] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:09:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:09:51.953962 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a831a8-c026-4a63-b453-a6df55792da1 service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:51.969571 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a831a8-c026-4a63-b453-a6df55792da1 service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:51.979792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459fe24-50fb-4e51-ac19-4bce56f6837b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:51.979792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459fe24-50fb-4e51-ac19-4bce56f6837b service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:51.979792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459fe24-50fb-4e51-ac19-4bce56f6837b service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:51.979792 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459fe24-50fb-4e51-ac19-4bce56f6837b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:51.980171 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4459fe24-50fb-4e51-ac19-4bce56f6837b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:52.000619 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459fe24-50fb-4e51-ac19-4bce56f6837b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:52.004829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459fe24-50fb-4e51-ac19-4bce56f6837b service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:52.016660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1308/2636] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:09:57.101118 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=24 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:58.143341 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38b4c4-8013-43b4-85cc-791b69d7b971 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:09:58.153742 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38b4c4-8013-43b4-85cc-791b69d7b971 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:09:58.157497 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953c4fc-112c-40be-8c02-a3d4e717a065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:09:58.158735 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c4fc-112c-40be-8c02-a3d4e717a065 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:09:58.159175 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c4fc-112c-40be-8c02-a3d4e717a065 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:09:58.159636 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c4fc-112c-40be-8c02-a3d4e717a065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:09:58.161430 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a953c4fc-112c-40be-8c02-a3d4e717a065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:09:58.177118 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953c4fc-112c-40be-8c02-a3d4e717a065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:09:58.178592 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953c4fc-112c-40be-8c02-a3d4e717a065 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:09:58.190045 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1329/2637] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:01.770671 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459fe24-50fb-4e51-ac19-4bce56f6837b service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:01.770671 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4459fe24-50fb-4e51-ac19-4bce56f6837b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:01.786857 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459fe24-50fb-4e51-ac19-4bce56f6837b service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:01.795526 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9f2b5-6839-4fcf-ad89-98b804c00e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:01.801011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9f2b5-6839-4fcf-ad89-98b804c00e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:01.801011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9f2b5-6839-4fcf-ad89-98b804c00e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:01.801011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9f2b5-6839-4fcf-ad89-98b804c00e5d admin admin] PATH_INFO: `/v3/users/d55973a68db34057b5dc4edde84e9a9a` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:01.801011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9f2b5-6839-4fcf-ad89-98b804c00e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d55973a68db34057b5dc4edde84e9a9a)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:01.803276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9f2b5-6839-4fcf-ad89-98b804c00e5d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:01.904539 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:02.009957 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-76b9f2b5-6839-4fcf-ad89-98b804c00e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd55973a68db34057b5dc4edde84e9a9a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:02.017505 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-76b9f2b5-6839-4fcf-ad89-98b804c00e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd55973a68db34057b5dc4edde84e9a9a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:02.029559 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-76b9f2b5-6839-4fcf-ad89-98b804c00e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd55973a68db34057b5dc4edde84e9a9a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:02.030300 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-76b9f2b5-6839-4fcf-ad89-98b804c00e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd55973a68db34057b5dc4edde84e9a9a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:02.030972 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-76b9f2b5-6839-4fcf-ad89-98b804c00e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd55973a68db34057b5dc4edde84e9a9a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:02.091280 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1309/2638] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:10:01 2022] DELETE /identity/v3/users/d55973a68db34057b5dc4edde84e9a9a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:02.501028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953c4fc-112c-40be-8c02-a3d4e717a065 service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:02.511239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953c4fc-112c-40be-8c02-a3d4e717a065 service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:02.594553 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74261c-542a-4022-a45a-ad29fe6637bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:02.595774 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74261c-542a-4022-a45a-ad29fe6637bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:02.596065 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74261c-542a-4022-a45a-ad29fe6637bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:02.596990 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74261c-542a-4022-a45a-ad29fe6637bb admin admin] PATH_INFO: `/v3/projects/1a51f592a9bb45249dc1db56d328fb1f` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:02.599304 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74261c-542a-4022-a45a-ad29fe6637bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a51f592a9bb45249dc1db56d328fb1f)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:02.601379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74261c-542a-4022-a45a-ad29fe6637bb admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:02.728787 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5b74261c-542a-4022-a45a-ad29fe6637bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a51f592a9bb45249dc1db56d328fb1f', 'request_id': 'req-5b74261c-542a-4022-a45a-ad29fe6637bb'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:02.735175 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5b74261c-542a-4022-a45a-ad29fe6637bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a51f592a9bb45249dc1db56d328fb1f', 'request_id': 'req-5b74261c-542a-4022-a45a-ad29fe6637bb'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:02.744336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5b74261c-542a-4022-a45a-ad29fe6637bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a51f592a9bb45249dc1db56d328fb1f', 'request_id': 'req-5b74261c-542a-4022-a45a-ad29fe6637bb'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:02.819274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5b74261c-542a-4022-a45a-ad29fe6637bb admin admin] The token cache is being invalidate because project 1a51f592a9bb45249dc1db56d328fb1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:10:02.823712 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5b74261c-542a-4022-a45a-ad29fe6637bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:02.823712 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5b74261c-542a-4022-a45a-ad29fe6637bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:02.823712 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1330/2639] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:10:02 2022] DELETE /identity/v3/projects/1a51f592a9bb45249dc1db56d328fb1f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:02.825884 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9f2b5-6839-4fcf-ad89-98b804c00e5d admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:02.828419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-76b9f2b5-6839-4fcf-ad89-98b804c00e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:02.852090 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9f2b5-6839-4fcf-ad89-98b804c00e5d admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:02.900662 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74261c-542a-4022-a45a-ad29fe6637bb admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:02.902614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5b74261c-542a-4022-a45a-ad29fe6637bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:02.910079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17325b36-5d3f-4ae0-ab1d-2f524aa1e4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:02.910775 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17325b36-5d3f-4ae0-ab1d-2f524aa1e4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:02.911060 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17325b36-5d3f-4ae0-ab1d-2f524aa1e4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:02.911342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17325b36-5d3f-4ae0-ab1d-2f524aa1e4e9 admin admin] PATH_INFO: `/v3/users/ac8fcc211c2b4046831de49f9a143422` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:02.913531 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17325b36-5d3f-4ae0-ab1d-2f524aa1e4e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8fcc211c2b4046831de49f9a143422)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:02.915793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17325b36-5d3f-4ae0-ab1d-2f524aa1e4e9 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:02.988825 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74261c-542a-4022-a45a-ad29fe6637bb admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:02.992338 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6415df-0b8f-4aa9-8327-90edc4ef66fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:02.992993 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6415df-0b8f-4aa9-8327-90edc4ef66fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:02.993469 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6415df-0b8f-4aa9-8327-90edc4ef66fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:02.993752 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6415df-0b8f-4aa9-8327-90edc4ef66fe admin admin] PATH_INFO: `/v3/users/5cd44ebc6bf442bca1e68c8b0fa94f00` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:03.011104 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6415df-0b8f-4aa9-8327-90edc4ef66fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cd44ebc6bf442bca1e68c8b0fa94f00)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:03.013180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6415df-0b8f-4aa9-8327-90edc4ef66fe admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:03.019169 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:03.175321 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-17325b36-5d3f-4ae0-ab1d-2f524aa1e4e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8fcc211c2b4046831de49f9a143422'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:03.182197 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-17325b36-5d3f-4ae0-ab1d-2f524aa1e4e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8fcc211c2b4046831de49f9a143422'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:03.196927 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-17325b36-5d3f-4ae0-ab1d-2f524aa1e4e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8fcc211c2b4046831de49f9a143422'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:03.200526 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-17325b36-5d3f-4ae0-ab1d-2f524aa1e4e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8fcc211c2b4046831de49f9a143422'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:03.200526 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-17325b36-5d3f-4ae0-ab1d-2f524aa1e4e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8fcc211c2b4046831de49f9a143422'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:03.205805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-bb6415df-0b8f-4aa9-8327-90edc4ef66fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cd44ebc6bf442bca1e68c8b0fa94f00'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:03.206727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-bb6415df-0b8f-4aa9-8327-90edc4ef66fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cd44ebc6bf442bca1e68c8b0fa94f00'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:03.219775 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-bb6415df-0b8f-4aa9-8327-90edc4ef66fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cd44ebc6bf442bca1e68c8b0fa94f00'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:03.309406 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1310/2640] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:10:02 2022] DELETE /identity/v3/users/ac8fcc211c2b4046831de49f9a143422 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:03.401041 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-bb6415df-0b8f-4aa9-8327-90edc4ef66fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cd44ebc6bf442bca1e68c8b0fa94f00'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:03.401699 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-bb6415df-0b8f-4aa9-8327-90edc4ef66fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cd44ebc6bf442bca1e68c8b0fa94f00'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:03.416497 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1331/2641] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:10:02 2022] DELETE /identity/v3/users/5cd44ebc6bf442bca1e68c8b0fa94f00 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:10:03.601059 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17325b36-5d3f-4ae0-ab1d-2f524aa1e4e9 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:03.603397 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-17325b36-5d3f-4ae0-ab1d-2f524aa1e4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:03.637025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:03.680829 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17325b36-5d3f-4ae0-ab1d-2f524aa1e4e9 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:03.708248 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6415df-0b8f-4aa9-8327-90edc4ef66fe admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:03.710482 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-bb6415df-0b8f-4aa9-8327-90edc4ef66fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:03.746241 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32215a-00e7-4756-b04c-0c119c6f46ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:03.746982 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32215a-00e7-4756-b04c-0c119c6f46ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:03.747266 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32215a-00e7-4756-b04c-0c119c6f46ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:03.747543 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32215a-00e7-4756-b04c-0c119c6f46ea admin admin] PATH_INFO: `/v3/projects/81689181471846bea71711b297202991` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:03.748830 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32215a-00e7-4756-b04c-0c119c6f46ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=81689181471846bea71711b297202991)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:03.750755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32215a-00e7-4756-b04c-0c119c6f46ea admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:03.781041 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6415df-0b8f-4aa9-8327-90edc4ef66fe admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:03.786587 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2370bbe-793e-42e6-bc11-6eb23b4301a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:03.787488 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2370bbe-793e-42e6-bc11-6eb23b4301a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:03.787773 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2370bbe-793e-42e6-bc11-6eb23b4301a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:03.788052 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2370bbe-793e-42e6-bc11-6eb23b4301a0 admin admin] PATH_INFO: `/v3/projects/209a08d43c1a439989a34711d35492a8` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:03.799142 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2370bbe-793e-42e6-bc11-6eb23b4301a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=209a08d43c1a439989a34711d35492a8)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:03.801082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2370bbe-793e-42e6-bc11-6eb23b4301a0 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:03.881812 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2f32215a-00e7-4756-b04c-0c119c6f46ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81689181471846bea71711b297202991', 'request_id': 'req-2f32215a-00e7-4756-b04c-0c119c6f46ea'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:03.888158 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2f32215a-00e7-4756-b04c-0c119c6f46ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81689181471846bea71711b297202991', 'request_id': 'req-2f32215a-00e7-4756-b04c-0c119c6f46ea'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:03.928912 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a2370bbe-793e-42e6-bc11-6eb23b4301a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209a08d43c1a439989a34711d35492a8', 'request_id': 'req-a2370bbe-793e-42e6-bc11-6eb23b4301a0'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:03.936314 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a2370bbe-793e-42e6-bc11-6eb23b4301a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209a08d43c1a439989a34711d35492a8', 'request_id': 'req-a2370bbe-793e-42e6-bc11-6eb23b4301a0'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:03.943027 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a2370bbe-793e-42e6-bc11-6eb23b4301a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209a08d43c1a439989a34711d35492a8', 'request_id': 'req-a2370bbe-793e-42e6-bc11-6eb23b4301a0'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:03.977683 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2f32215a-00e7-4756-b04c-0c119c6f46ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81689181471846bea71711b297202991', 'request_id': 'req-2f32215a-00e7-4756-b04c-0c119c6f46ea'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:03.988787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2f32215a-00e7-4756-b04c-0c119c6f46ea admin admin] The token cache is being invalidate because project 81689181471846bea71711b297202991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:10:03.989717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2f32215a-00e7-4756-b04c-0c119c6f46ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:03.990377 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2f32215a-00e7-4756-b04c-0c119c6f46ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:03.991975 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1311/2642] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:10:03 2022] DELETE /identity/v3/projects/81689181471846bea71711b297202991 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:10:04.088902 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a2370bbe-793e-42e6-bc11-6eb23b4301a0 admin admin] The token cache is being invalidate because project 209a08d43c1a439989a34711d35492a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:10:04.093049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a2370bbe-793e-42e6-bc11-6eb23b4301a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:04.093049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a2370bbe-793e-42e6-bc11-6eb23b4301a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:04.100605 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e428d9f-fe26-4bc4-bcac-3287242a4051 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:04.100911 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e428d9f-fe26-4bc4-bcac-3287242a4051 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:04.101191 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e428d9f-fe26-4bc4-bcac-3287242a4051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:04.103980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1332/2643] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:10:03 2022] DELETE /identity/v3/projects/209a08d43c1a439989a34711d35492a8 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:04.122167 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-9e428d9f-fe26-4bc4-bcac-3287242a4051 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:04.123463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-9e428d9f-fe26-4bc4-bcac-3287242a4051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:04.180659 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:04.189752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1312/2644] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:04.198247 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f619c1b-67b6-4722-abe1-34c3d281267d None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:04.198778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f619c1b-67b6-4722-abe1-34c3d281267d None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:04.201871 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f619c1b-67b6-4722-abe1-34c3d281267d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:04.218096 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:04.222366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-9f619c1b-67b6-4722-abe1-34c3d281267d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:04.223815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-9f619c1b-67b6-4722-abe1-34c3d281267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:04.232109 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1333/2645] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:04.237164 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e428d9f-fe26-4bc4-bcac-3287242a4051 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:04.247703 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e428d9f-fe26-4bc4-bcac-3287242a4051 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:04.253326 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b670b-4d19-49c2-8e9f-85e67aaa6ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:04.253957 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b670b-4d19-49c2-8e9f-85e67aaa6ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:04.254275 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b670b-4d19-49c2-8e9f-85e67aaa6ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:04.254546 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b670b-4d19-49c2-8e9f-85e67aaa6ab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:04.255309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b670b-4d19-49c2-8e9f-85e67aaa6ab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:04.255614 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b670b-4d19-49c2-8e9f-85e67aaa6ab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:04.257240 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b670b-4d19-49c2-8e9f-85e67aaa6ab2 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:04.270857 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1313/2646] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:04.275363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f619c1b-67b6-4722-abe1-34c3d281267d None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:04.285370 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f619c1b-67b6-4722-abe1-34c3d281267d None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:04.290298 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f464d4-d670-4196-81f8-b3a6d55dee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:04.290977 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f464d4-d670-4196-81f8-b3a6d55dee39 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:04.291257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f464d4-d670-4196-81f8-b3a6d55dee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:04.291527 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f464d4-d670-4196-81f8-b3a6d55dee39 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:04.292200 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f464d4-d670-4196-81f8-b3a6d55dee39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:04.294114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f464d4-d670-4196-81f8-b3a6d55dee39 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:04.408533 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1334/2647] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:10:04 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:04.413104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b670b-4d19-49c2-8e9f-85e67aaa6ab2 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:04.423014 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b670b-4d19-49c2-8e9f-85e67aaa6ab2 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:04.480585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f98b49-5be3-43b4-b656-5de2fecf4d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:04.481127 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f98b49-5be3-43b4-b656-5de2fecf4d73 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:04.481413 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f98b49-5be3-43b4-b656-5de2fecf4d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:04.481692 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f98b49-5be3-43b4-b656-5de2fecf4d73 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:04.482369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f98b49-5be3-43b4-b656-5de2fecf4d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:04.484303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f98b49-5be3-43b4-b656-5de2fecf4d73 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:04.571891 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1314/2648] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:10:04 2022] POST /identity/v3/users => generated 284 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:10:04.576027 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f464d4-d670-4196-81f8-b3a6d55dee39 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:04.586306 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f464d4-d670-4196-81f8-b3a6d55dee39 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:04.591254 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24199235-95c7-4c5f-9331-fc9da5c3905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:04.591864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24199235-95c7-4c5f-9331-fc9da5c3905c admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:04.592149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24199235-95c7-4c5f-9331-fc9da5c3905c admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:04.592426 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24199235-95c7-4c5f-9331-fc9da5c3905c admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:04.593152 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24199235-95c7-4c5f-9331-fc9da5c3905c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:04.594837 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24199235-95c7-4c5f-9331-fc9da5c3905c admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:04.604887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1335/2649] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:10:04.608674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f98b49-5be3-43b4-b656-5de2fecf4d73 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:04.619213 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f98b49-5be3-43b4-b656-5de2fecf4d73 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:04.623886 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c069912-7a61-4a2d-ad1e-36afe42ff399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:04.624484 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c069912-7a61-4a2d-ad1e-36afe42ff399 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:04.624766 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c069912-7a61-4a2d-ad1e-36afe42ff399 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:04.625039 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c069912-7a61-4a2d-ad1e-36afe42ff399 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:04.625724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c069912-7a61-4a2d-ad1e-36afe42ff399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:04.627992 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c069912-7a61-4a2d-ad1e-36afe42ff399 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:04.638485 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1315/2650] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:10:04.642562 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24199235-95c7-4c5f-9331-fc9da5c3905c admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:04.652523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24199235-95c7-4c5f-9331-fc9da5c3905c admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:04.657146 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42189045-110c-4d84-9cd5-0fd66e73ca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:04.658399 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42189045-110c-4d84-9cd5-0fd66e73ca14 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:04.658702 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42189045-110c-4d84-9cd5-0fd66e73ca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:04.658987 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42189045-110c-4d84-9cd5-0fd66e73ca14 admin admin] PATH_INFO: `/v3/projects/10b2c7c679e84994adf704fd8746a4c4/users/9a4895b24cd64dba9580b1714410dca4/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:04.675161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42189045-110c-4d84-9cd5-0fd66e73ca14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b2c7c679e84994adf704fd8746a4c4, user_id=9a4895b24cd64dba9580b1714410dca4, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:04.677823 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42189045-110c-4d84-9cd5-0fd66e73ca14 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:04.727003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1336/2651] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:10:04 2022] PUT /identity/v3/projects/10b2c7c679e84994adf704fd8746a4c4/users/9a4895b24cd64dba9580b1714410dca4/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:04.741955 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5a6dd-ce42-4bd2-9c7c-d7f5661c99a5 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:04.742185 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5a6dd-ce42-4bd2-9c7c-d7f5661c99a5 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:04.742483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5a6dd-ce42-4bd2-9c7c-d7f5661c99a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:04.770467 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-4da5a6dd-ce42-4bd2-9c7c-d7f5661c99a5 None None] MFA Rules not processed for user `9a4895b24cd64dba9580b1714410dca4`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:04.771666 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4da5a6dd-ce42-4bd2-9c7c-d7f5661c99a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:04.837917 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1316/2652] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:04.842590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42189045-110c-4d84-9cd5-0fd66e73ca14 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:04.904029 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42189045-110c-4d84-9cd5-0fd66e73ca14 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:04.909343 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f786a6d-c5e6-4340-83f8-7c0572bedb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:04.909985 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f786a6d-c5e6-4340-83f8-7c0572bedb1b admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:04.910277 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f786a6d-c5e6-4340-83f8-7c0572bedb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:04.910599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f786a6d-c5e6-4340-83f8-7c0572bedb1b admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:04.911272 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f786a6d-c5e6-4340-83f8-7c0572bedb1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:04.913435 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f786a6d-c5e6-4340-83f8-7c0572bedb1b admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:05.007817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1337/2653] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:10:04 2022] POST /identity/v3/projects => generated 367 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:05.012012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5a6dd-ce42-4bd2-9c7c-d7f5661c99a5 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:05.023653 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5a6dd-ce42-4bd2-9c7c-d7f5661c99a5 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:05.072516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:05.079325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cf4b0-cc2e-441d-a2e0-f78bcf93c35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:05.080464 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cf4b0-cc2e-441d-a2e0-f78bcf93c35c admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:05.080773 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cf4b0-cc2e-441d-a2e0-f78bcf93c35c admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:05.081110 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cf4b0-cc2e-441d-a2e0-f78bcf93c35c admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:05.081782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cf4b0-cc2e-441d-a2e0-f78bcf93c35c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:05.083766 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cf4b0-cc2e-441d-a2e0-f78bcf93c35c admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:05.214352 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1317/2654] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:10:05 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:05.217060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f786a6d-c5e6-4340-83f8-7c0572bedb1b admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:05.227877 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f786a6d-c5e6-4340-83f8-7c0572bedb1b admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:05.233254 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe68033-ec3d-44ae-8f1e-90e1659d0b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:05.233882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe68033-ec3d-44ae-8f1e-90e1659d0b7d admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:05.234173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe68033-ec3d-44ae-8f1e-90e1659d0b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:05.234499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe68033-ec3d-44ae-8f1e-90e1659d0b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:05.235201 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe68033-ec3d-44ae-8f1e-90e1659d0b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:05.236817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe68033-ec3d-44ae-8f1e-90e1659d0b7d admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:05.248178 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1338/2655] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:10:05.252243 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cf4b0-cc2e-441d-a2e0-f78bcf93c35c admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:05.263890 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cf4b0-cc2e-441d-a2e0-f78bcf93c35c admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:05.268058 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70ee3e-6bba-4ec6-bbb1-1cc2ac2a9eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:05.268728 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70ee3e-6bba-4ec6-bbb1-1cc2ac2a9eca admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:05.269010 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70ee3e-6bba-4ec6-bbb1-1cc2ac2a9eca admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:05.269356 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70ee3e-6bba-4ec6-bbb1-1cc2ac2a9eca admin admin] PATH_INFO: `/v3/projects/df68f02daba14c5e813404796c7cbbd1/users/e4af5e575cac42b9a9d4f579fe62040f/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:05.287475 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70ee3e-6bba-4ec6-bbb1-1cc2ac2a9eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=df68f02daba14c5e813404796c7cbbd1, user_id=e4af5e575cac42b9a9d4f579fe62040f, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:05.289710 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70ee3e-6bba-4ec6-bbb1-1cc2ac2a9eca admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:05.355254 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1318/2656] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:10:05 2022] PUT /identity/v3/projects/df68f02daba14c5e813404796c7cbbd1/users/e4af5e575cac42b9a9d4f579fe62040f/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:05.359370 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe68033-ec3d-44ae-8f1e-90e1659d0b7d admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:05.369679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe68033-ec3d-44ae-8f1e-90e1659d0b7d admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:05.428713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776d436-aeb3-4ca3-a323-a324bea2bed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:05.429366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776d436-aeb3-4ca3-a323-a324bea2bed4 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:05.429644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776d436-aeb3-4ca3-a323-a324bea2bed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:05.429919 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776d436-aeb3-4ca3-a323-a324bea2bed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:05.430642 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776d436-aeb3-4ca3-a323-a324bea2bed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:05.432257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776d436-aeb3-4ca3-a323-a324bea2bed4 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:05.442751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1339/2657] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:10:05.447134 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70ee3e-6bba-4ec6-bbb1-1cc2ac2a9eca admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:05.458198 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70ee3e-6bba-4ec6-bbb1-1cc2ac2a9eca admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:05.462827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e69aa-db94-40f9-836d-362a0e713289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:05.463493 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e69aa-db94-40f9-836d-362a0e713289 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:05.463763 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e69aa-db94-40f9-836d-362a0e713289 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:05.464035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e69aa-db94-40f9-836d-362a0e713289 admin admin] PATH_INFO: `/v3/projects/df68f02daba14c5e813404796c7cbbd1/users/e4af5e575cac42b9a9d4f579fe62040f/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:05.465956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e69aa-db94-40f9-836d-362a0e713289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df68f02daba14c5e813404796c7cbbd1, user_id=e4af5e575cac42b9a9d4f579fe62040f, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:05.468741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e69aa-db94-40f9-836d-362a0e713289 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:05.479007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1319/2658] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:10:05 2022] PUT /identity/v3/projects/df68f02daba14c5e813404796c7cbbd1/users/e4af5e575cac42b9a9d4f579fe62040f/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:05.490675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df6661-bff2-4320-8e08-ffab49da7cb1 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:05.490978 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df6661-bff2-4320-8e08-ffab49da7cb1 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:05.491267 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df6661-bff2-4320-8e08-ffab49da7cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:05.516382 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:05.519833 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-88df6661-bff2-4320-8e08-ffab49da7cb1 None None] MFA Rules not processed for user `e4af5e575cac42b9a9d4f579fe62040f`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:05.521034 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-88df6661-bff2-4320-8e08-ffab49da7cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:05.589805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1340/2659] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:05.600817 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e69aa-db94-40f9-836d-362a0e713289 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:05.602659 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-269e69aa-db94-40f9-836d-362a0e713289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:05.664484 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e69aa-db94-40f9-836d-362a0e713289 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:05.668281 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5f91e-e261-419d-ba7e-a70090a5f4f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:05.668909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5f91e-e261-419d-ba7e-a70090a5f4f5 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:05.669217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5f91e-e261-419d-ba7e-a70090a5f4f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:05.669493 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5f91e-e261-419d-ba7e-a70090a5f4f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:05.682694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5f91e-e261-419d-ba7e-a70090a5f4f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:05.686107 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5f91e-e261-419d-ba7e-a70090a5f4f5 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:05.694175 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1320/2660] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:05 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:07.432895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41655b28-37b5-40e1-acc3-50deeb79f923 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:07.433406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41655b28-37b5-40e1-acc3-50deeb79f923 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:07.433499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41655b28-37b5-40e1-acc3-50deeb79f923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:07.453884 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-41655b28-37b5-40e1-acc3-50deeb79f923 None None] MFA Rules not processed for user `b769a01bcf7e4f47bc978aeb04c45a32`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:07.455218 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-41655b28-37b5-40e1-acc3-50deeb79f923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:07.511686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1341/2661] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:08.602039 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5f91e-e261-419d-ba7e-a70090a5f4f5 service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:08.665893 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5f91e-e261-419d-ba7e-a70090a5f4f5 service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:08.670912 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559c7d2-ba7f-4e86-83dd-8a0b5cd24003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:08.671563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559c7d2-ba7f-4e86-83dd-8a0b5cd24003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:08.671877 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559c7d2-ba7f-4e86-83dd-8a0b5cd24003 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:08.672172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559c7d2-ba7f-4e86-83dd-8a0b5cd24003 admin admin] PATH_INFO: `/v3/users/9a4895b24cd64dba9580b1714410dca4` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:08.673395 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559c7d2-ba7f-4e86-83dd-8a0b5cd24003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a4895b24cd64dba9580b1714410dca4)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:08.675380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559c7d2-ba7f-4e86-83dd-8a0b5cd24003 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:08.895768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3559c7d2-ba7f-4e86-83dd-8a0b5cd24003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a4895b24cd64dba9580b1714410dca4'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:08.900285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:08.903866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3559c7d2-ba7f-4e86-83dd-8a0b5cd24003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a4895b24cd64dba9580b1714410dca4'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:08.916292 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3559c7d2-ba7f-4e86-83dd-8a0b5cd24003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a4895b24cd64dba9580b1714410dca4'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:08.918965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3559c7d2-ba7f-4e86-83dd-8a0b5cd24003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a4895b24cd64dba9580b1714410dca4'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:08.918965 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3559c7d2-ba7f-4e86-83dd-8a0b5cd24003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a4895b24cd64dba9580b1714410dca4'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:09.001502 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1321/2662] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:10:08 2022] DELETE /identity/v3/users/9a4895b24cd64dba9580b1714410dca4 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:09.006715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b532a6-79a1-4d7e-9946-8785ff6ebdec None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:09.007210 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b532a6-79a1-4d7e-9946-8785ff6ebdec None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:09.007342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b532a6-79a1-4d7e-9946-8785ff6ebdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:09.025599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-d2b532a6-79a1-4d7e-9946-8785ff6ebdec None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:09.026814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d2b532a6-79a1-4d7e-9946-8785ff6ebdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:09.087382 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1342/2663] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:09.098093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559c7d2-ba7f-4e86-83dd-8a0b5cd24003 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:09.099577 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-3559c7d2-ba7f-4e86-83dd-8a0b5cd24003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:09.156752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559c7d2-ba7f-4e86-83dd-8a0b5cd24003 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:09.161130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04636130-8dcc-448f-a1d2-8224ec94a15b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:09.161760 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04636130-8dcc-448f-a1d2-8224ec94a15b service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:09.162044 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04636130-8dcc-448f-a1d2-8224ec94a15b service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:09.162626 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04636130-8dcc-448f-a1d2-8224ec94a15b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:09.171928 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04636130-8dcc-448f-a1d2-8224ec94a15b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:09.174102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04636130-8dcc-448f-a1d2-8224ec94a15b service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:09.184283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1322/2664] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:09.762601 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b532a6-79a1-4d7e-9946-8785ff6ebdec None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:09.764189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d2b532a6-79a1-4d7e-9946-8785ff6ebdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:09.778652 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b532a6-79a1-4d7e-9946-8785ff6ebdec None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:09.783303 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b38cdf-1f2b-4cda-a163-c511031d7f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:09.786203 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b38cdf-1f2b-4cda-a163-c511031d7f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:09.786203 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b38cdf-1f2b-4cda-a163-c511031d7f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:09.786203 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b38cdf-1f2b-4cda-a163-c511031d7f17 admin admin] PATH_INFO: `/v3/projects/10b2c7c679e84994adf704fd8746a4c4` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:09.787633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b38cdf-1f2b-4cda-a163-c511031d7f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10b2c7c679e84994adf704fd8746a4c4)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:09.789548 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b38cdf-1f2b-4cda-a163-c511031d7f17 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:09.954498 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:09.961992 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-09b38cdf-1f2b-4cda-a163-c511031d7f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10b2c7c679e84994adf704fd8746a4c4', 'request_id': 'req-09b38cdf-1f2b-4cda-a163-c511031d7f17'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:09.968163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-09b38cdf-1f2b-4cda-a163-c511031d7f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10b2c7c679e84994adf704fd8746a4c4', 'request_id': 'req-09b38cdf-1f2b-4cda-a163-c511031d7f17'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:09.973528 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-09b38cdf-1f2b-4cda-a163-c511031d7f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10b2c7c679e84994adf704fd8746a4c4', 'request_id': 'req-09b38cdf-1f2b-4cda-a163-c511031d7f17'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:10.063942 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-09b38cdf-1f2b-4cda-a163-c511031d7f17 admin admin] The token cache is being invalidate because project 10b2c7c679e84994adf704fd8746a4c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:10:10.064617 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-09b38cdf-1f2b-4cda-a163-c511031d7f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:10.064781 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-09b38cdf-1f2b-4cda-a163-c511031d7f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:10.066349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1343/2665] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:10:09 2022] DELETE /identity/v3/projects/10b2c7c679e84994adf704fd8746a4c4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:10.070903 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04636130-8dcc-448f-a1d2-8224ec94a15b service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:10.080812 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04636130-8dcc-448f-a1d2-8224ec94a15b service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:10.136718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dc034-2f7a-4f80-a3aa-df9f3876fb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:10.137368 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dc034-2f7a-4f80-a3aa-df9f3876fb48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:10.137674 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dc034-2f7a-4f80-a3aa-df9f3876fb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:10.137938 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dc034-2f7a-4f80-a3aa-df9f3876fb48 admin admin] PATH_INFO: `/v3/users/e4af5e575cac42b9a9d4f579fe62040f` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:10.139166 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709dc034-2f7a-4f80-a3aa-df9f3876fb48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4af5e575cac42b9a9d4f579fe62040f)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:10.141098 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709dc034-2f7a-4f80-a3aa-df9f3876fb48 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:10.282184 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-709dc034-2f7a-4f80-a3aa-df9f3876fb48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4af5e575cac42b9a9d4f579fe62040f'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:10.289459 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-709dc034-2f7a-4f80-a3aa-df9f3876fb48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4af5e575cac42b9a9d4f579fe62040f'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:10.301318 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-709dc034-2f7a-4f80-a3aa-df9f3876fb48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4af5e575cac42b9a9d4f579fe62040f'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:10.302538 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-709dc034-2f7a-4f80-a3aa-df9f3876fb48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4af5e575cac42b9a9d4f579fe62040f'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:10.303137 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-709dc034-2f7a-4f80-a3aa-df9f3876fb48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4af5e575cac42b9a9d4f579fe62040f'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:10.304871 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:10.367502 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1323/2666] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:10:10 2022] DELETE /identity/v3/users/e4af5e575cac42b9a9d4f579fe62040f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:10.819733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b38cdf-1f2b-4cda-a163-c511031d7f17 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:10.821309 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-09b38cdf-1f2b-4cda-a163-c511031d7f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:10.835322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b38cdf-1f2b-4cda-a163-c511031d7f17 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:10.905615 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4b91c-5a0e-40ea-bfaf-2b20fcfe5ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:10.906506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4b91c-5a0e-40ea-bfaf-2b20fcfe5ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:10.906792 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4b91c-5a0e-40ea-bfaf-2b20fcfe5ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:10.907073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4b91c-5a0e-40ea-bfaf-2b20fcfe5ad7 admin admin] PATH_INFO: `/v3/projects/df68f02daba14c5e813404796c7cbbd1` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:10.908253 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4b91c-5a0e-40ea-bfaf-2b20fcfe5ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df68f02daba14c5e813404796c7cbbd1)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:10.910224 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4b91c-5a0e-40ea-bfaf-2b20fcfe5ad7 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:11.054025 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-aaf4b91c-5a0e-40ea-bfaf-2b20fcfe5ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df68f02daba14c5e813404796c7cbbd1', 'request_id': 'req-aaf4b91c-5a0e-40ea-bfaf-2b20fcfe5ad7'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:11.063067 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-aaf4b91c-5a0e-40ea-bfaf-2b20fcfe5ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df68f02daba14c5e813404796c7cbbd1', 'request_id': 'req-aaf4b91c-5a0e-40ea-bfaf-2b20fcfe5ad7'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:11.068926 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-aaf4b91c-5a0e-40ea-bfaf-2b20fcfe5ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df68f02daba14c5e813404796c7cbbd1', 'request_id': 'req-aaf4b91c-5a0e-40ea-bfaf-2b20fcfe5ad7'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:11.149557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-aaf4b91c-5a0e-40ea-bfaf-2b20fcfe5ad7 admin admin] The token cache is being invalidate because project df68f02daba14c5e813404796c7cbbd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:10:11.149854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-aaf4b91c-5a0e-40ea-bfaf-2b20fcfe5ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:11.150513 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-aaf4b91c-5a0e-40ea-bfaf-2b20fcfe5ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:11.152046 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1344/2667] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:10:10 2022] DELETE /identity/v3/projects/df68f02daba14c5e813404796c7cbbd1 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:11.157100 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69120df2-ce5e-47fe-95ab-83ea8b9c3805 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:11.157593 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69120df2-ce5e-47fe-95ab-83ea8b9c3805 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:11.157593 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69120df2-ce5e-47fe-95ab-83ea8b9c3805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:11.178960 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-69120df2-ce5e-47fe-95ab-83ea8b9c3805 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:11.180264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-69120df2-ce5e-47fe-95ab-83ea8b9c3805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:11.243729 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1324/2668] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:11.251635 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c913a-6e6e-49e8-85ef-4f9b7cc5a33a None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:11.252011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c913a-6e6e-49e8-85ef-4f9b7cc5a33a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:11.252368 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c913a-6e6e-49e8-85ef-4f9b7cc5a33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:11.273514 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-000c913a-6e6e-49e8-85ef-4f9b7cc5a33a None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:11.274773 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-000c913a-6e6e-49e8-85ef-4f9b7cc5a33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:11.282993 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1345/2669] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:11.288259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69120df2-ce5e-47fe-95ab-83ea8b9c3805 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:11.298196 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69120df2-ce5e-47fe-95ab-83ea8b9c3805 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:11.303524 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559f7b5-20ec-477f-a9eb-c9c962b9d76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:11.304144 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559f7b5-20ec-477f-a9eb-c9c962b9d76e admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:11.304432 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559f7b5-20ec-477f-a9eb-c9c962b9d76e admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:11.304739 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559f7b5-20ec-477f-a9eb-c9c962b9d76e admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:11.305438 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559f7b5-20ec-477f-a9eb-c9c962b9d76e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:11.305746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559f7b5-20ec-477f-a9eb-c9c962b9d76e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:11.307374 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559f7b5-20ec-477f-a9eb-c9c962b9d76e admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:11.321310 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1325/2670] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:11.326011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c913a-6e6e-49e8-85ef-4f9b7cc5a33a None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:11.335103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c913a-6e6e-49e8-85ef-4f9b7cc5a33a None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:11.339997 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628fc79-124f-4555-a42d-aedc58df2c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:11.340872 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628fc79-124f-4555-a42d-aedc58df2c66 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:11.341158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628fc79-124f-4555-a42d-aedc58df2c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:11.341439 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628fc79-124f-4555-a42d-aedc58df2c66 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:11.342291 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628fc79-124f-4555-a42d-aedc58df2c66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:11.344230 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628fc79-124f-4555-a42d-aedc58df2c66 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:11.443035 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1346/2671] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:10:11 2022] POST /identity/v3/projects => generated 401 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:10:11.447203 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559f7b5-20ec-477f-a9eb-c9c962b9d76e admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:11.457371 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559f7b5-20ec-477f-a9eb-c9c962b9d76e admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:11.512572 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1448a2a-c012-4fac-9634-d5c3eaa64984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:11.513181 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1448a2a-c012-4fac-9634-d5c3eaa64984 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:11.513463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1448a2a-c012-4fac-9634-d5c3eaa64984 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:11.513855 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1448a2a-c012-4fac-9634-d5c3eaa64984 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:11.514563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1448a2a-c012-4fac-9634-d5c3eaa64984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:11.516525 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1448a2a-c012-4fac-9634-d5c3eaa64984 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:11.552572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628fc79-124f-4555-a42d-aedc58df2c66 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:11.554540 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0628fc79-124f-4555-a42d-aedc58df2c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:11.587427 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:11.592873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1326/2672] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:10:11 2022] POST /identity/v3/users => generated 301 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:11.593883 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1448a2a-c012-4fac-9634-d5c3eaa64984 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:11.604859 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1448a2a-c012-4fac-9634-d5c3eaa64984 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:11.609686 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a3dfe-7753-471d-8684-eef7a27bd9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:11.612455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a3dfe-7753-471d-8684-eef7a27bd9ca admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:11.612455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a3dfe-7753-471d-8684-eef7a27bd9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:11.612455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a3dfe-7753-471d-8684-eef7a27bd9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:11.612455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a3dfe-7753-471d-8684-eef7a27bd9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:11.613549 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a3dfe-7753-471d-8684-eef7a27bd9ca admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:11.613852 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628fc79-124f-4555-a42d-aedc58df2c66 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:11.618729 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98e9a4-b48d-4330-9652-a82b7329800a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:11.619345 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98e9a4-b48d-4330-9652-a82b7329800a service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:11.620081 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98e9a4-b48d-4330-9652-a82b7329800a service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:11.620366 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98e9a4-b48d-4330-9652-a82b7329800a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:11.622322 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4d98e9a4-b48d-4330-9652-a82b7329800a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:11.625252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1327/2673] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:10:11.629283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a3dfe-7753-471d-8684-eef7a27bd9ca admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:11.633629 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98e9a4-b48d-4330-9652-a82b7329800a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:11.635211 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98e9a4-b48d-4330-9652-a82b7329800a service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:11.639028 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a3dfe-7753-471d-8684-eef7a27bd9ca admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:11.643749 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6b7c9-8ca1-4b72-b96f-c36e32b2da45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:11.644347 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6b7c9-8ca1-4b72-b96f-c36e32b2da45 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:11.644632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6b7c9-8ca1-4b72-b96f-c36e32b2da45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:11.644953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6b7c9-8ca1-4b72-b96f-c36e32b2da45 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:11.646141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6b7c9-8ca1-4b72-b96f-c36e32b2da45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:11.646570 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1347/2674] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:10:11.648048 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6b7c9-8ca1-4b72-b96f-c36e32b2da45 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:11.662562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1328/2675] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:10:11.664382 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98e9a4-b48d-4330-9652-a82b7329800a service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:11.676180 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98e9a4-b48d-4330-9652-a82b7329800a service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:11.681892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebb99e-7275-4ba5-b427-2b5242194c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:11.682849 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebb99e-7275-4ba5-b427-2b5242194c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:11.683137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebb99e-7275-4ba5-b427-2b5242194c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:11.683448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebb99e-7275-4ba5-b427-2b5242194c63 admin admin] PATH_INFO: `/v3/projects/84060dff1bb14ff9b6a9a91f14cb5bd3/users/fc62da5b2f1a4d97b48cf3379549fd4f/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:11.701591 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebb99e-7275-4ba5-b427-2b5242194c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84060dff1bb14ff9b6a9a91f14cb5bd3, user_id=fc62da5b2f1a4d97b48cf3379549fd4f, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:11.704677 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebb99e-7275-4ba5-b427-2b5242194c63 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:11.779696 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1348/2676] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:10:11 2022] PUT /identity/v3/projects/84060dff1bb14ff9b6a9a91f14cb5bd3/users/fc62da5b2f1a4d97b48cf3379549fd4f/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:10:11.796239 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58149122-139e-4c98-98ae-d3d85a13690a None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:11.796877 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58149122-139e-4c98-98ae-d3d85a13690a None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:11.797426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58149122-139e-4c98-98ae-d3d85a13690a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:11.831215 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-58149122-139e-4c98-98ae-d3d85a13690a None None] MFA Rules not processed for user `fc62da5b2f1a4d97b48cf3379549fd4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:11.832437 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-58149122-139e-4c98-98ae-d3d85a13690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:11.871126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:11.916015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1329/2677] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:10:11.920544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebb99e-7275-4ba5-b427-2b5242194c63 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:11.985249 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebb99e-7275-4ba5-b427-2b5242194c63 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:11.989867 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76805b58-dbac-4dd9-ba5b-a754a25c8c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:11.990542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76805b58-dbac-4dd9-ba5b-a754a25c8c73 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:11.990827 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76805b58-dbac-4dd9-ba5b-a754a25c8c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:11.991103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76805b58-dbac-4dd9-ba5b-a754a25c8c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:11.991768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76805b58-dbac-4dd9-ba5b-a754a25c8c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:11.993707 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76805b58-dbac-4dd9-ba5b-a754a25c8c73 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:12.145101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1349/2678] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:10:11 2022] POST /identity/v3/projects => generated 401 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:12.149921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58149122-139e-4c98-98ae-d3d85a13690a None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:12.163622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58149122-139e-4c98-98ae-d3d85a13690a None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:12.231778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b61662-d6a5-43c9-a449-e1d5120c7232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:12.232434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b61662-d6a5-43c9-a449-e1d5120c7232 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:12.232718 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b61662-d6a5-43c9-a449-e1d5120c7232 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:12.232996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b61662-d6a5-43c9-a449-e1d5120c7232 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:12.233687 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b61662-d6a5-43c9-a449-e1d5120c7232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:12.240268 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b61662-d6a5-43c9-a449-e1d5120c7232 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:12.306974 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1330/2679] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:10:12 2022] POST /identity/v3/users => generated 307 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:12.308870 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76805b58-dbac-4dd9-ba5b-a754a25c8c73 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:12.320628 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76805b58-dbac-4dd9-ba5b-a754a25c8c73 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:12.325719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6995de-bbd1-46e0-84d4-67b0018321a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:12.326352 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6995de-bbd1-46e0-84d4-67b0018321a7 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:12.326744 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6995de-bbd1-46e0-84d4-67b0018321a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:12.326964 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6995de-bbd1-46e0-84d4-67b0018321a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:12.327669 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6995de-bbd1-46e0-84d4-67b0018321a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:12.329402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6995de-bbd1-46e0-84d4-67b0018321a7 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:12.342840 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1350/2680] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:10:12.347316 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b61662-d6a5-43c9-a449-e1d5120c7232 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:12.357796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b61662-d6a5-43c9-a449-e1d5120c7232 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:12.362477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd053d6-cec7-4c14-a536-71c522600bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:12.363185 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd053d6-cec7-4c14-a536-71c522600bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:12.363474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd053d6-cec7-4c14-a536-71c522600bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:12.363755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd053d6-cec7-4c14-a536-71c522600bb6 admin admin] PATH_INFO: `/v3/projects/fee1c900bca14fc782e45295c3720acf/users/ac97a73f739546b3be52b8c4d8bfdb36/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:12.378936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd053d6-cec7-4c14-a536-71c522600bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee1c900bca14fc782e45295c3720acf, user_id=ac97a73f739546b3be52b8c4d8bfdb36, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:12.382152 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd053d6-cec7-4c14-a536-71c522600bb6 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:12.495589 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1331/2681] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:10:12 2022] PUT /identity/v3/projects/fee1c900bca14fc782e45295c3720acf/users/ac97a73f739546b3be52b8c4d8bfdb36/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:12.499734 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6995de-bbd1-46e0-84d4-67b0018321a7 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:12.513001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6995de-bbd1-46e0-84d4-67b0018321a7 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:12.579089 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7f9f8-7ef6-4f31-b277-38bc6b6a2b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:12.579724 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7f9f8-7ef6-4f31-b277-38bc6b6a2b44 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:12.580139 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7f9f8-7ef6-4f31-b277-38bc6b6a2b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:12.580426 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7f9f8-7ef6-4f31-b277-38bc6b6a2b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:12.581131 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7f9f8-7ef6-4f31-b277-38bc6b6a2b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:12.582888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7f9f8-7ef6-4f31-b277-38bc6b6a2b44 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:12.593758 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1351/2682] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:10:12.597866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd053d6-cec7-4c14-a536-71c522600bb6 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:12.608569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd053d6-cec7-4c14-a536-71c522600bb6 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:12.613263 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b93e31-a7d9-4a81-859b-50ef7fb8ac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:12.613930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b93e31-a7d9-4a81-859b-50ef7fb8ac7e admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:12.615708 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b93e31-a7d9-4a81-859b-50ef7fb8ac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:12.615708 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b93e31-a7d9-4a81-859b-50ef7fb8ac7e admin admin] PATH_INFO: `/v3/projects/fee1c900bca14fc782e45295c3720acf/users/ac97a73f739546b3be52b8c4d8bfdb36/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:12.617167 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b93e31-a7d9-4a81-859b-50ef7fb8ac7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee1c900bca14fc782e45295c3720acf, user_id=ac97a73f739546b3be52b8c4d8bfdb36, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:12.619844 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b93e31-a7d9-4a81-859b-50ef7fb8ac7e admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:12.631849 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1332/2683] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:10:12 2022] PUT /identity/v3/projects/fee1c900bca14fc782e45295c3720acf/users/ac97a73f739546b3be52b8c4d8bfdb36/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:12.642583 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169c719-fc84-443a-ac17-c13b9caced00 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:12.642875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169c719-fc84-443a-ac17-c13b9caced00 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:12.643155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169c719-fc84-443a-ac17-c13b9caced00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:12.672769 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-e169c719-fc84-443a-ac17-c13b9caced00 None None] MFA Rules not processed for user `ac97a73f739546b3be52b8c4d8bfdb36`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:12.674098 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e169c719-fc84-443a-ac17-c13b9caced00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:12.680469 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:12.745650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1352/2684] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:12.757398 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b93e31-a7d9-4a81-859b-50ef7fb8ac7e admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:12.759309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-48b93e31-a7d9-4a81-859b-50ef7fb8ac7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:12.820320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b93e31-a7d9-4a81-859b-50ef7fb8ac7e admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:12.824350 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085d51d-18cf-4305-bd6c-08244dba10f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:12.824970 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085d51d-18cf-4305-bd6c-08244dba10f0 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:12.825247 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085d51d-18cf-4305-bd6c-08244dba10f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:12.825520 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085d51d-18cf-4305-bd6c-08244dba10f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:12.836142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085d51d-18cf-4305-bd6c-08244dba10f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:12.837794 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085d51d-18cf-4305-bd6c-08244dba10f0 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:12.847999 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1333/2685] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:12 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:13.060468 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169c719-fc84-443a-ac17-c13b9caced00 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:13.070842 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169c719-fc84-443a-ac17-c13b9caced00 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:13.074675 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2563fe8-18e0-4357-86be-0cb3a4db8116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:13.075308 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2563fe8-18e0-4357-86be-0cb3a4db8116 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:13.075596 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2563fe8-18e0-4357-86be-0cb3a4db8116 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:13.075876 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2563fe8-18e0-4357-86be-0cb3a4db8116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:13.132987 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2563fe8-18e0-4357-86be-0cb3a4db8116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:13.134476 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2563fe8-18e0-4357-86be-0cb3a4db8116 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:13.143855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1353/2686] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:19.164987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085d51d-18cf-4305-bd6c-08244dba10f0 service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:19.202804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:19.234184 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085d51d-18cf-4305-bd6c-08244dba10f0 service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:19.239127 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef69126-d2f3-4f26-aa19-ec1402d02048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:19.239713 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef69126-d2f3-4f26-aa19-ec1402d02048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:19.240022 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef69126-d2f3-4f26-aa19-ec1402d02048 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:19.240290 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef69126-d2f3-4f26-aa19-ec1402d02048 admin admin] PATH_INFO: `/v3/users/fc62da5b2f1a4d97b48cf3379549fd4f` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:19.241552 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef69126-d2f3-4f26-aa19-ec1402d02048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc62da5b2f1a4d97b48cf3379549fd4f)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:19.243517 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef69126-d2f3-4f26-aa19-ec1402d02048 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:19.453373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2ef69126-d2f3-4f26-aa19-ec1402d02048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc62da5b2f1a4d97b48cf3379549fd4f'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:19.464066 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2ef69126-d2f3-4f26-aa19-ec1402d02048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc62da5b2f1a4d97b48cf3379549fd4f'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:19.478856 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2ef69126-d2f3-4f26-aa19-ec1402d02048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc62da5b2f1a4d97b48cf3379549fd4f'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:19.479645 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2ef69126-d2f3-4f26-aa19-ec1402d02048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc62da5b2f1a4d97b48cf3379549fd4f'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:19.480251 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-2ef69126-d2f3-4f26-aa19-ec1402d02048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc62da5b2f1a4d97b48cf3379549fd4f'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:19.567433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1334/2687] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:10:19 2022] DELETE /identity/v3/users/fc62da5b2f1a4d97b48cf3379549fd4f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:10:19.572604 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff742f-79f7-48bf-a285-81ba1aea218b None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:19.573149 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff742f-79f7-48bf-a285-81ba1aea218b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:19.573248 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff742f-79f7-48bf-a285-81ba1aea218b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:19.594375 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-81ff742f-79f7-48bf-a285-81ba1aea218b None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:19.595703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-81ff742f-79f7-48bf-a285-81ba1aea218b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:19.660472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1354/2688] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:19.671145 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef69126-d2f3-4f26-aa19-ec1402d02048 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:19.672596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2ef69126-d2f3-4f26-aa19-ec1402d02048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:19.738039 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef69126-d2f3-4f26-aa19-ec1402d02048 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:19.744337 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75ff4c-6580-4748-9839-ab7a0e2605ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:19.745434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75ff4c-6580-4748-9839-ab7a0e2605ed service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:19.745717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75ff4c-6580-4748-9839-ab7a0e2605ed service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:19.745999 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75ff4c-6580-4748-9839-ab7a0e2605ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:19.757340 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75ff4c-6580-4748-9839-ab7a0e2605ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:19.758893 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75ff4c-6580-4748-9839-ab7a0e2605ed service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:19.769392 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1335/2689] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:20.516356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff742f-79f7-48bf-a285-81ba1aea218b None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:20.517798 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-81ff742f-79f7-48bf-a285-81ba1aea218b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:20.530108 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff742f-79f7-48bf-a285-81ba1aea218b None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:20.534814 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f73c6-a46b-4ead-9ae2-65e66b2cdc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:20.535465 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f73c6-a46b-4ead-9ae2-65e66b2cdc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:20.535749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f73c6-a46b-4ead-9ae2-65e66b2cdc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:20.536130 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f73c6-a46b-4ead-9ae2-65e66b2cdc18 admin admin] PATH_INFO: `/v3/projects/84060dff1bb14ff9b6a9a91f14cb5bd3` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:20.538085 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f73c6-a46b-4ead-9ae2-65e66b2cdc18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84060dff1bb14ff9b6a9a91f14cb5bd3)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:20.540050 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f73c6-a46b-4ead-9ae2-65e66b2cdc18 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:20.671291 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:20.680271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-896f73c6-a46b-4ead-9ae2-65e66b2cdc18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84060dff1bb14ff9b6a9a91f14cb5bd3', 'request_id': 'req-896f73c6-a46b-4ead-9ae2-65e66b2cdc18'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:20.687099 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-896f73c6-a46b-4ead-9ae2-65e66b2cdc18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84060dff1bb14ff9b6a9a91f14cb5bd3', 'request_id': 'req-896f73c6-a46b-4ead-9ae2-65e66b2cdc18'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:20.701894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-896f73c6-a46b-4ead-9ae2-65e66b2cdc18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84060dff1bb14ff9b6a9a91f14cb5bd3', 'request_id': 'req-896f73c6-a46b-4ead-9ae2-65e66b2cdc18'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:20.771970 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-896f73c6-a46b-4ead-9ae2-65e66b2cdc18 admin admin] The token cache is being invalidate because project 84060dff1bb14ff9b6a9a91f14cb5bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:10:20.772278 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-896f73c6-a46b-4ead-9ae2-65e66b2cdc18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:20.772910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-896f73c6-a46b-4ead-9ae2-65e66b2cdc18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:20.774489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1355/2690] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:10:20 2022] DELETE /identity/v3/projects/84060dff1bb14ff9b6a9a91f14cb5bd3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:20.778651 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75ff4c-6580-4748-9839-ab7a0e2605ed service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:20.788964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75ff4c-6580-4748-9839-ab7a0e2605ed service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:20.837621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:20.849482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d605d-cf3c-4934-b4c9-0f1b0a88c358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:20.849482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d605d-cf3c-4934-b4c9-0f1b0a88c358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:20.849482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d605d-cf3c-4934-b4c9-0f1b0a88c358 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:20.849482 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d605d-cf3c-4934-b4c9-0f1b0a88c358 admin admin] PATH_INFO: `/v3/users/ac97a73f739546b3be52b8c4d8bfdb36` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:20.849910 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d605d-cf3c-4934-b4c9-0f1b0a88c358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac97a73f739546b3be52b8c4d8bfdb36)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:20.851262 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d605d-cf3c-4934-b4c9-0f1b0a88c358 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:21.003076 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ca8d605d-cf3c-4934-b4c9-0f1b0a88c358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac97a73f739546b3be52b8c4d8bfdb36'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:21.010624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ca8d605d-cf3c-4934-b4c9-0f1b0a88c358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac97a73f739546b3be52b8c4d8bfdb36'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:21.022761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ca8d605d-cf3c-4934-b4c9-0f1b0a88c358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac97a73f739546b3be52b8c4d8bfdb36'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:21.023443 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ca8d605d-cf3c-4934-b4c9-0f1b0a88c358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac97a73f739546b3be52b8c4d8bfdb36'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:21.024046 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-ca8d605d-cf3c-4934-b4c9-0f1b0a88c358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac97a73f739546b3be52b8c4d8bfdb36'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:21.126458 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1336/2691] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:10:20 2022] DELETE /identity/v3/users/ac97a73f739546b3be52b8c4d8bfdb36 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:10:21.603103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f73c6-a46b-4ead-9ae2-65e66b2cdc18 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:21.604568 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-896f73c6-a46b-4ead-9ae2-65e66b2cdc18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:21.617897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f73c6-a46b-4ead-9ae2-65e66b2cdc18 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:21.683796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6318e-94d4-4b82-9a95-eb0682df4ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:21.684778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6318e-94d4-4b82-9a95-eb0682df4ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:21.685259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6318e-94d4-4b82-9a95-eb0682df4ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:21.685629 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6318e-94d4-4b82-9a95-eb0682df4ab1 admin admin] PATH_INFO: `/v3/projects/fee1c900bca14fc782e45295c3720acf` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:21.686926 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6318e-94d4-4b82-9a95-eb0682df4ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee1c900bca14fc782e45295c3720acf)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:21.688905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6318e-94d4-4b82-9a95-eb0682df4ab1 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:21.796250 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3db6318e-94d4-4b82-9a95-eb0682df4ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee1c900bca14fc782e45295c3720acf', 'request_id': 'req-3db6318e-94d4-4b82-9a95-eb0682df4ab1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:21.802480 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3db6318e-94d4-4b82-9a95-eb0682df4ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee1c900bca14fc782e45295c3720acf', 'request_id': 'req-3db6318e-94d4-4b82-9a95-eb0682df4ab1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:21.808152 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3db6318e-94d4-4b82-9a95-eb0682df4ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee1c900bca14fc782e45295c3720acf', 'request_id': 'req-3db6318e-94d4-4b82-9a95-eb0682df4ab1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:21.904453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3db6318e-94d4-4b82-9a95-eb0682df4ab1 admin admin] The token cache is being invalidate because project fee1c900bca14fc782e45295c3720acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:10:21.904741 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3db6318e-94d4-4b82-9a95-eb0682df4ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:21.905368 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3db6318e-94d4-4b82-9a95-eb0682df4ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:21.907022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1356/2692] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:10:21 2022] DELETE /identity/v3/projects/fee1c900bca14fc782e45295c3720acf => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:21.920385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e268af-06fa-46b8-8e30-03a0deb3c6c4 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:21.920385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e268af-06fa-46b8-8e30-03a0deb3c6c4 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:21.920385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e268af-06fa-46b8-8e30-03a0deb3c6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:21.933134 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-84e268af-06fa-46b8-8e30-03a0deb3c6c4 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:21.934365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-84e268af-06fa-46b8-8e30-03a0deb3c6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:22.000484 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1337/2693] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:22.013077 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9addf0-8207-49d0-9d8c-315f7ff90b11 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:22.013364 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9addf0-8207-49d0-9d8c-315f7ff90b11 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:22.013640 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9addf0-8207-49d0-9d8c-315f7ff90b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:22.034659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-2b9addf0-8207-49d0-9d8c-315f7ff90b11 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:22.035952 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2b9addf0-8207-49d0-9d8c-315f7ff90b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:22.044847 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1357/2694] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:22.049308 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e268af-06fa-46b8-8e30-03a0deb3c6c4 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:22.063685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e268af-06fa-46b8-8e30-03a0deb3c6c4 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:22.063685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a23ab3-c64c-48ed-b39b-8098e348e829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:22.064102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a23ab3-c64c-48ed-b39b-8098e348e829 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:22.064384 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a23ab3-c64c-48ed-b39b-8098e348e829 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:22.064658 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a23ab3-c64c-48ed-b39b-8098e348e829 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:22.065380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a23ab3-c64c-48ed-b39b-8098e348e829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:22.065688 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a23ab3-c64c-48ed-b39b-8098e348e829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:22.067311 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a23ab3-c64c-48ed-b39b-8098e348e829 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:22.079766 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1338/2695] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:22.084887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9addf0-8207-49d0-9d8c-315f7ff90b11 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:22.094952 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9addf0-8207-49d0-9d8c-315f7ff90b11 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:22.099658 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d79eb6-b977-4fa5-bd65-165a8b3dda26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:22.100272 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d79eb6-b977-4fa5-bd65-165a8b3dda26 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:22.100558 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d79eb6-b977-4fa5-bd65-165a8b3dda26 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:22.100843 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d79eb6-b977-4fa5-bd65-165a8b3dda26 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:22.101520 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d79eb6-b977-4fa5-bd65-165a8b3dda26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:22.103463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d79eb6-b977-4fa5-bd65-165a8b3dda26 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:22.180963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1358/2696] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:10:22 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:22.184997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a23ab3-c64c-48ed-b39b-8098e348e829 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:22.195690 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a23ab3-c64c-48ed-b39b-8098e348e829 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:22.253743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781ca40-f3a8-445f-a687-737aad0ceedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:22.254514 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781ca40-f3a8-445f-a687-737aad0ceedc admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:22.254802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781ca40-f3a8-445f-a687-737aad0ceedc admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:22.255079 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781ca40-f3a8-445f-a687-737aad0ceedc admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:22.255745 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c781ca40-f3a8-445f-a687-737aad0ceedc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:22.258224 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c781ca40-f3a8-445f-a687-737aad0ceedc admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:22.266247 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:22.310595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1339/2697] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:10:22 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:22.315005 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d79eb6-b977-4fa5-bd65-165a8b3dda26 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:22.326219 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d79eb6-b977-4fa5-bd65-165a8b3dda26 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:22.330887 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e03314-1e7a-4948-8626-df7e8387bbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:22.331495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e03314-1e7a-4948-8626-df7e8387bbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:22.331782 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e03314-1e7a-4948-8626-df7e8387bbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:22.332059 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e03314-1e7a-4948-8626-df7e8387bbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:22.332754 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e03314-1e7a-4948-8626-df7e8387bbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:22.334489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e03314-1e7a-4948-8626-df7e8387bbb0 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:22.344543 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1359/2698] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:10:22.348598 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781ca40-f3a8-445f-a687-737aad0ceedc admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:22.359027 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781ca40-f3a8-445f-a687-737aad0ceedc admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:22.363523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c39d5c-08b7-4e3b-a0ca-6330153aaef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:22.364122 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c39d5c-08b7-4e3b-a0ca-6330153aaef4 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:22.364403 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c39d5c-08b7-4e3b-a0ca-6330153aaef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:22.364682 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c39d5c-08b7-4e3b-a0ca-6330153aaef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:22.365870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c39d5c-08b7-4e3b-a0ca-6330153aaef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:22.367480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c39d5c-08b7-4e3b-a0ca-6330153aaef4 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:22.378122 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1340/2699] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:10:22.382902 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e03314-1e7a-4948-8626-df7e8387bbb0 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:22.392715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e03314-1e7a-4948-8626-df7e8387bbb0 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:22.397321 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cdf61-c900-46b0-88a3-2ce9cb2834bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:22.397974 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cdf61-c900-46b0-88a3-2ce9cb2834bf admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:22.398256 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cdf61-c900-46b0-88a3-2ce9cb2834bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:22.398565 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cdf61-c900-46b0-88a3-2ce9cb2834bf admin admin] PATH_INFO: `/v3/projects/5c5265cae6e54156bbb38b8b08055bcc/users/094892da79824808b585281340054b62/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:22.411146 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:22.414381 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4cdf61-c900-46b0-88a3-2ce9cb2834bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c5265cae6e54156bbb38b8b08055bcc, user_id=094892da79824808b585281340054b62, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:22.417068 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4cdf61-c900-46b0-88a3-2ce9cb2834bf admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:22.498182 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1360/2700] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:10:22 2022] PUT /identity/v3/projects/5c5265cae6e54156bbb38b8b08055bcc/users/094892da79824808b585281340054b62/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:22.509930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de09481-4ed7-4c7c-b2dd-b0fbfead0542 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:22.510218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de09481-4ed7-4c7c-b2dd-b0fbfead0542 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:22.510527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de09481-4ed7-4c7c-b2dd-b0fbfead0542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:22.538219 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-7de09481-4ed7-4c7c-b2dd-b0fbfead0542 None None] MFA Rules not processed for user `094892da79824808b585281340054b62`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:22.539446 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-7de09481-4ed7-4c7c-b2dd-b0fbfead0542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:22.603477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1341/2701] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:22.614923 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cdf61-c900-46b0-88a3-2ce9cb2834bf admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:22.617425 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0a4cdf61-c900-46b0-88a3-2ce9cb2834bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:22.677107 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cdf61-c900-46b0-88a3-2ce9cb2834bf admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:22.681626 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213d2a0-285c-4972-8662-f125eece9b64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:22.682479 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213d2a0-285c-4972-8662-f125eece9b64 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:22.682796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213d2a0-285c-4972-8662-f125eece9b64 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:22.683072 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213d2a0-285c-4972-8662-f125eece9b64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:22.692244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213d2a0-285c-4972-8662-f125eece9b64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:22.693730 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213d2a0-285c-4972-8662-f125eece9b64 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:22.703020 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1361/2702] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:26.512164 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de09481-4ed7-4c7c-b2dd-b0fbfead0542 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:26.513656 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-7de09481-4ed7-4c7c-b2dd-b0fbfead0542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:26.592737 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de09481-4ed7-4c7c-b2dd-b0fbfead0542 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:26.598926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f65ec-48cb-44a4-a8ef-3de4798bc388 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:26.599590 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f65ec-48cb-44a4-a8ef-3de4798bc388 service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:26.599940 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f65ec-48cb-44a4-a8ef-3de4798bc388 service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:26.600218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f65ec-48cb-44a4-a8ef-3de4798bc388 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:26.602650 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-467f65ec-48cb-44a4-a8ef-3de4798bc388 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:26.624242 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f65ec-48cb-44a4-a8ef-3de4798bc388 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:26.625818 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f65ec-48cb-44a4-a8ef-3de4798bc388 service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:26.636775 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1342/2703] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:31.280731 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349a9d6-86a8-4112-abe0-246fd36325b2 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:31.281351 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349a9d6-86a8-4112-abe0-246fd36325b2 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:31.281469 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349a9d6-86a8-4112-abe0-246fd36325b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:31.344965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-4349a9d6-86a8-4112-abe0-246fd36325b2 None None] MFA Rules not processed for user `0834be7405cd4c968763099251d37154`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:31.346649 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-4349a9d6-86a8-4112-abe0-246fd36325b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:31.419082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1362/2704] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jul 26 15:10:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:31.696061 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f65ec-48cb-44a4-a8ef-3de4798bc388 service nova] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:31.697484 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-467f65ec-48cb-44a4-a8ef-3de4798bc388 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:31.753898 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:31.793478 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f65ec-48cb-44a4-a8ef-3de4798bc388 service nova] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:31.798835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43ae53-b284-49e6-8dcb-5d93ed356dcc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '462ecbb85c6b4a17a952fb74fa2de65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:31.799587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43ae53-b284-49e6-8dcb-5d93ed356dcc service swift] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:31.799879 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43ae53-b284-49e6-8dcb-5d93ed356dcc service swift] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:31.800161 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43ae53-b284-49e6-8dcb-5d93ed356dcc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:31.809567 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43ae53-b284-49e6-8dcb-5d93ed356dcc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:31.811339 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43ae53-b284-49e6-8dcb-5d93ed356dcc service swift] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:31.819781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1343/2705] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jul 26 15:10:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 15:10:41.415766 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=69,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:41.978565 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=17 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:43.841283 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349a9d6-86a8-4112-abe0-246fd36325b2 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:43.947697 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349a9d6-86a8-4112-abe0-246fd36325b2 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:43.955651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca81bf-2219-4e2d-91f0-0e6c121b1d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:43.957207 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca81bf-2219-4e2d-91f0-0e6c121b1d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:43.957758 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca81bf-2219-4e2d-91f0-0e6c121b1d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:43.958423 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca81bf-2219-4e2d-91f0-0e6c121b1d63 admin admin] PATH_INFO: `/v3/users/094892da79824808b585281340054b62` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:43.960226 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca81bf-2219-4e2d-91f0-0e6c121b1d63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=094892da79824808b585281340054b62)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:43.962193 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca81bf-2219-4e2d-91f0-0e6c121b1d63 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:44.167541 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-0dca81bf-2219-4e2d-91f0-0e6c121b1d63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094892da79824808b585281340054b62'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:44.168445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-0dca81bf-2219-4e2d-91f0-0e6c121b1d63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094892da79824808b585281340054b62'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:44.186555 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-0dca81bf-2219-4e2d-91f0-0e6c121b1d63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094892da79824808b585281340054b62'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:44.287249 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-0dca81bf-2219-4e2d-91f0-0e6c121b1d63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094892da79824808b585281340054b62'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:44.289039 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-0dca81bf-2219-4e2d-91f0-0e6c121b1d63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094892da79824808b585281340054b62'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:44.309934 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1363/2706] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:10:43 2022] DELETE /identity/v3/users/094892da79824808b585281340054b62 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:44.315737 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8439fb-ed50-4077-8ba0-957b26d0a69f None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:44.317126 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8439fb-ed50-4077-8ba0-957b26d0a69f None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:44.317804 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8439fb-ed50-4077-8ba0-957b26d0a69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:44.347959 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-fc8439fb-ed50-4077-8ba0-957b26d0a69f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:44.349515 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-fc8439fb-ed50-4077-8ba0-957b26d0a69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:44.422050 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1344/2707] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:44.432697 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca81bf-2219-4e2d-91f0-0e6c121b1d63 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:44.434794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0dca81bf-2219-4e2d-91f0-0e6c121b1d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:44.500788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca81bf-2219-4e2d-91f0-0e6c121b1d63 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:44.504701 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf36e7-b4a2-4d1f-8656-921754325fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:44.505823 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf36e7-b4a2-4d1f-8656-921754325fde service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:44.506131 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf36e7-b4a2-4d1f-8656-921754325fde service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:44.506720 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf36e7-b4a2-4d1f-8656-921754325fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:44.517606 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf36e7-b4a2-4d1f-8656-921754325fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:44.519109 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf36e7-b4a2-4d1f-8656-921754325fde service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:44.540223 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1364/2708] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:45.236847 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8439fb-ed50-4077-8ba0-957b26d0a69f None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:45.238259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-fc8439fb-ed50-4077-8ba0-957b26d0a69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:45.252962 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8439fb-ed50-4077-8ba0-957b26d0a69f None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:45.259077 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc1790-30b0-4899-b149-4975677397c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:45.259741 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc1790-30b0-4899-b149-4975677397c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:45.260026 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc1790-30b0-4899-b149-4975677397c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:45.260308 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc1790-30b0-4899-b149-4975677397c4 admin admin] PATH_INFO: `/v3/projects/5c5265cae6e54156bbb38b8b08055bcc` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:45.261518 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc1790-30b0-4899-b149-4975677397c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c5265cae6e54156bbb38b8b08055bcc)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:45.276500 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc1790-30b0-4899-b149-4975677397c4 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:45.404309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-89bc1790-30b0-4899-b149-4975677397c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c5265cae6e54156bbb38b8b08055bcc', 'request_id': 'req-89bc1790-30b0-4899-b149-4975677397c4'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:45.412787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-89bc1790-30b0-4899-b149-4975677397c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c5265cae6e54156bbb38b8b08055bcc', 'request_id': 'req-89bc1790-30b0-4899-b149-4975677397c4'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:45.481350 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-89bc1790-30b0-4899-b149-4975677397c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c5265cae6e54156bbb38b8b08055bcc', 'request_id': 'req-89bc1790-30b0-4899-b149-4975677397c4'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:45.496359 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-89bc1790-30b0-4899-b149-4975677397c4 admin admin] The token cache is being invalidate because project 5c5265cae6e54156bbb38b8b08055bcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:10:45.496733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-89bc1790-30b0-4899-b149-4975677397c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:45.497466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-89bc1790-30b0-4899-b149-4975677397c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:45.500045 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1345/2709] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:10:45 2022] DELETE /identity/v3/projects/5c5265cae6e54156bbb38b8b08055bcc => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:45.505830 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc8fca-244b-40f4-ab94-025e84e45b57 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:45.506363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc8fca-244b-40f4-ab94-025e84e45b57 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:45.506693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc8fca-244b-40f4-ab94-025e84e45b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:45.564483 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-1bcc8fca-244b-40f4-ab94-025e84e45b57 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:45.567699 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-1bcc8fca-244b-40f4-ab94-025e84e45b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:45.590985 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:45.656967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1365/2710] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:45.658964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfee2e-c3ca-4423-9725-0d9b154f3f58 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:45.659278 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfee2e-c3ca-4423-9725-0d9b154f3f58 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:45.659569 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfee2e-c3ca-4423-9725-0d9b154f3f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:45.723039 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-b9cfee2e-c3ca-4423-9725-0d9b154f3f58 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:45.724837 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b9cfee2e-c3ca-4423-9725-0d9b154f3f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:45.743011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1346/2711] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:45.745591 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc8fca-244b-40f4-ab94-025e84e45b57 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:45.764614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc8fca-244b-40f4-ab94-025e84e45b57 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:45.770844 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c68828-0b9f-47b5-bdef-fb7c71e3f034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:45.771491 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c68828-0b9f-47b5-bdef-fb7c71e3f034 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:45.771780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c68828-0b9f-47b5-bdef-fb7c71e3f034 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:45.772060 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c68828-0b9f-47b5-bdef-fb7c71e3f034 admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:45.773574 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c68828-0b9f-47b5-bdef-fb7c71e3f034 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:45.774218 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c68828-0b9f-47b5-bdef-fb7c71e3f034 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:45.776627 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c68828-0b9f-47b5-bdef-fb7c71e3f034 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:45.803049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1366/2712] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:45.805327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfee2e-c3ca-4423-9725-0d9b154f3f58 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:45.821119 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfee2e-c3ca-4423-9725-0d9b154f3f58 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:45.826946 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e21c22-10f9-43a3-ba09-a1925619051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:45.827636 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21c22-10f9-43a3-ba09-a1925619051c admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:45.827869 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21c22-10f9-43a3-ba09-a1925619051c admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:45.828142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21c22-10f9-43a3-ba09-a1925619051c admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:45.828813 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e21c22-10f9-43a3-ba09-a1925619051c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:45.830747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e21c22-10f9-43a3-ba09-a1925619051c admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:45.923462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c68828-0b9f-47b5-bdef-fb7c71e3f034 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:45.923715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1347/2713] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:10:45 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:45.935221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c68828-0b9f-47b5-bdef-fb7c71e3f034 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:46.021399 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76200302-637c-4862-a2fd-0b14272fc742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:46.022474 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76200302-637c-4862-a2fd-0b14272fc742 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.023226 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76200302-637c-4862-a2fd-0b14272fc742 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.023406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76200302-637c-4862-a2fd-0b14272fc742 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.024672 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76200302-637c-4862-a2fd-0b14272fc742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:46.025943 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76200302-637c-4862-a2fd-0b14272fc742 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:46.135975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1367/2714] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:10:45 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:46.136363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e21c22-10f9-43a3-ba09-a1925619051c admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:46.145428 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e21c22-10f9-43a3-ba09-a1925619051c admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:46.150342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907a345-4d20-4f91-a826-3f5a0f7d888d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:46.151009 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907a345-4d20-4f91-a826-3f5a0f7d888d admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.151289 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907a345-4d20-4f91-a826-3f5a0f7d888d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.151564 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907a345-4d20-4f91-a826-3f5a0f7d888d admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.152366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907a345-4d20-4f91-a826-3f5a0f7d888d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:46.154212 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907a345-4d20-4f91-a826-3f5a0f7d888d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:46.166441 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1348/2715] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:10:46.170743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76200302-637c-4862-a2fd-0b14272fc742 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:46.183544 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76200302-637c-4862-a2fd-0b14272fc742 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:46.188701 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54a747-687e-443f-846d-e83226407a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:46.189570 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54a747-687e-443f-846d-e83226407a30 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.189690 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54a747-687e-443f-846d-e83226407a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.189974 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54a747-687e-443f-846d-e83226407a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.200714 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54a747-687e-443f-846d-e83226407a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:46.200714 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54a747-687e-443f-846d-e83226407a30 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:46.209635 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1368/2716] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:10:46.211581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907a345-4d20-4f91-a826-3f5a0f7d888d admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:46.223747 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907a345-4d20-4f91-a826-3f5a0f7d888d admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:46.230238 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93581fd0-1c53-4585-bdbd-f1f30c7ed488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:46.231106 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93581fd0-1c53-4585-bdbd-f1f30c7ed488 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.231495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93581fd0-1c53-4585-bdbd-f1f30c7ed488 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.231743 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93581fd0-1c53-4585-bdbd-f1f30c7ed488 admin admin] PATH_INFO: `/v3/projects/2452044b93ed4f318b87cb0e8d7769b0/users/b1346652b3914684b0c47d0fc6572f70/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.249902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93581fd0-1c53-4585-bdbd-f1f30c7ed488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2452044b93ed4f318b87cb0e8d7769b0, user_id=b1346652b3914684b0c47d0fc6572f70, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:46.253663 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93581fd0-1c53-4585-bdbd-f1f30c7ed488 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:46.321880 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1349/2717] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:10:46 2022] PUT /identity/v3/projects/2452044b93ed4f318b87cb0e8d7769b0/users/b1346652b3914684b0c47d0fc6572f70/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:46.333033 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1127c9-0787-400d-9e06-aa0d8e735802 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.333321 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1127c9-0787-400d-9e06-aa0d8e735802 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.333644 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1127c9-0787-400d-9e06-aa0d8e735802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.367377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-1d1127c9-0787-400d-9e06-aa0d8e735802 None None] MFA Rules not processed for user `b1346652b3914684b0c47d0fc6572f70`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:46.368642 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-1d1127c9-0787-400d-9e06-aa0d8e735802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:46.456755 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1369/2718] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:46.461515 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93581fd0-1c53-4585-bdbd-f1f30c7ed488 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:46.485317 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:46.532153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93581fd0-1c53-4585-bdbd-f1f30c7ed488 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:46.537512 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514558e3-7e09-45f7-940b-351091d3c079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:46.539855 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514558e3-7e09-45f7-940b-351091d3c079 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.539855 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514558e3-7e09-45f7-940b-351091d3c079 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.539855 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514558e3-7e09-45f7-940b-351091d3c079 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.540841 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514558e3-7e09-45f7-940b-351091d3c079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:46.543565 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514558e3-7e09-45f7-940b-351091d3c079 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:46.654442 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1350/2719] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:10:46 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:10:46.655660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1127c9-0787-400d-9e06-aa0d8e735802 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:46.676700 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1127c9-0787-400d-9e06-aa0d8e735802 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:46.696741 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:46.746621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125f34e-9688-4d33-bfef-a0b86ac54a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:46.747656 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125f34e-9688-4d33-bfef-a0b86ac54a0a admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.748177 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125f34e-9688-4d33-bfef-a0b86ac54a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.748525 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125f34e-9688-4d33-bfef-a0b86ac54a0a admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.749276 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125f34e-9688-4d33-bfef-a0b86ac54a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:46.751495 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125f34e-9688-4d33-bfef-a0b86ac54a0a admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:46.819651 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1370/2720] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:10:46 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:46.823519 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514558e3-7e09-45f7-940b-351091d3c079 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:46.835901 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514558e3-7e09-45f7-940b-351091d3c079 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:46.843854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a4885-8bf5-4a43-be82-f2bc883c9f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:46.844527 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a4885-8bf5-4a43-be82-f2bc883c9f10 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.844814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a4885-8bf5-4a43-be82-f2bc883c9f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.845096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a4885-8bf5-4a43-be82-f2bc883c9f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.845864 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a4885-8bf5-4a43-be82-f2bc883c9f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:46.847533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a4885-8bf5-4a43-be82-f2bc883c9f10 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:46.860642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1351/2721] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:10:46.863685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125f34e-9688-4d33-bfef-a0b86ac54a0a admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:46.875864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125f34e-9688-4d33-bfef-a0b86ac54a0a admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:46.886159 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f5d4d-fc1b-439c-b6c9-b55b9356765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:46.886837 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f5d4d-fc1b-439c-b6c9-b55b9356765e admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.887126 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f5d4d-fc1b-439c-b6c9-b55b9356765e admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.887409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f5d4d-fc1b-439c-b6c9-b55b9356765e admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.888161 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f5d4d-fc1b-439c-b6c9-b55b9356765e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:46.889879 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f5d4d-fc1b-439c-b6c9-b55b9356765e admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:46.904727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1371/2722] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:10:46.905996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a4885-8bf5-4a43-be82-f2bc883c9f10 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:46.921463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a4885-8bf5-4a43-be82-f2bc883c9f10 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:46.926752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37f61e-271b-41e2-8a27-4e057258a57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:46.927444 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37f61e-271b-41e2-8a27-4e057258a57a admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.927724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37f61e-271b-41e2-8a27-4e057258a57a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.927998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37f61e-271b-41e2-8a27-4e057258a57a admin admin] PATH_INFO: `/v3/projects/4765f4fd33b142c59d18edeec1856a45/users/345fc1f6961446539502b584a1db1095/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.950677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37f61e-271b-41e2-8a27-4e057258a57a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4765f4fd33b142c59d18edeec1856a45, user_id=345fc1f6961446539502b584a1db1095, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:46.953642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37f61e-271b-41e2-8a27-4e057258a57a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:47.032947 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1352/2723] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:10:46 2022] PUT /identity/v3/projects/4765f4fd33b142c59d18edeec1856a45/users/345fc1f6961446539502b584a1db1095/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:47.034262 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920769d-bbe8-4679-a7b7-7e57f1e1ce79 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:47.034590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920769d-bbe8-4679-a7b7-7e57f1e1ce79 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:47.034876 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920769d-bbe8-4679-a7b7-7e57f1e1ce79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:47.071566 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-e920769d-bbe8-4679-a7b7-7e57f1e1ce79 None None] MFA Rules not processed for user `345fc1f6961446539502b584a1db1095`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:47.072830 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e920769d-bbe8-4679-a7b7-7e57f1e1ce79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:47.159204 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1372/2724] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:47.164003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37f61e-271b-41e2-8a27-4e057258a57a admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:47.252898 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37f61e-271b-41e2-8a27-4e057258a57a admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:47.260249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e1033-df02-415d-830e-2f5510cdccbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:47.261228 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e1033-df02-415d-830e-2f5510cdccbe admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:47.261855 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e1033-df02-415d-830e-2f5510cdccbe admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:47.262481 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e1033-df02-415d-830e-2f5510cdccbe admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:47.263329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e1033-df02-415d-830e-2f5510cdccbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:47.265267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e1033-df02-415d-830e-2f5510cdccbe admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:47.358405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1353/2725] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:10:47 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:47.362844 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920769d-bbe8-4679-a7b7-7e57f1e1ce79 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:47.374913 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920769d-bbe8-4679-a7b7-7e57f1e1ce79 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:47.441746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bf13b-7477-497e-8b56-0003ddb2e1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:47.442287 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bf13b-7477-497e-8b56-0003ddb2e1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:47.442600 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bf13b-7477-497e-8b56-0003ddb2e1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:47.442876 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bf13b-7477-497e-8b56-0003ddb2e1c3 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:47.443555 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bf13b-7477-497e-8b56-0003ddb2e1c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:47.445707 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bf13b-7477-497e-8b56-0003ddb2e1c3 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:47.567285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1373/2726] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:10:47 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:10:47.572247 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e1033-df02-415d-830e-2f5510cdccbe admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:47.584119 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e1033-df02-415d-830e-2f5510cdccbe admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:47.591143 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151d6b1-f118-4d09-b194-df5959d68571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:47.592153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151d6b1-f118-4d09-b194-df5959d68571 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:47.592435 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151d6b1-f118-4d09-b194-df5959d68571 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:47.592709 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151d6b1-f118-4d09-b194-df5959d68571 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:47.593489 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151d6b1-f118-4d09-b194-df5959d68571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:47.595132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151d6b1-f118-4d09-b194-df5959d68571 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:47.611348 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bf13b-7477-497e-8b56-0003ddb2e1c3 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:47.617316 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1354/2727] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:10:47.622951 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bf13b-7477-497e-8b56-0003ddb2e1c3 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:47.629479 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886fb3a-6098-4089-8bc4-eb807da896e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:47.629479 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886fb3a-6098-4089-8bc4-eb807da896e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:47.629749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886fb3a-6098-4089-8bc4-eb807da896e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:47.630214 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886fb3a-6098-4089-8bc4-eb807da896e9 admin admin] PATH_INFO: `/v3/projects/87a3e0b9eea34b51b778464cde22e4b5/users/eb16412527cc41e08af9d9206240de1a/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:47.644762 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:47.648108 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886fb3a-6098-4089-8bc4-eb807da896e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a3e0b9eea34b51b778464cde22e4b5, user_id=eb16412527cc41e08af9d9206240de1a, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:47.651137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886fb3a-6098-4089-8bc4-eb807da896e9 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:47.764886 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1374/2728] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:10:47 2022] PUT /identity/v3/projects/87a3e0b9eea34b51b778464cde22e4b5/users/eb16412527cc41e08af9d9206240de1a/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:10:47.770761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151d6b1-f118-4d09-b194-df5959d68571 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:47.783825 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151d6b1-f118-4d09-b194-df5959d68571 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:47.835413 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:47.851864 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd90ae-337a-4da0-a4ce-d9356d5d118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:47.852791 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd90ae-337a-4da0-a4ce-d9356d5d118d admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:47.853084 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd90ae-337a-4da0-a4ce-d9356d5d118d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:47.853381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd90ae-337a-4da0-a4ce-d9356d5d118d admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:47.854192 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd90ae-337a-4da0-a4ce-d9356d5d118d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:47.856192 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd90ae-337a-4da0-a4ce-d9356d5d118d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:47.868565 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1355/2729] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:10:47.872853 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886fb3a-6098-4089-8bc4-eb807da896e9 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:47.887693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886fb3a-6098-4089-8bc4-eb807da896e9 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:47.892752 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ef0d6-11c8-4955-a670-51bf53c55e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:47.893461 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ef0d6-11c8-4955-a670-51bf53c55e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:47.903998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ef0d6-11c8-4955-a670-51bf53c55e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:47.903998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ef0d6-11c8-4955-a670-51bf53c55e8e admin admin] PATH_INFO: `/v3/projects/87a3e0b9eea34b51b778464cde22e4b5/users/eb16412527cc41e08af9d9206240de1a/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:47.903998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ef0d6-11c8-4955-a670-51bf53c55e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a3e0b9eea34b51b778464cde22e4b5, user_id=eb16412527cc41e08af9d9206240de1a, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:47.903998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ef0d6-11c8-4955-a670-51bf53c55e8e admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:47.913788 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1375/2730] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:10:47 2022] PUT /identity/v3/projects/87a3e0b9eea34b51b778464cde22e4b5/users/eb16412527cc41e08af9d9206240de1a/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:10:47.925742 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3c2d9-0be3-44d2-b4ab-b5797ae2a3f2 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:47.926049 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3c2d9-0be3-44d2-b4ab-b5797ae2a3f2 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:47.926297 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3c2d9-0be3-44d2-b4ab-b5797ae2a3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:47.960020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-16b3c2d9-0be3-44d2-b4ab-b5797ae2a3f2 None None] MFA Rules not processed for user `eb16412527cc41e08af9d9206240de1a`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:47.961178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-16b3c2d9-0be3-44d2-b4ab-b5797ae2a3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:48.046341 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1356/2731] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:48.059871 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ef0d6-11c8-4955-a670-51bf53c55e8e admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:48.061618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-163ef0d6-11c8-4955-a670-51bf53c55e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:48.134340 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ef0d6-11c8-4955-a670-51bf53c55e8e admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:48.139042 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68ac1e-70a2-4c31-a879-aed1b6c17565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:48.139733 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68ac1e-70a2-4c31-a879-aed1b6c17565 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:48.140694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68ac1e-70a2-4c31-a879-aed1b6c17565 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:48.141014 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68ac1e-70a2-4c31-a879-aed1b6c17565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:48.219666 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68ac1e-70a2-4c31-a879-aed1b6c17565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:48.221369 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68ac1e-70a2-4c31-a879-aed1b6c17565 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:48.234312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1376/2732] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:48.478061 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3c2d9-0be3-44d2-b4ab-b5797ae2a3f2 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:48.479800 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-16b3c2d9-0be3-44d2-b4ab-b5797ae2a3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:48.555395 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3c2d9-0be3-44d2-b4ab-b5797ae2a3f2 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:48.559844 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b14c15-d8d8-4641-acac-c30bff2a0724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:48.562784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b14c15-d8d8-4641-acac-c30bff2a0724 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:48.562784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b14c15-d8d8-4641-acac-c30bff2a0724 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:48.562784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b14c15-d8d8-4641-acac-c30bff2a0724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:48.563172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-74b14c15-d8d8-4641-acac-c30bff2a0724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:48.650809 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b14c15-d8d8-4641-acac-c30bff2a0724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:48.653170 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b14c15-d8d8-4641-acac-c30bff2a0724 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:48.669275 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1357/2733] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:50.935516 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5c5f0-2c2b-48ce-8bdd-bf16a88c5d58 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:50.935988 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5c5f0-2c2b-48ce-8bdd-bf16a88c5d58 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:50.936090 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5c5f0-2c2b-48ce-8bdd-bf16a88c5d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:50.962990 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-5fd5c5f0-2c2b-48ce-8bdd-bf16a88c5d58 None None] MFA Rules not processed for user `0834be7405cd4c968763099251d37154`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:50.964844 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5fd5c5f0-2c2b-48ce-8bdd-bf16a88c5d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:51.038886 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1377/2734] 10.222.0.86 () {58 vars in 967 bytes} [Tue Jul 26 15:10:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:51.051757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b14c15-d8d8-4641-acac-c30bff2a0724 service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:51.053165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-74b14c15-d8d8-4641-acac-c30bff2a0724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:51.072288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:51.138855 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b14c15-d8d8-4641-acac-c30bff2a0724 service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:51.143776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3347445-de11-40f3-8816-c2b11a3331a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '462ecbb85c6b4a17a952fb74fa2de65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:51.144415 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3347445-de11-40f3-8816-c2b11a3331a6 service swift] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:51.144705 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3347445-de11-40f3-8816-c2b11a3331a6 service swift] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:51.144985 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3347445-de11-40f3-8816-c2b11a3331a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:51.158221 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3347445-de11-40f3-8816-c2b11a3331a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:51.159859 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3347445-de11-40f3-8816-c2b11a3331a6 service swift] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:51.168936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1358/2735] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jul 26 15:10:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:10:51.230732 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5c5f0-2c2b-48ce-8bdd-bf16a88c5d58 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:51.240338 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5c5f0-2c2b-48ce-8bdd-bf16a88c5d58 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:51.244090 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee398fe-cfd5-4f50-96e9-e2939d8c0abd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:51.244713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee398fe-cfd5-4f50-96e9-e2939d8c0abd service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:51.245002 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee398fe-cfd5-4f50-96e9-e2939d8c0abd service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:51.245285 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee398fe-cfd5-4f50-96e9-e2939d8c0abd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:51.286990 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:51.313743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee398fe-cfd5-4f50-96e9-e2939d8c0abd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:51.315249 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee398fe-cfd5-4f50-96e9-e2939d8c0abd service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:51.325827 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1378/2736] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:52.464660 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3347445-de11-40f3-8816-c2b11a3331a6 service swift] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:52.466141 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d3347445-de11-40f3-8816-c2b11a3331a6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:52.481127 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3347445-de11-40f3-8816-c2b11a3331a6 service swift] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:52.485567 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c4f30-65b4-4610-95ec-440ebf13d52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:52.486279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c4f30-65b4-4610-95ec-440ebf13d52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:52.489899 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c4f30-65b4-4610-95ec-440ebf13d52f admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:52.489899 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c4f30-65b4-4610-95ec-440ebf13d52f admin admin] PATH_INFO: `/v3/users/d7dbcd204d864ad6914aca2c3594089c` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:52.489899 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c4f30-65b4-4610-95ec-440ebf13d52f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7dbcd204d864ad6914aca2c3594089c)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:52.489899 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c4f30-65b4-4610-95ec-440ebf13d52f admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:52.689353 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-065c4f30-65b4-4610-95ec-440ebf13d52f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7dbcd204d864ad6914aca2c3594089c'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:52.696309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-065c4f30-65b4-4610-95ec-440ebf13d52f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7dbcd204d864ad6914aca2c3594089c'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:52.709050 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-065c4f30-65b4-4610-95ec-440ebf13d52f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7dbcd204d864ad6914aca2c3594089c'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:52.709762 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-065c4f30-65b4-4610-95ec-440ebf13d52f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7dbcd204d864ad6914aca2c3594089c'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:52.710372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-065c4f30-65b4-4610-95ec-440ebf13d52f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7dbcd204d864ad6914aca2c3594089c'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:52.801247 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1359/2737] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:10:52 2022] DELETE /identity/v3/users/d7dbcd204d864ad6914aca2c3594089c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:52.923302 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee398fe-cfd5-4f50-96e9-e2939d8c0abd service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:52.933000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee398fe-cfd5-4f50-96e9-e2939d8c0abd service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:53.088019 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c4f30-65b4-4610-95ec-440ebf13d52f admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:53.089721 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-065c4f30-65b4-4610-95ec-440ebf13d52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:53.119713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd424c-4237-4a87-9fae-614ab7b8d024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:53.120460 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd424c-4237-4a87-9fae-614ab7b8d024 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:53.120749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd424c-4237-4a87-9fae-614ab7b8d024 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:53.121026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd424c-4237-4a87-9fae-614ab7b8d024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:53.122893 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-aafd424c-4237-4a87-9fae-614ab7b8d024 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:53.159794 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c4f30-65b4-4610-95ec-440ebf13d52f admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:53.165706 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127fd0c-8604-4612-8dc5-f34f5a42e430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:53.166363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127fd0c-8604-4612-8dc5-f34f5a42e430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:53.166685 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127fd0c-8604-4612-8dc5-f34f5a42e430 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:53.166967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127fd0c-8604-4612-8dc5-f34f5a42e430 admin admin] PATH_INFO: `/v3/projects/b20b53372fcf41fbb43b3e494f8c187d` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:53.168147 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127fd0c-8604-4612-8dc5-f34f5a42e430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b20b53372fcf41fbb43b3e494f8c187d)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:53.170295 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127fd0c-8604-4612-8dc5-f34f5a42e430 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:53.192406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd424c-4237-4a87-9fae-614ab7b8d024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:53.193977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:53.194156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd424c-4237-4a87-9fae-614ab7b8d024 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:53.204045 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1379/2738] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:52 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:53.254170 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0127fd0c-8604-4612-8dc5-f34f5a42e430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b20b53372fcf41fbb43b3e494f8c187d', 'request_id': 'req-0127fd0c-8604-4612-8dc5-f34f5a42e430'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:53.260833 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0127fd0c-8604-4612-8dc5-f34f5a42e430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b20b53372fcf41fbb43b3e494f8c187d', 'request_id': 'req-0127fd0c-8604-4612-8dc5-f34f5a42e430'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:53.315286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0127fd0c-8604-4612-8dc5-f34f5a42e430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b20b53372fcf41fbb43b3e494f8c187d', 'request_id': 'req-0127fd0c-8604-4612-8dc5-f34f5a42e430'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:53.326646 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0127fd0c-8604-4612-8dc5-f34f5a42e430 admin admin] The token cache is being invalidate because project b20b53372fcf41fbb43b3e494f8c187d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:10:53.326936 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0127fd0c-8604-4612-8dc5-f34f5a42e430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:53.327556 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-0127fd0c-8604-4612-8dc5-f34f5a42e430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:53.329082 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1360/2739] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:10:53 2022] DELETE /identity/v3/projects/b20b53372fcf41fbb43b3e494f8c187d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:10:53.334084 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f137a-139f-4502-ad4d-de87448c7284 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:53.334379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f137a-139f-4502-ad4d-de87448c7284 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:53.334691 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f137a-139f-4502-ad4d-de87448c7284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:53.355167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-5c2f137a-139f-4502-ad4d-de87448c7284 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:53.356367 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5c2f137a-139f-4502-ad4d-de87448c7284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:53.417827 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1380/2740] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:53.426238 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0f502-50c2-4a4a-80a6-f688dd769cc9 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:53.426601 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0f502-50c2-4a4a-80a6-f688dd769cc9 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:53.426854 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0f502-50c2-4a4a-80a6-f688dd769cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:53.447513 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-7cd0f502-50c2-4a4a-80a6-f688dd769cc9 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:53.448797 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-7cd0f502-50c2-4a4a-80a6-f688dd769cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:53.457205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1361/2741] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:53.461542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f137a-139f-4502-ad4d-de87448c7284 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:53.471346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f137a-139f-4502-ad4d-de87448c7284 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:53.476484 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8ed21-4e6d-4008-a093-8201b671af0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:53.477136 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8ed21-4e6d-4008-a093-8201b671af0e admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:53.477410 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8ed21-4e6d-4008-a093-8201b671af0e admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:53.477693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8ed21-4e6d-4008-a093-8201b671af0e admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:53.478419 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8ed21-4e6d-4008-a093-8201b671af0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:53.478727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8ed21-4e6d-4008-a093-8201b671af0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:53.480414 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8ed21-4e6d-4008-a093-8201b671af0e admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:53.492587 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1381/2742] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:53.497330 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0f502-50c2-4a4a-80a6-f688dd769cc9 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:53.506923 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0f502-50c2-4a4a-80a6-f688dd769cc9 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:53.511752 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d798ce-f868-4842-9485-cf71d73835af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:53.512365 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d798ce-f868-4842-9485-cf71d73835af admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:53.512648 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d798ce-f868-4842-9485-cf71d73835af admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:53.512923 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d798ce-f868-4842-9485-cf71d73835af admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:53.513590 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d798ce-f868-4842-9485-cf71d73835af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:53.515554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d798ce-f868-4842-9485-cf71d73835af admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:53.585417 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1362/2743] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:10:53 2022] POST /identity/v3/projects => generated 365 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:53.589097 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8ed21-4e6d-4008-a093-8201b671af0e admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:53.598952 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8ed21-4e6d-4008-a093-8201b671af0e admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:53.608445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=100 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:53.655449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a9d0f-a96b-4888-bd1f-5a89c128fa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:53.656070 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a9d0f-a96b-4888-bd1f-5a89c128fa5c admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:53.656353 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a9d0f-a96b-4888-bd1f-5a89c128fa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:53.656625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a9d0f-a96b-4888-bd1f-5a89c128fa5c admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:53.657289 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a9d0f-a96b-4888-bd1f-5a89c128fa5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:53.659306 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a9d0f-a96b-4888-bd1f-5a89c128fa5c admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:53.764572 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1382/2744] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:10:53 2022] POST /identity/v3/users => generated 283 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:53.766263 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d798ce-f868-4842-9485-cf71d73835af admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:53.777987 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d798ce-f868-4842-9485-cf71d73835af admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:53.783547 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79feb25-9fd1-4b2e-ba3a-1efd64f5f218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:53.784229 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79feb25-9fd1-4b2e-ba3a-1efd64f5f218 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:53.784541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79feb25-9fd1-4b2e-ba3a-1efd64f5f218 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:53.784852 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79feb25-9fd1-4b2e-ba3a-1efd64f5f218 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:53.785546 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79feb25-9fd1-4b2e-ba3a-1efd64f5f218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:53.787264 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79feb25-9fd1-4b2e-ba3a-1efd64f5f218 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:53.803537 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1363/2745] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:10:53.804949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a9d0f-a96b-4888-bd1f-5a89c128fa5c admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:53.816658 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a9d0f-a96b-4888-bd1f-5a89c128fa5c admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:53.821237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783b8f2-08a9-4d83-8fc4-e0f900b2aefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:53.822006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783b8f2-08a9-4d83-8fc4-e0f900b2aefe admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:53.822422 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783b8f2-08a9-4d83-8fc4-e0f900b2aefe admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:53.822794 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783b8f2-08a9-4d83-8fc4-e0f900b2aefe admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:53.823609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783b8f2-08a9-4d83-8fc4-e0f900b2aefe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:53.825403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783b8f2-08a9-4d83-8fc4-e0f900b2aefe admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:53.836351 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1383/2746] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:10:53.840712 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79feb25-9fd1-4b2e-ba3a-1efd64f5f218 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:53.854378 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79feb25-9fd1-4b2e-ba3a-1efd64f5f218 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:53.861205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4789c-e6c1-4a2c-af53-b605e082a316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:53.862602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4789c-e6c1-4a2c-af53-b605e082a316 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:53.863102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4789c-e6c1-4a2c-af53-b605e082a316 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:53.863594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4789c-e6c1-4a2c-af53-b605e082a316 admin admin] PATH_INFO: `/v3/projects/962dbece6ce34064a8353feee531390b/users/21f7e99f22764eb19ad9adf536552b9c/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:53.881885 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4789c-e6c1-4a2c-af53-b605e082a316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=962dbece6ce34064a8353feee531390b, user_id=21f7e99f22764eb19ad9adf536552b9c, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:53.884577 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4789c-e6c1-4a2c-af53-b605e082a316 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:53.962165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1364/2747] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:10:53 2022] PUT /identity/v3/projects/962dbece6ce34064a8353feee531390b/users/21f7e99f22764eb19ad9adf536552b9c/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:53.973007 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4b345-48a7-4382-b5a1-479f1d69ba39 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:53.973950 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4b345-48a7-4382-b5a1-479f1d69ba39 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:53.974830 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4b345-48a7-4382-b5a1-479f1d69ba39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:54.003568 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-bbe4b345-48a7-4382-b5a1-479f1d69ba39 None None] MFA Rules not processed for user `21f7e99f22764eb19ad9adf536552b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:54.004947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-bbe4b345-48a7-4382-b5a1-479f1d69ba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:54.074720 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1384/2748] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:10:54.086663 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4789c-e6c1-4a2c-af53-b605e082a316 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:54.088463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-caf4789c-e6c1-4a2c-af53-b605e082a316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:54.148541 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4789c-e6c1-4a2c-af53-b605e082a316 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:54.152539 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbe7b5-56f8-4a80-a5b9-9daef5891492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:54.153168 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbe7b5-56f8-4a80-a5b9-9daef5891492 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:54.153456 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbe7b5-56f8-4a80-a5b9-9daef5891492 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:54.153736 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbe7b5-56f8-4a80-a5b9-9daef5891492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:54.164807 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bbe7b5-56f8-4a80-a5b9-9daef5891492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:54.166508 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bbe7b5-56f8-4a80-a5b9-9daef5891492 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:54.177153 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1365/2749] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:54.374704 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4b345-48a7-4382-b5a1-479f1d69ba39 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:54.375279 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-bbe4b345-48a7-4382-b5a1-479f1d69ba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:54.441910 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4b345-48a7-4382-b5a1-479f1d69ba39 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:54.446452 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7cb82-81ca-4f79-b941-e02556001d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:54.447126 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7cb82-81ca-4f79-b941-e02556001d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:54.447398 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7cb82-81ca-4f79-b941-e02556001d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:54.447673 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7cb82-81ca-4f79-b941-e02556001d1d admin admin] PATH_INFO: `/v3/users/b769a01bcf7e4f47bc978aeb04c45a32` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:54.448820 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7cb82-81ca-4f79-b941-e02556001d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b769a01bcf7e4f47bc978aeb04c45a32)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:54.450813 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7cb82-81ca-4f79-b941-e02556001d1d admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:54.474590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:54.660900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5ce7cb82-81ca-4f79-b941-e02556001d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b769a01bcf7e4f47bc978aeb04c45a32'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:54.661563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5ce7cb82-81ca-4f79-b941-e02556001d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b769a01bcf7e4f47bc978aeb04c45a32'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:54.674258 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5ce7cb82-81ca-4f79-b941-e02556001d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b769a01bcf7e4f47bc978aeb04c45a32'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:54.738237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5ce7cb82-81ca-4f79-b941-e02556001d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b769a01bcf7e4f47bc978aeb04c45a32'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:54.738893 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-5ce7cb82-81ca-4f79-b941-e02556001d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b769a01bcf7e4f47bc978aeb04c45a32'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:54.751768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1385/2750] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:10:54 2022] DELETE /identity/v3/users/b769a01bcf7e4f47bc978aeb04c45a32 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:55.015315 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbe7b5-56f8-4a80-a5b9-9daef5891492 service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:55.030755 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbe7b5-56f8-4a80-a5b9-9daef5891492 service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:55.087617 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:55.101289 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2f8e9-3256-4d09-b7e2-71e6ffd1f9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:55.101944 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2f8e9-3256-4d09-b7e2-71e6ffd1f9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:55.102329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2f8e9-3256-4d09-b7e2-71e6ffd1f9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:55.102649 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2f8e9-3256-4d09-b7e2-71e6ffd1f9f9 admin admin] PATH_INFO: `/v3/projects/afc6c6d2070a4e39ac4579ac7b2382d4` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:55.103885 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2f8e9-3256-4d09-b7e2-71e6ffd1f9f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afc6c6d2070a4e39ac4579ac7b2382d4)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:55.105748 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2f8e9-3256-4d09-b7e2-71e6ffd1f9f9 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:55.255609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3ff2f8e9-3256-4d09-b7e2-71e6ffd1f9f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afc6c6d2070a4e39ac4579ac7b2382d4', 'request_id': 'req-3ff2f8e9-3256-4d09-b7e2-71e6ffd1f9f9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:55.263314 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3ff2f8e9-3256-4d09-b7e2-71e6ffd1f9f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afc6c6d2070a4e39ac4579ac7b2382d4', 'request_id': 'req-3ff2f8e9-3256-4d09-b7e2-71e6ffd1f9f9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:55.332201 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3ff2f8e9-3256-4d09-b7e2-71e6ffd1f9f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afc6c6d2070a4e39ac4579ac7b2382d4', 'request_id': 'req-3ff2f8e9-3256-4d09-b7e2-71e6ffd1f9f9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:55.344571 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3ff2f8e9-3256-4d09-b7e2-71e6ffd1f9f9 admin admin] The token cache is being invalidate because project afc6c6d2070a4e39ac4579ac7b2382d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:10:55.344859 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3ff2f8e9-3256-4d09-b7e2-71e6ffd1f9f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:55.345496 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-3ff2f8e9-3256-4d09-b7e2-71e6ffd1f9f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:55.347026 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1366/2751] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:10:55 2022] DELETE /identity/v3/projects/afc6c6d2070a4e39ac4579ac7b2382d4 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:58.978826 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7cb82-81ca-4f79-b941-e02556001d1d admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:58.980274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5ce7cb82-81ca-4f79-b941-e02556001d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:58.994617 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7cb82-81ca-4f79-b941-e02556001d1d admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:59.051980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51650d-5db9-45bd-997f-84dfb5c7945a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:59.052684 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51650d-5db9-45bd-997f-84dfb5c7945a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:59.052974 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51650d-5db9-45bd-997f-84dfb5c7945a admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:59.053254 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51650d-5db9-45bd-997f-84dfb5c7945a admin admin] PATH_INFO: `/v3/users/b1346652b3914684b0c47d0fc6572f70` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:59.054492 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51650d-5db9-45bd-997f-84dfb5c7945a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1346652b3914684b0c47d0fc6572f70)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:59.056453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51650d-5db9-45bd-997f-84dfb5c7945a admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:59.214539 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-ba51650d-5db9-45bd-997f-84dfb5c7945a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1346652b3914684b0c47d0fc6572f70'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:59.215101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-ba51650d-5db9-45bd-997f-84dfb5c7945a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1346652b3914684b0c47d0fc6572f70'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:59.228413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-ba51650d-5db9-45bd-997f-84dfb5c7945a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1346652b3914684b0c47d0fc6572f70'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:59.281254 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-ba51650d-5db9-45bd-997f-84dfb5c7945a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1346652b3914684b0c47d0fc6572f70'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:59.283106 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-ba51650d-5db9-45bd-997f-84dfb5c7945a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1346652b3914684b0c47d0fc6572f70'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:10:59.298090 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1386/2752] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:10:58 2022] DELETE /identity/v3/users/b1346652b3914684b0c47d0fc6572f70 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:59.302866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423c1e2-8a8c-4531-8c77-97f2751e1c9f None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:59.303440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423c1e2-8a8c-4531-8c77-97f2751e1c9f None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:59.303440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423c1e2-8a8c-4531-8c77-97f2751e1c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:59.323796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-6423c1e2-8a8c-4531-8c77-97f2751e1c9f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:59.325263 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-6423c1e2-8a8c-4531-8c77-97f2751e1c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:59.397428 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1367/2753] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:10:59.408016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51650d-5db9-45bd-997f-84dfb5c7945a admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:59.409652 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-ba51650d-5db9-45bd-997f-84dfb5c7945a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:59.434519 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:59.471718 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51650d-5db9-45bd-997f-84dfb5c7945a admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:59.475851 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ee226-f175-47e5-8bfa-3c43aa32e205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:59.477753 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ee226-f175-47e5-8bfa-3c43aa32e205 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:59.478011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ee226-f175-47e5-8bfa-3c43aa32e205 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:59.478291 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ee226-f175-47e5-8bfa-3c43aa32e205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:59.487531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ee226-f175-47e5-8bfa-3c43aa32e205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:59.489097 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ee226-f175-47e5-8bfa-3c43aa32e205 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:59.499596 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1387/2754] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:10:59.946323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423c1e2-8a8c-4531-8c77-97f2751e1c9f None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:59.947983 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-6423c1e2-8a8c-4531-8c77-97f2751e1c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:59.962173 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423c1e2-8a8c-4531-8c77-97f2751e1c9f None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:59.969856 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49836710-99a1-4973-956a-998e8365f9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:59.970793 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49836710-99a1-4973-956a-998e8365f9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:59.971075 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49836710-99a1-4973-956a-998e8365f9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:59.971504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49836710-99a1-4973-956a-998e8365f9d6 admin admin] PATH_INFO: `/v3/projects/2452044b93ed4f318b87cb0e8d7769b0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:59.972838 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49836710-99a1-4973-956a-998e8365f9d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2452044b93ed4f318b87cb0e8d7769b0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:59.974937 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49836710-99a1-4973-956a-998e8365f9d6 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:00.117618 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-49836710-99a1-4973-956a-998e8365f9d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2452044b93ed4f318b87cb0e8d7769b0', 'request_id': 'req-49836710-99a1-4973-956a-998e8365f9d6'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:00.128041 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-49836710-99a1-4973-956a-998e8365f9d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2452044b93ed4f318b87cb0e8d7769b0', 'request_id': 'req-49836710-99a1-4973-956a-998e8365f9d6'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:00.195461 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-49836710-99a1-4973-956a-998e8365f9d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2452044b93ed4f318b87cb0e8d7769b0', 'request_id': 'req-49836710-99a1-4973-956a-998e8365f9d6'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:00.203130 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:00.206966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-49836710-99a1-4973-956a-998e8365f9d6 admin admin] The token cache is being invalidate because project 2452044b93ed4f318b87cb0e8d7769b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:11:00.207238 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-49836710-99a1-4973-956a-998e8365f9d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:00.207857 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-49836710-99a1-4973-956a-998e8365f9d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:00.209584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1368/2755] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:10:59 2022] DELETE /identity/v3/projects/2452044b93ed4f318b87cb0e8d7769b0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:00.214001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ee226-f175-47e5-8bfa-3c43aa32e205 service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:00.223641 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ee226-f175-47e5-8bfa-3c43aa32e205 service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:00.283445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba8e53-d941-4e22-8ebe-751b6207e060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:00.284094 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba8e53-d941-4e22-8ebe-751b6207e060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:00.284379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba8e53-d941-4e22-8ebe-751b6207e060 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:00.284659 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba8e53-d941-4e22-8ebe-751b6207e060 admin admin] PATH_INFO: `/v3/users/345fc1f6961446539502b584a1db1095` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:00.285911 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba8e53-d941-4e22-8ebe-751b6207e060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=345fc1f6961446539502b584a1db1095)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:00.287903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba8e53-d941-4e22-8ebe-751b6207e060 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:00.459404 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a7ba8e53-d941-4e22-8ebe-751b6207e060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345fc1f6961446539502b584a1db1095'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:00.460713 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a7ba8e53-d941-4e22-8ebe-751b6207e060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345fc1f6961446539502b584a1db1095'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:00.474047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a7ba8e53-d941-4e22-8ebe-751b6207e060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345fc1f6961446539502b584a1db1095'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:00.543302 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a7ba8e53-d941-4e22-8ebe-751b6207e060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345fc1f6961446539502b584a1db1095'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:00.543992 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a7ba8e53-d941-4e22-8ebe-751b6207e060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345fc1f6961446539502b584a1db1095'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:00.557018 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1388/2756] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:11:00 2022] DELETE /identity/v3/users/345fc1f6961446539502b584a1db1095 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:00.950906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49836710-99a1-4973-956a-998e8365f9d6 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:00.952367 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-49836710-99a1-4973-956a-998e8365f9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:00.965998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49836710-99a1-4973-956a-998e8365f9d6 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:01.029782 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e695e9-8e8c-4a58-98db-9e7d9a9047aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:01.030464 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e695e9-8e8c-4a58-98db-9e7d9a9047aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:01.030753 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e695e9-8e8c-4a58-98db-9e7d9a9047aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:01.031035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e695e9-8e8c-4a58-98db-9e7d9a9047aa admin admin] PATH_INFO: `/v3/projects/4765f4fd33b142c59d18edeec1856a45` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:01.032200 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e695e9-8e8c-4a58-98db-9e7d9a9047aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4765f4fd33b142c59d18edeec1856a45)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:01.034251 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e695e9-8e8c-4a58-98db-9e7d9a9047aa admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:01.126722 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-88e695e9-8e8c-4a58-98db-9e7d9a9047aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4765f4fd33b142c59d18edeec1856a45', 'request_id': 'req-88e695e9-8e8c-4a58-98db-9e7d9a9047aa'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:01.132964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-88e695e9-8e8c-4a58-98db-9e7d9a9047aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4765f4fd33b142c59d18edeec1856a45', 'request_id': 'req-88e695e9-8e8c-4a58-98db-9e7d9a9047aa'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:01.200688 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-88e695e9-8e8c-4a58-98db-9e7d9a9047aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4765f4fd33b142c59d18edeec1856a45', 'request_id': 'req-88e695e9-8e8c-4a58-98db-9e7d9a9047aa'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:01.211991 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-88e695e9-8e8c-4a58-98db-9e7d9a9047aa admin admin] The token cache is being invalidate because project 4765f4fd33b142c59d18edeec1856a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:11:01.212284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-88e695e9-8e8c-4a58-98db-9e7d9a9047aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:01.212932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-88e695e9-8e8c-4a58-98db-9e7d9a9047aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:01.214519 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1369/2757] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:11:00 2022] DELETE /identity/v3/projects/4765f4fd33b142c59d18edeec1856a45 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:01.218550 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba8e53-d941-4e22-8ebe-751b6207e060 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:01.220042 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a7ba8e53-d941-4e22-8ebe-751b6207e060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:01.233163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba8e53-d941-4e22-8ebe-751b6207e060 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:01.272006 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:01.289843 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556313c0-e5fb-48de-bbbc-112662a8daaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:01.290547 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556313c0-e5fb-48de-bbbc-112662a8daaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:01.290838 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556313c0-e5fb-48de-bbbc-112662a8daaf admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:01.291120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556313c0-e5fb-48de-bbbc-112662a8daaf admin admin] PATH_INFO: `/v3/users/eb16412527cc41e08af9d9206240de1a` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:01.292318 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556313c0-e5fb-48de-bbbc-112662a8daaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb16412527cc41e08af9d9206240de1a)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:01.294241 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556313c0-e5fb-48de-bbbc-112662a8daaf admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:01.448061 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-556313c0-e5fb-48de-bbbc-112662a8daaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb16412527cc41e08af9d9206240de1a'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:01.448625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-556313c0-e5fb-48de-bbbc-112662a8daaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb16412527cc41e08af9d9206240de1a'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:01.460936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-556313c0-e5fb-48de-bbbc-112662a8daaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb16412527cc41e08af9d9206240de1a'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:01.538273 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-556313c0-e5fb-48de-bbbc-112662a8daaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb16412527cc41e08af9d9206240de1a'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:01.539326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-556313c0-e5fb-48de-bbbc-112662a8daaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb16412527cc41e08af9d9206240de1a'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:01.553233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1389/2758] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:11:01 2022] DELETE /identity/v3/users/eb16412527cc41e08af9d9206240de1a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:01.916893 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e695e9-8e8c-4a58-98db-9e7d9a9047aa admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:01.921000 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-88e695e9-8e8c-4a58-98db-9e7d9a9047aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:01.934361 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e695e9-8e8c-4a58-98db-9e7d9a9047aa admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:01.996786 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d1569-0a4f-4451-b0c4-f1817d262296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:01.997503 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d1569-0a4f-4451-b0c4-f1817d262296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:01.997893 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d1569-0a4f-4451-b0c4-f1817d262296 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:01.998242 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d1569-0a4f-4451-b0c4-f1817d262296 admin admin] PATH_INFO: `/v3/projects/87a3e0b9eea34b51b778464cde22e4b5` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:01.999463 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d1569-0a4f-4451-b0c4-f1817d262296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87a3e0b9eea34b51b778464cde22e4b5)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:02.001894 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d1569-0a4f-4451-b0c4-f1817d262296 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:02.224095 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:02.236922 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-285d1569-0a4f-4451-b0c4-f1817d262296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87a3e0b9eea34b51b778464cde22e4b5', 'request_id': 'req-285d1569-0a4f-4451-b0c4-f1817d262296'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:02.243085 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-285d1569-0a4f-4451-b0c4-f1817d262296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87a3e0b9eea34b51b778464cde22e4b5', 'request_id': 'req-285d1569-0a4f-4451-b0c4-f1817d262296'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:02.343333 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-285d1569-0a4f-4451-b0c4-f1817d262296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87a3e0b9eea34b51b778464cde22e4b5', 'request_id': 'req-285d1569-0a4f-4451-b0c4-f1817d262296'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:02.355189 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-285d1569-0a4f-4451-b0c4-f1817d262296 admin admin] The token cache is being invalidate because project 87a3e0b9eea34b51b778464cde22e4b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:11:02.355483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-285d1569-0a4f-4451-b0c4-f1817d262296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:02.356129 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-285d1569-0a4f-4451-b0c4-f1817d262296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:02.357704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1370/2759] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:11:01 2022] DELETE /identity/v3/projects/87a3e0b9eea34b51b778464cde22e4b5 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:02.363515 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69b5b6-2667-4c88-95c6-184b47fabfa0 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:02.363997 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69b5b6-2667-4c88-95c6-184b47fabfa0 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:02.364116 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69b5b6-2667-4c88-95c6-184b47fabfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:02.383679 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-fc69b5b6-2667-4c88-95c6-184b47fabfa0 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:02.384874 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-fc69b5b6-2667-4c88-95c6-184b47fabfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:02.445670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1390/2760] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:02.453392 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0234c-af96-40f6-aec1-747427a06ea5 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:02.459560 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0234c-af96-40f6-aec1-747427a06ea5 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:02.459560 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0234c-af96-40f6-aec1-747427a06ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:02.474132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-3ed0234c-af96-40f6-aec1-747427a06ea5 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:02.475364 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-3ed0234c-af96-40f6-aec1-747427a06ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:02.483513 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1371/2761] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:02.490339 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69b5b6-2667-4c88-95c6-184b47fabfa0 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:02.497342 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69b5b6-2667-4c88-95c6-184b47fabfa0 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:02.501877 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99924988-a3f9-4113-8809-014ba303290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:02.502533 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99924988-a3f9-4113-8809-014ba303290e admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:02.502819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99924988-a3f9-4113-8809-014ba303290e admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:02.503101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99924988-a3f9-4113-8809-014ba303290e admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:02.503802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99924988-a3f9-4113-8809-014ba303290e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:02.504112 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99924988-a3f9-4113-8809-014ba303290e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:02.505703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99924988-a3f9-4113-8809-014ba303290e admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:02.518028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1391/2762] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:02.522918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0234c-af96-40f6-aec1-747427a06ea5 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:02.532028 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0234c-af96-40f6-aec1-747427a06ea5 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:02.536669 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9633a-ddae-43d4-9acf-3f76b03ce2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:02.537276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9633a-ddae-43d4-9acf-3f76b03ce2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:02.537565 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9633a-ddae-43d4-9acf-3f76b03ce2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:02.537864 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9633a-ddae-43d4-9acf-3f76b03ce2c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:02.538816 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9633a-ddae-43d4-9acf-3f76b03ce2c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:02.540709 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9633a-ddae-43d4-9acf-3f76b03ce2c6 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:02.653893 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1372/2763] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:11:02 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:11:02.657967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99924988-a3f9-4113-8809-014ba303290e admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:02.668570 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99924988-a3f9-4113-8809-014ba303290e admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:02.713222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:02.724452 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1956b-ab9e-44e2-950b-fa958dee38b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:02.726682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1956b-ab9e-44e2-950b-fa958dee38b2 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:02.726682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1956b-ab9e-44e2-950b-fa958dee38b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:02.726682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1956b-ab9e-44e2-950b-fa958dee38b2 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:02.726682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1956b-ab9e-44e2-950b-fa958dee38b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:02.728200 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1956b-ab9e-44e2-950b-fa958dee38b2 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:02.830155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1392/2764] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:11:02 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:11:02.834571 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9633a-ddae-43d4-9acf-3f76b03ce2c6 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:02.845084 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9633a-ddae-43d4-9acf-3f76b03ce2c6 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:02.849715 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34808cdc-5a09-4398-b7bb-898377ad2d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:02.850415 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34808cdc-5a09-4398-b7bb-898377ad2d49 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:02.850724 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34808cdc-5a09-4398-b7bb-898377ad2d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:02.851005 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34808cdc-5a09-4398-b7bb-898377ad2d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:02.851701 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34808cdc-5a09-4398-b7bb-898377ad2d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:02.853300 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34808cdc-5a09-4398-b7bb-898377ad2d49 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:02.864178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1373/2765] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:11:02.868056 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1956b-ab9e-44e2-950b-fa958dee38b2 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:02.878033 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1956b-ab9e-44e2-950b-fa958dee38b2 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:02.883259 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f890f37-03a9-4e8b-95e8-6f08885979f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:02.884403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f890f37-03a9-4e8b-95e8-6f08885979f5 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:02.884403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f890f37-03a9-4e8b-95e8-6f08885979f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:02.884403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f890f37-03a9-4e8b-95e8-6f08885979f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:02.885098 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f890f37-03a9-4e8b-95e8-6f08885979f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:02.886746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f890f37-03a9-4e8b-95e8-6f08885979f5 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:02.897114 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1393/2766] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:02.901372 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34808cdc-5a09-4398-b7bb-898377ad2d49 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:02.911366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34808cdc-5a09-4398-b7bb-898377ad2d49 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:02.916289 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6165dfc-a181-4293-b769-3a7c0d907bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:02.922111 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6165dfc-a181-4293-b769-3a7c0d907bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:02.922111 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6165dfc-a181-4293-b769-3a7c0d907bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:02.922111 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6165dfc-a181-4293-b769-3a7c0d907bd0 admin admin] PATH_INFO: `/v3/projects/b23a31977f8d4729aa5ed6e29a93ab6b/users/306d0fab2d4149cf82a1a3a2f8aece53/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:02.932930 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6165dfc-a181-4293-b769-3a7c0d907bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b23a31977f8d4729aa5ed6e29a93ab6b, user_id=306d0fab2d4149cf82a1a3a2f8aece53, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:02.935638 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6165dfc-a181-4293-b769-3a7c0d907bd0 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:03.035768 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1374/2767] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:11:02 2022] PUT /identity/v3/projects/b23a31977f8d4729aa5ed6e29a93ab6b/users/306d0fab2d4149cf82a1a3a2f8aece53/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:03.047626 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520b50e-0771-44ae-8dfd-b445f4ceadc9 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:03.054531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520b50e-0771-44ae-8dfd-b445f4ceadc9 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:03.054531 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520b50e-0771-44ae-8dfd-b445f4ceadc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:03.077168 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-a520b50e-0771-44ae-8dfd-b445f4ceadc9 None None] MFA Rules not processed for user `306d0fab2d4149cf82a1a3a2f8aece53`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:03.078437 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a520b50e-0771-44ae-8dfd-b445f4ceadc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:03.141700 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1394/2768] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:03.153097 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6165dfc-a181-4293-b769-3a7c0d907bd0 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:03.154860 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e6165dfc-a181-4293-b769-3a7c0d907bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:03.220030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6165dfc-a181-4293-b769-3a7c0d907bd0 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:03.223641 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac999bb-7cd6-4784-8c9d-b23f42f7d8cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:03.224260 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac999bb-7cd6-4784-8c9d-b23f42f7d8cf service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:03.224545 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac999bb-7cd6-4784-8c9d-b23f42f7d8cf service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:03.224827 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac999bb-7cd6-4784-8c9d-b23f42f7d8cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:03.233700 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac999bb-7cd6-4784-8c9d-b23f42f7d8cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:03.235173 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac999bb-7cd6-4784-8c9d-b23f42f7d8cf service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:03.244045 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1375/2769] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:04.093353 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520b50e-0771-44ae-8dfd-b445f4ceadc9 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:04.094766 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a520b50e-0771-44ae-8dfd-b445f4ceadc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:04.166873 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520b50e-0771-44ae-8dfd-b445f4ceadc9 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:04.171464 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39c44d-cf82-48ee-8340-7bd75db07fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:04.173817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39c44d-cf82-48ee-8340-7bd75db07fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:04.173817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39c44d-cf82-48ee-8340-7bd75db07fea admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:04.173817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39c44d-cf82-48ee-8340-7bd75db07fea admin admin] PATH_INFO: `/v3/users/21f7e99f22764eb19ad9adf536552b9c` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:04.173817 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39c44d-cf82-48ee-8340-7bd75db07fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f7e99f22764eb19ad9adf536552b9c)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:04.175735 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39c44d-cf82-48ee-8340-7bd75db07fea admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:04.368693 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3a39c44d-cf82-48ee-8340-7bd75db07fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f7e99f22764eb19ad9adf536552b9c'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:04.369258 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3a39c44d-cf82-48ee-8340-7bd75db07fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f7e99f22764eb19ad9adf536552b9c'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:04.376842 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:04.381155 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3a39c44d-cf82-48ee-8340-7bd75db07fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f7e99f22764eb19ad9adf536552b9c'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:04.440607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3a39c44d-cf82-48ee-8340-7bd75db07fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f7e99f22764eb19ad9adf536552b9c'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:04.441227 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-3a39c44d-cf82-48ee-8340-7bd75db07fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f7e99f22764eb19ad9adf536552b9c'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:04.456872 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1395/2770] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:11:04 2022] DELETE /identity/v3/users/21f7e99f22764eb19ad9adf536552b9c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:04.461471 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fea6a7-7f1a-4880-b6e5-3846ed6f33d5 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:04.462055 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fea6a7-7f1a-4880-b6e5-3846ed6f33d5 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:04.462055 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fea6a7-7f1a-4880-b6e5-3846ed6f33d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:04.482766 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-b4fea6a7-7f1a-4880-b6e5-3846ed6f33d5 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:04.484212 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b4fea6a7-7f1a-4880-b6e5-3846ed6f33d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:04.533983 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:04.543052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1376/2771] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:04.552632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39c44d-cf82-48ee-8340-7bd75db07fea admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:04.554686 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3a39c44d-cf82-48ee-8340-7bd75db07fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:04.610618 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39c44d-cf82-48ee-8340-7bd75db07fea admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:04.614362 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a8230-c768-47e4-9a94-a3622674a99c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:04.615002 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a8230-c768-47e4-9a94-a3622674a99c service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:04.615286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a8230-c768-47e4-9a94-a3622674a99c service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:04.615563 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a8230-c768-47e4-9a94-a3622674a99c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:04.628975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a8230-c768-47e4-9a94-a3622674a99c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:04.628975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a8230-c768-47e4-9a94-a3622674a99c service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:04.636383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1396/2772] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:05.036885 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a8230-c768-47e4-9a94-a3622674a99c service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:05.039142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de58b3-83db-4138-9721-326e36656557 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.039142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de58b3-83db-4138-9721-326e36656557 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.039142 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de58b3-83db-4138-9721-326e36656557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.039460 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-d60a8230-c768-47e4-9a94-a3622674a99c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:05.053291 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a8230-c768-47e4-9a94-a3622674a99c service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:05.060616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-b5de58b3-83db-4138-9721-326e36656557 None None] MFA Rules not processed for user `306d0fab2d4149cf82a1a3a2f8aece53`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:05.062304 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b5de58b3-83db-4138-9721-326e36656557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:05.065245 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7144db0-0bd9-4540-a5f3-6e0f90649f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:05.065909 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7144db0-0bd9-4540-a5f3-6e0f90649f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.066538 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7144db0-0bd9-4540-a5f3-6e0f90649f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.066538 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7144db0-0bd9-4540-a5f3-6e0f90649f37 admin admin] PATH_INFO: `/v3/projects/962dbece6ce34064a8353feee531390b` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.068397 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7144db0-0bd9-4540-a5f3-6e0f90649f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=962dbece6ce34064a8353feee531390b)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:05.070338 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7144db0-0bd9-4540-a5f3-6e0f90649f37 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:05.132554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1377/2773] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:05.190900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a7144db0-0bd9-4540-a5f3-6e0f90649f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '962dbece6ce34064a8353feee531390b', 'request_id': 'req-a7144db0-0bd9-4540-a5f3-6e0f90649f37'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:05.197208 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a7144db0-0bd9-4540-a5f3-6e0f90649f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '962dbece6ce34064a8353feee531390b', 'request_id': 'req-a7144db0-0bd9-4540-a5f3-6e0f90649f37'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:05.204132 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a7144db0-0bd9-4540-a5f3-6e0f90649f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '962dbece6ce34064a8353feee531390b', 'request_id': 'req-a7144db0-0bd9-4540-a5f3-6e0f90649f37'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:05.332163 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a7144db0-0bd9-4540-a5f3-6e0f90649f37 admin admin] The token cache is being invalidate because project 962dbece6ce34064a8353feee531390b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:11:05.335953 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a7144db0-0bd9-4540-a5f3-6e0f90649f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:05.335953 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-a7144db0-0bd9-4540-a5f3-6e0f90649f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:05.335953 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1397/2774] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:11:05 2022] DELETE /identity/v3/projects/962dbece6ce34064a8353feee531390b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:05.340327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f5ff4-f7a7-4ef9-9d84-2c3c5e1d69c0 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.340684 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f5ff4-f7a7-4ef9-9d84-2c3c5e1d69c0 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.340909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f5ff4-f7a7-4ef9-9d84-2c3c5e1d69c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.361480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-1e7f5ff4-f7a7-4ef9-9d84-2c3c5e1d69c0 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:05.365301 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-1e7f5ff4-f7a7-4ef9-9d84-2c3c5e1d69c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:05.426203 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1378/2775] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:05.434361 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462be919-16ec-4040-b44c-1990809032d3 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.434670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462be919-16ec-4040-b44c-1990809032d3 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.434942 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462be919-16ec-4040-b44c-1990809032d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.455453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-462be919-16ec-4040-b44c-1990809032d3 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:05.456780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-462be919-16ec-4040-b44c-1990809032d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:05.465202 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1398/2776] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:05.469591 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f5ff4-f7a7-4ef9-9d84-2c3c5e1d69c0 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:05.482186 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f5ff4-f7a7-4ef9-9d84-2c3c5e1d69c0 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:05.487523 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db557d-40d3-4ae8-a3bd-bdc2bc759058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:05.488146 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db557d-40d3-4ae8-a3bd-bdc2bc759058 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.488434 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db557d-40d3-4ae8-a3bd-bdc2bc759058 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.488712 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db557d-40d3-4ae8-a3bd-bdc2bc759058 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.489413 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db557d-40d3-4ae8-a3bd-bdc2bc759058 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:05.489719 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db557d-40d3-4ae8-a3bd-bdc2bc759058 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:05.491356 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db557d-40d3-4ae8-a3bd-bdc2bc759058 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:05.503205 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1379/2777] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:05.508169 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462be919-16ec-4040-b44c-1990809032d3 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:05.518120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462be919-16ec-4040-b44c-1990809032d3 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:05.523543 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af98137-82b0-482b-a932-d6caeec847e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:05.524151 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af98137-82b0-482b-a932-d6caeec847e4 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.524454 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af98137-82b0-482b-a932-d6caeec847e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.524842 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af98137-82b0-482b-a932-d6caeec847e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.525508 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af98137-82b0-482b-a932-d6caeec847e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:05.527448 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af98137-82b0-482b-a932-d6caeec847e4 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:05.671292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1399/2778] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:11:05 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:05.675650 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db557d-40d3-4ae8-a3bd-bdc2bc759058 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:05.686809 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db557d-40d3-4ae8-a3bd-bdc2bc759058 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:05.745218 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af98137-82b0-482b-a932-d6caeec847e4 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:05.747737 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3af98137-82b0-482b-a932-d6caeec847e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:05.748288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c02f92-9edf-42b2-b608-38c9ddb80404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:05.750257 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c02f92-9edf-42b2-b608-38c9ddb80404 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.750257 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c02f92-9edf-42b2-b608-38c9ddb80404 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.750257 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c02f92-9edf-42b2-b608-38c9ddb80404 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.750671 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c02f92-9edf-42b2-b608-38c9ddb80404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:05.756616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c02f92-9edf-42b2-b608-38c9ddb80404 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:05.796932 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:05.841002 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af98137-82b0-482b-a932-d6caeec847e4 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:05.847424 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0c708-23ec-4304-a007-11461f976f56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fab620bc5d044479746d8ea17615a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:05.848156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0c708-23ec-4304-a007-11461f976f56 service placement] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.848443 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0c708-23ec-4304-a007-11461f976f56 service placement] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.848719 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0c708-23ec-4304-a007-11461f976f56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.850802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-91a0c708-23ec-4304-a007-11461f976f56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:05.864398 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1380/2779] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:11:05 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:11:05.868573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c02f92-9edf-42b2-b608-38c9ddb80404 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:05.868715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0c708-23ec-4304-a007-11461f976f56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:05.870191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0c708-23ec-4304-a007-11461f976f56 service placement] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:05.878908 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c02f92-9edf-42b2-b608-38c9ddb80404 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:05.880491 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1400/2780] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:11:05.884197 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8e919-45fa-41d3-b889-81bc88e72265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:05.884800 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8e919-45fa-41d3-b889-81bc88e72265 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.885209 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8e919-45fa-41d3-b889-81bc88e72265 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.885370 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8e919-45fa-41d3-b889-81bc88e72265 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.886069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8e919-45fa-41d3-b889-81bc88e72265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:05.887686 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8e919-45fa-41d3-b889-81bc88e72265 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:05.901431 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1381/2781] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:05.902872 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0c708-23ec-4304-a007-11461f976f56 service placement] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:05.914235 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0c708-23ec-4304-a007-11461f976f56 service placement] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:05.919183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a22a0e-559d-4ffc-8362-2fad18dfa568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:05.919792 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a22a0e-559d-4ffc-8362-2fad18dfa568 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.920073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a22a0e-559d-4ffc-8362-2fad18dfa568 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.920377 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a22a0e-559d-4ffc-8362-2fad18dfa568 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.921061 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a22a0e-559d-4ffc-8362-2fad18dfa568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:05.922776 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a22a0e-559d-4ffc-8362-2fad18dfa568 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:05.933072 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1401/2782] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:05.937383 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8e919-45fa-41d3-b889-81bc88e72265 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:05.949423 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8e919-45fa-41d3-b889-81bc88e72265 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:05.965798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207c9e2-eb61-47e3-a80f-c1256bc02064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:05.965798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207c9e2-eb61-47e3-a80f-c1256bc02064 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.965798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207c9e2-eb61-47e3-a80f-c1256bc02064 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.965798 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207c9e2-eb61-47e3-a80f-c1256bc02064 admin admin] PATH_INFO: `/v3/projects/0f4b35e2cd1b465aa1b19a1e4eb36d14/users/885085e844a64cba8d47ef4cc8ba9667/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.966519 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:05.972088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207c9e2-eb61-47e3-a80f-c1256bc02064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f4b35e2cd1b465aa1b19a1e4eb36d14, user_id=885085e844a64cba8d47ef4cc8ba9667, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:05.974851 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207c9e2-eb61-47e3-a80f-c1256bc02064 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:06.052868 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1382/2783] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:11:05 2022] PUT /identity/v3/projects/0f4b35e2cd1b465aa1b19a1e4eb36d14/users/885085e844a64cba8d47ef4cc8ba9667/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:06.065300 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a9423-eb25-46d9-a28c-6334ffb86d12 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:06.065593 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a9423-eb25-46d9-a28c-6334ffb86d12 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:06.065875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a9423-eb25-46d9-a28c-6334ffb86d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:06.093818 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-db2a9423-eb25-46d9-a28c-6334ffb86d12 None None] MFA Rules not processed for user `885085e844a64cba8d47ef4cc8ba9667`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:06.095067 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-db2a9423-eb25-46d9-a28c-6334ffb86d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:06.171097 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1402/2784] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:06.175844 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207c9e2-eb61-47e3-a80f-c1256bc02064 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:06.238822 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207c9e2-eb61-47e3-a80f-c1256bc02064 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:06.244169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660ed89-7f4c-47e5-9fc6-7f24e6b5cf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:06.244832 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660ed89-7f4c-47e5-9fc6-7f24e6b5cf1b admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:06.245105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660ed89-7f4c-47e5-9fc6-7f24e6b5cf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:06.245376 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660ed89-7f4c-47e5-9fc6-7f24e6b5cf1b admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:06.246172 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660ed89-7f4c-47e5-9fc6-7f24e6b5cf1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:06.248143 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660ed89-7f4c-47e5-9fc6-7f24e6b5cf1b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:06.316629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1383/2785] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:11:06 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:06.321141 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a9423-eb25-46d9-a28c-6334ffb86d12 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:06.331956 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a9423-eb25-46d9-a28c-6334ffb86d12 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:06.392632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763994c7-c2d5-4aeb-98f2-73f1b19d0dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:06.393364 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763994c7-c2d5-4aeb-98f2-73f1b19d0dfd admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:06.393650 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763994c7-c2d5-4aeb-98f2-73f1b19d0dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:06.393936 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763994c7-c2d5-4aeb-98f2-73f1b19d0dfd admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:06.394666 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763994c7-c2d5-4aeb-98f2-73f1b19d0dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:06.396609 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763994c7-c2d5-4aeb-98f2-73f1b19d0dfd admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:06.498419 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1403/2786] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:11:06 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:06.502404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660ed89-7f4c-47e5-9fc6-7f24e6b5cf1b admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:06.512824 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660ed89-7f4c-47e5-9fc6-7f24e6b5cf1b admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:06.519394 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b020d29-f363-449c-bbac-da24b62ac837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:06.520007 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b020d29-f363-449c-bbac-da24b62ac837 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:06.520285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b020d29-f363-449c-bbac-da24b62ac837 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:06.520562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b020d29-f363-449c-bbac-da24b62ac837 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:06.521250 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b020d29-f363-449c-bbac-da24b62ac837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:06.523379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b020d29-f363-449c-bbac-da24b62ac837 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:06.534300 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1384/2787] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:06.539625 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763994c7-c2d5-4aeb-98f2-73f1b19d0dfd admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:06.549752 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763994c7-c2d5-4aeb-98f2-73f1b19d0dfd admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:06.554567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc8890-e58c-45d4-a3c6-4f8b42c0e6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:06.555237 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc8890-e58c-45d4-a3c6-4f8b42c0e6ac admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:06.555521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc8890-e58c-45d4-a3c6-4f8b42c0e6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:06.555828 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc8890-e58c-45d4-a3c6-4f8b42c0e6ac admin admin] PATH_INFO: `/v3/projects/ae84f6ba012947eeafa6c581a96ca2d8/users/9d88fbcf4184467e9c272e7762a73e59/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:06.571030 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc8890-e58c-45d4-a3c6-4f8b42c0e6ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae84f6ba012947eeafa6c581a96ca2d8, user_id=9d88fbcf4184467e9c272e7762a73e59, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:06.573689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc8890-e58c-45d4-a3c6-4f8b42c0e6ac admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:06.733792 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1404/2788] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:11:06 2022] PUT /identity/v3/projects/ae84f6ba012947eeafa6c581a96ca2d8/users/9d88fbcf4184467e9c272e7762a73e59/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:06.738035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b020d29-f363-449c-bbac-da24b62ac837 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:06.748540 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b020d29-f363-449c-bbac-da24b62ac837 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:06.805781 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852c782-fcbc-4ca6-90fc-fda9ab02a002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:06.806568 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852c782-fcbc-4ca6-90fc-fda9ab02a002 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:06.806924 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852c782-fcbc-4ca6-90fc-fda9ab02a002 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:06.807244 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852c782-fcbc-4ca6-90fc-fda9ab02a002 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:06.807960 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852c782-fcbc-4ca6-90fc-fda9ab02a002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:06.809716 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852c782-fcbc-4ca6-90fc-fda9ab02a002 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:06.820690 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1385/2789] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:06.824969 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc8890-e58c-45d4-a3c6-4f8b42c0e6ac admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:06.836038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc8890-e58c-45d4-a3c6-4f8b42c0e6ac admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:06.841343 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e32928-e2c2-45f0-b642-4796eb34d7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:06.842064 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e32928-e2c2-45f0-b642-4796eb34d7f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:06.842350 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e32928-e2c2-45f0-b642-4796eb34d7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:06.842671 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e32928-e2c2-45f0-b642-4796eb34d7f4 admin admin] PATH_INFO: `/v3/projects/ae84f6ba012947eeafa6c581a96ca2d8/users/9d88fbcf4184467e9c272e7762a73e59/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:06.844725 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e32928-e2c2-45f0-b642-4796eb34d7f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae84f6ba012947eeafa6c581a96ca2d8, user_id=9d88fbcf4184467e9c272e7762a73e59, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:06.847428 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e32928-e2c2-45f0-b642-4796eb34d7f4 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:06.850112 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:06.859905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1405/2790] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:11:06 2022] PUT /identity/v3/projects/ae84f6ba012947eeafa6c581a96ca2d8/users/9d88fbcf4184467e9c272e7762a73e59/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:06.870986 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ff8ce-f882-48aa-8da3-ed529f5d7f3a None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:06.871385 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ff8ce-f882-48aa-8da3-ed529f5d7f3a None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:06.871769 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ff8ce-f882-48aa-8da3-ed529f5d7f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:06.905866 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-c02ff8ce-f882-48aa-8da3-ed529f5d7f3a None None] MFA Rules not processed for user `9d88fbcf4184467e9c272e7762a73e59`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:06.908178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-c02ff8ce-f882-48aa-8da3-ed529f5d7f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:06.953392 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:06.976906 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1386/2791] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:06.988206 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e32928-e2c2-45f0-b642-4796eb34d7f4 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:06.990001 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-60e32928-e2c2-45f0-b642-4796eb34d7f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:07.050352 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e32928-e2c2-45f0-b642-4796eb34d7f4 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:07.054597 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bad34-9bb2-4827-9578-6e58259b18b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:07.055212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bad34-9bb2-4827-9578-6e58259b18b2 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:07.055496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bad34-9bb2-4827-9578-6e58259b18b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:07.055767 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bad34-9bb2-4827-9578-6e58259b18b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:07.064705 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284bad34-9bb2-4827-9578-6e58259b18b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:07.066147 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284bad34-9bb2-4827-9578-6e58259b18b2 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:07.075453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1406/2792] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:07.106177 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ff8ce-f882-48aa-8da3-ed529f5d7f3a None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:07.170546 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ff8ce-f882-48aa-8da3-ed529f5d7f3a None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:07.175098 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d30681-68d4-4d16-8281-ea97a1cbbd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:07.175744 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d30681-68d4-4d16-8281-ea97a1cbbd8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:07.176024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d30681-68d4-4d16-8281-ea97a1cbbd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:07.176329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d30681-68d4-4d16-8281-ea97a1cbbd8d admin admin] PATH_INFO: `/v3/users/885085e844a64cba8d47ef4cc8ba9667` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:07.177581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d30681-68d4-4d16-8281-ea97a1cbbd8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=885085e844a64cba8d47ef4cc8ba9667)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:07.179613 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d30681-68d4-4d16-8281-ea97a1cbbd8d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:07.438525 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a2d30681-68d4-4d16-8281-ea97a1cbbd8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '885085e844a64cba8d47ef4cc8ba9667'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:07.445535 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a2d30681-68d4-4d16-8281-ea97a1cbbd8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '885085e844a64cba8d47ef4cc8ba9667'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:07.457981 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a2d30681-68d4-4d16-8281-ea97a1cbbd8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '885085e844a64cba8d47ef4cc8ba9667'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:07.458796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a2d30681-68d4-4d16-8281-ea97a1cbbd8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '885085e844a64cba8d47ef4cc8ba9667'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:07.459512 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-a2d30681-68d4-4d16-8281-ea97a1cbbd8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '885085e844a64cba8d47ef4cc8ba9667'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:07.583834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1387/2793] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:11:07 2022] DELETE /identity/v3/users/885085e844a64cba8d47ef4cc8ba9667 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:07.589790 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688b7e9-a2c6-49e7-9915-ec85c289b89c None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:07.591459 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688b7e9-a2c6-49e7-9915-ec85c289b89c None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:07.591459 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688b7e9-a2c6-49e7-9915-ec85c289b89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:07.611027 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-c688b7e9-a2c6-49e7-9915-ec85c289b89c None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:07.614494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c688b7e9-a2c6-49e7-9915-ec85c289b89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:07.671627 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1407/2794] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:07.683927 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d30681-68d4-4d16-8281-ea97a1cbbd8d admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:07.685551 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-a2d30681-68d4-4d16-8281-ea97a1cbbd8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:07.743778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d30681-68d4-4d16-8281-ea97a1cbbd8d admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:07.747510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39afd3-6682-49c1-a445-75dc2dc8ab64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:07.748276 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39afd3-6682-49c1-a445-75dc2dc8ab64 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:07.748552 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39afd3-6682-49c1-a445-75dc2dc8ab64 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:07.748849 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39afd3-6682-49c1-a445-75dc2dc8ab64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:07.758964 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39afd3-6682-49c1-a445-75dc2dc8ab64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:07.760440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39afd3-6682-49c1-a445-75dc2dc8ab64 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:07.770042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1388/2795] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:11:08.199946 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688b7e9-a2c6-49e7-9915-ec85c289b89c None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:08.201536 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c688b7e9-a2c6-49e7-9915-ec85c289b89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:08.222040 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688b7e9-a2c6-49e7-9915-ec85c289b89c None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:08.230662 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf6916-7319-4878-b724-9546b26762f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:08.231614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf6916-7319-4878-b724-9546b26762f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:08.232098 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf6916-7319-4878-b724-9546b26762f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:08.232433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf6916-7319-4878-b724-9546b26762f1 admin admin] PATH_INFO: `/v3/projects/0f4b35e2cd1b465aa1b19a1e4eb36d14` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:08.234183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf6916-7319-4878-b724-9546b26762f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f4b35e2cd1b465aa1b19a1e4eb36d14)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:08.237269 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf6916-7319-4878-b724-9546b26762f1 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:08.356298 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-42bf6916-7319-4878-b724-9546b26762f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f4b35e2cd1b465aa1b19a1e4eb36d14', 'request_id': 'req-42bf6916-7319-4878-b724-9546b26762f1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:08.362768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-42bf6916-7319-4878-b724-9546b26762f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f4b35e2cd1b465aa1b19a1e4eb36d14', 'request_id': 'req-42bf6916-7319-4878-b724-9546b26762f1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:08.369265 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-42bf6916-7319-4878-b724-9546b26762f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f4b35e2cd1b465aa1b19a1e4eb36d14', 'request_id': 'req-42bf6916-7319-4878-b724-9546b26762f1'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:08.469980 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-42bf6916-7319-4878-b724-9546b26762f1 admin admin] The token cache is being invalidate because project 0f4b35e2cd1b465aa1b19a1e4eb36d14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:11:08.476026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-42bf6916-7319-4878-b724-9546b26762f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:08.476026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-42bf6916-7319-4878-b724-9546b26762f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:08.476026 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1408/2796] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:11:08 2022] DELETE /identity/v3/projects/0f4b35e2cd1b465aa1b19a1e4eb36d14 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:08.478074 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39afd3-6682-49c1-a445-75dc2dc8ab64 service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:08.485619 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:08.489412 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39afd3-6682-49c1-a445-75dc2dc8ab64 service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:08.547874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ba252-e039-4d21-8ce5-c3029d42fba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:08.548634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ba252-e039-4d21-8ce5-c3029d42fba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:08.549327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ba252-e039-4d21-8ce5-c3029d42fba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:08.549795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ba252-e039-4d21-8ce5-c3029d42fba2 admin admin] PATH_INFO: `/v3/users/9d88fbcf4184467e9c272e7762a73e59` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:08.551334 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ba252-e039-4d21-8ce5-c3029d42fba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d88fbcf4184467e9c272e7762a73e59)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:08.553478 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ba252-e039-4d21-8ce5-c3029d42fba2 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:08.843257 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5f7ba252-e039-4d21-8ce5-c3029d42fba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d88fbcf4184467e9c272e7762a73e59'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:08.850068 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5f7ba252-e039-4d21-8ce5-c3029d42fba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d88fbcf4184467e9c272e7762a73e59'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:08.862880 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5f7ba252-e039-4d21-8ce5-c3029d42fba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d88fbcf4184467e9c272e7762a73e59'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:08.863618 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5f7ba252-e039-4d21-8ce5-c3029d42fba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d88fbcf4184467e9c272e7762a73e59'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:08.864208 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5f7ba252-e039-4d21-8ce5-c3029d42fba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d88fbcf4184467e9c272e7762a73e59'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:08.972934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1389/2797] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:11:08 2022] DELETE /identity/v3/users/9d88fbcf4184467e9c272e7762a73e59 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:09.386920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf6916-7319-4878-b724-9546b26762f1 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:09.388479 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-42bf6916-7319-4878-b724-9546b26762f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:09.404486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf6916-7319-4878-b724-9546b26762f1 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:09.426193 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:09.469528 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0862d-3219-40a8-bcaa-2767f95dfe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:09.470185 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0862d-3219-40a8-bcaa-2767f95dfe63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:09.470521 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0862d-3219-40a8-bcaa-2767f95dfe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:09.471110 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0862d-3219-40a8-bcaa-2767f95dfe63 admin admin] PATH_INFO: `/v3/projects/ae84f6ba012947eeafa6c581a96ca2d8` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:09.472068 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0862d-3219-40a8-bcaa-2767f95dfe63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae84f6ba012947eeafa6c581a96ca2d8)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:09.473999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0862d-3219-40a8-bcaa-2767f95dfe63 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:09.636081 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-89c0862d-3219-40a8-bcaa-2767f95dfe63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae84f6ba012947eeafa6c581a96ca2d8', 'request_id': 'req-89c0862d-3219-40a8-bcaa-2767f95dfe63'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:09.642244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-89c0862d-3219-40a8-bcaa-2767f95dfe63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae84f6ba012947eeafa6c581a96ca2d8', 'request_id': 'req-89c0862d-3219-40a8-bcaa-2767f95dfe63'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:09.648992 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-89c0862d-3219-40a8-bcaa-2767f95dfe63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae84f6ba012947eeafa6c581a96ca2d8', 'request_id': 'req-89c0862d-3219-40a8-bcaa-2767f95dfe63'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:09.761541 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-89c0862d-3219-40a8-bcaa-2767f95dfe63 admin admin] The token cache is being invalidate because project ae84f6ba012947eeafa6c581a96ca2d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:11:09.761854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-89c0862d-3219-40a8-bcaa-2767f95dfe63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:09.762568 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-89c0862d-3219-40a8-bcaa-2767f95dfe63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:09.764320 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1409/2798] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:11:09 2022] DELETE /identity/v3/projects/ae84f6ba012947eeafa6c581a96ca2d8 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:09.769344 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0a23f-a68f-4f5d-a6f3-6187684a3e69 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:09.769714 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0a23f-a68f-4f5d-a6f3-6187684a3e69 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:09.770048 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0a23f-a68f-4f5d-a6f3-6187684a3e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:09.790975 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-50e0a23f-a68f-4f5d-a6f3-6187684a3e69 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:09.792256 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-50e0a23f-a68f-4f5d-a6f3-6187684a3e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:09.852611 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1390/2799] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:09.860238 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15650dea-698d-47ac-a897-d1737e92c843 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:09.860656 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15650dea-698d-47ac-a897-d1737e92c843 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:09.861016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15650dea-698d-47ac-a897-d1737e92c843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:09.884795 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-15650dea-698d-47ac-a897-d1737e92c843 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:09.886011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-15650dea-698d-47ac-a897-d1737e92c843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:09.894242 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1410/2800] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:09.899285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0a23f-a68f-4f5d-a6f3-6187684a3e69 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:09.909178 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0a23f-a68f-4f5d-a6f3-6187684a3e69 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:09.914887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4bc54-2420-4d1f-b614-9ceadd5a8376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:09.915495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4bc54-2420-4d1f-b614-9ceadd5a8376 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:09.916440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4bc54-2420-4d1f-b614-9ceadd5a8376 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:09.916727 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4bc54-2420-4d1f-b614-9ceadd5a8376 admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:09.917449 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4bc54-2420-4d1f-b614-9ceadd5a8376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:09.917764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4bc54-2420-4d1f-b614-9ceadd5a8376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:09.919624 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4bc54-2420-4d1f-b614-9ceadd5a8376 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:09.932544 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1391/2801] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:09.936949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15650dea-698d-47ac-a897-d1737e92c843 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:09.947861 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15650dea-698d-47ac-a897-d1737e92c843 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:09.952605 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c5b86-6a4f-4c76-a243-f0aa6d82f443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:09.953306 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c5b86-6a4f-4c76-a243-f0aa6d82f443 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:09.953878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c5b86-6a4f-4c76-a243-f0aa6d82f443 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:09.954351 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c5b86-6a4f-4c76-a243-f0aa6d82f443 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:09.955629 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c5b86-6a4f-4c76-a243-f0aa6d82f443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:09.959297 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c5b86-6a4f-4c76-a243-f0aa6d82f443 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:10.055051 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1411/2802] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:11:09 2022] POST /identity/v3/projects => generated 407 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:10.059105 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4bc54-2420-4d1f-b614-9ceadd5a8376 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:10.070165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4bc54-2420-4d1f-b614-9ceadd5a8376 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:10.078977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:10.136758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c51727-354d-4238-848e-fbcd6bb6da3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:10.141887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c51727-354d-4238-848e-fbcd6bb6da3c admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:10.141887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c51727-354d-4238-848e-fbcd6bb6da3c admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:10.141887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c51727-354d-4238-848e-fbcd6bb6da3c admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:10.141887 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c51727-354d-4238-848e-fbcd6bb6da3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:10.143096 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c51727-354d-4238-848e-fbcd6bb6da3c admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:10.239893 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1392/2803] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:11:10 2022] POST /identity/v3/users => generated 304 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:10.245742 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c5b86-6a4f-4c76-a243-f0aa6d82f443 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:10.259072 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c5b86-6a4f-4c76-a243-f0aa6d82f443 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:10.264897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65c896-162e-4f45-b367-7558f033a7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:10.265559 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65c896-162e-4f45-b367-7558f033a7da admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:10.265841 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65c896-162e-4f45-b367-7558f033a7da admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:10.266117 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65c896-162e-4f45-b367-7558f033a7da admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:10.266882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65c896-162e-4f45-b367-7558f033a7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:10.268607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65c896-162e-4f45-b367-7558f033a7da admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:10.280346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1412/2804] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:10.284568 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c51727-354d-4238-848e-fbcd6bb6da3c admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:10.298973 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c51727-354d-4238-848e-fbcd6bb6da3c admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:10.304778 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa52d70-3ce9-468d-bc52-7ca7bee73b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:10.305453 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa52d70-3ce9-468d-bc52-7ca7bee73b4b admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:10.305802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa52d70-3ce9-468d-bc52-7ca7bee73b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:10.306163 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa52d70-3ce9-468d-bc52-7ca7bee73b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:10.307042 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa52d70-3ce9-468d-bc52-7ca7bee73b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:10.309006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa52d70-3ce9-468d-bc52-7ca7bee73b4b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:10.320820 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1393/2805] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:10.324847 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65c896-162e-4f45-b367-7558f033a7da admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:10.335459 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65c896-162e-4f45-b367-7558f033a7da admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:10.340261 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58caa6-bf7b-4e4e-a38b-2244a15f284b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:10.340939 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58caa6-bf7b-4e4e-a38b-2244a15f284b admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:10.341222 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58caa6-bf7b-4e4e-a38b-2244a15f284b admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:10.341503 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58caa6-bf7b-4e4e-a38b-2244a15f284b admin admin] PATH_INFO: `/v3/projects/10e5e259088b4ad8a086549eb023ad7d/users/1f6c2f4cd9124ef7a4320ebd0e3bf023/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:10.360349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58caa6-bf7b-4e4e-a38b-2244a15f284b admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e5e259088b4ad8a086549eb023ad7d, user_id=1f6c2f4cd9124ef7a4320ebd0e3bf023, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:10.364313 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58caa6-bf7b-4e4e-a38b-2244a15f284b admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:10.472621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1413/2806] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:11:10 2022] PUT /identity/v3/projects/10e5e259088b4ad8a086549eb023ad7d/users/1f6c2f4cd9124ef7a4320ebd0e3bf023/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:10.484738 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf1e8d-712d-4819-b23d-3de71e5e0efb None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:10.485233 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf1e8d-712d-4819-b23d-3de71e5e0efb None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:10.485585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf1e8d-712d-4819-b23d-3de71e5e0efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:10.519610 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-9dcf1e8d-712d-4819-b23d-3de71e5e0efb None None] MFA Rules not processed for user `1f6c2f4cd9124ef7a4320ebd0e3bf023`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:10.521444 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-9dcf1e8d-712d-4819-b23d-3de71e5e0efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:10.601954 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1394/2807] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:10 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:10.606518 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58caa6-bf7b-4e4e-a38b-2244a15f284b admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:10.659895 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:10.675809 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58caa6-bf7b-4e4e-a38b-2244a15f284b admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:10.680632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0786b-bd70-4de0-893b-4af8e7cd5fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:10.681199 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0786b-bd70-4de0-893b-4af8e7cd5fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:10.681480 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0786b-bd70-4de0-893b-4af8e7cd5fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:10.681755 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0786b-bd70-4de0-893b-4af8e7cd5fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:10.682449 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0786b-bd70-4de0-893b-4af8e7cd5fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:10.684368 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0786b-bd70-4de0-893b-4af8e7cd5fc4 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:10.809186 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1414/2808] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:11:10 2022] POST /identity/v3/projects => generated 409 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:10.817619 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf1e8d-712d-4819-b23d-3de71e5e0efb None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:10.824094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf1e8d-712d-4819-b23d-3de71e5e0efb None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:10.887728 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82ff46-8381-4941-ad4e-1c1c9bc68656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:10.888354 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82ff46-8381-4941-ad4e-1c1c9bc68656 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:10.888635 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82ff46-8381-4941-ad4e-1c1c9bc68656 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:10.888913 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82ff46-8381-4941-ad4e-1c1c9bc68656 admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:10.889596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82ff46-8381-4941-ad4e-1c1c9bc68656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:10.891561 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82ff46-8381-4941-ad4e-1c1c9bc68656 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:11.006732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1395/2809] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:11:10 2022] POST /identity/v3/users => generated 311 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:11.010998 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0786b-bd70-4de0-893b-4af8e7cd5fc4 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:11.021575 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0786b-bd70-4de0-893b-4af8e7cd5fc4 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:11.026726 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f3bef-bfcd-4be6-bca9-60997b459fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:11.027336 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f3bef-bfcd-4be6-bca9-60997b459fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:11.027639 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f3bef-bfcd-4be6-bca9-60997b459fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:11.027900 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f3bef-bfcd-4be6-bca9-60997b459fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:11.028589 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f3bef-bfcd-4be6-bca9-60997b459fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:11.030195 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f3bef-bfcd-4be6-bca9-60997b459fd9 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:11.041475 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1415/2810] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:11.045764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82ff46-8381-4941-ad4e-1c1c9bc68656 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:11.056218 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82ff46-8381-4941-ad4e-1c1c9bc68656 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:11.060937 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164c283-a27b-454a-8d8b-568746e0b709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:11.061609 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164c283-a27b-454a-8d8b-568746e0b709 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:11.061896 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164c283-a27b-454a-8d8b-568746e0b709 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:11.062175 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164c283-a27b-454a-8d8b-568746e0b709 admin admin] PATH_INFO: `/v3/projects/481cb775a54a40d38a81769cd591c31f/users/284c23638dca497182be01d4dcf29a90/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:11.065373 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:11.081340 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164c283-a27b-454a-8d8b-568746e0b709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=481cb775a54a40d38a81769cd591c31f, user_id=284c23638dca497182be01d4dcf29a90, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:11.081340 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164c283-a27b-454a-8d8b-568746e0b709 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:11.178480 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1396/2811] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:11:11 2022] PUT /identity/v3/projects/481cb775a54a40d38a81769cd591c31f/users/284c23638dca497182be01d4dcf29a90/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:11:11.182500 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f3bef-bfcd-4be6-bca9-60997b459fd9 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:11.192567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f3bef-bfcd-4be6-bca9-60997b459fd9 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:11.250674 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24185a88-fa1e-4513-aad1-556362845a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:11.251294 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24185a88-fa1e-4513-aad1-556362845a14 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:11.251579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24185a88-fa1e-4513-aad1-556362845a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:11.251855 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24185a88-fa1e-4513-aad1-556362845a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:11.252568 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24185a88-fa1e-4513-aad1-556362845a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:11.254156 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24185a88-fa1e-4513-aad1-556362845a14 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:11.264288 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1416/2812] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:11.268409 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164c283-a27b-454a-8d8b-568746e0b709 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:11.279346 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164c283-a27b-454a-8d8b-568746e0b709 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:11.286162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5eeed-e7c7-4397-b212-19a9eaa07d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:11.286162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5eeed-e7c7-4397-b212-19a9eaa07d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:11.286162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5eeed-e7c7-4397-b212-19a9eaa07d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:11.286162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5eeed-e7c7-4397-b212-19a9eaa07d6e admin admin] PATH_INFO: `/v3/projects/481cb775a54a40d38a81769cd591c31f/users/284c23638dca497182be01d4dcf29a90/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:11.287269 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5eeed-e7c7-4397-b212-19a9eaa07d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=481cb775a54a40d38a81769cd591c31f, user_id=284c23638dca497182be01d4dcf29a90, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:11.290159 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5eeed-e7c7-4397-b212-19a9eaa07d6e admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:11.300289 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1397/2813] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:11:11 2022] PUT /identity/v3/projects/481cb775a54a40d38a81769cd591c31f/users/284c23638dca497182be01d4dcf29a90/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:11.310515 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612991b8-4178-441e-ab96-b0ba9432da9a None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:11.310811 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612991b8-4178-441e-ab96-b0ba9432da9a None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:11.311092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612991b8-4178-441e-ab96-b0ba9432da9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:11.339859 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-612991b8-4178-441e-ab96-b0ba9432da9a None None] MFA Rules not processed for user `284c23638dca497182be01d4dcf29a90`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:11.340972 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-612991b8-4178-441e-ab96-b0ba9432da9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:11.411581 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1417/2814] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:11 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:11.423119 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5eeed-e7c7-4397-b212-19a9eaa07d6e admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:11.424932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-d3b5eeed-e7c7-4397-b212-19a9eaa07d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:11.487311 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5eeed-e7c7-4397-b212-19a9eaa07d6e admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:11.491602 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92cda3-99f9-4cff-a221-ecb015159808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:11.492290 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92cda3-99f9-4cff-a221-ecb015159808 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:11.492572 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92cda3-99f9-4cff-a221-ecb015159808 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:11.492863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92cda3-99f9-4cff-a221-ecb015159808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:11.502716 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92cda3-99f9-4cff-a221-ecb015159808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:11.504165 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92cda3-99f9-4cff-a221-ecb015159808 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:11.514784 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1398/2815] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:11 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:11.919028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612991b8-4178-441e-ab96-b0ba9432da9a None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:11.928670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612991b8-4178-441e-ab96-b0ba9432da9a None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:11.932167 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a7cf4-eb66-427f-8adf-ca98e05d6cd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:11.932768 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a7cf4-eb66-427f-8adf-ca98e05d6cd3 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:11.933053 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a7cf4-eb66-427f-8adf-ca98e05d6cd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:11.933331 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a7cf4-eb66-427f-8adf-ca98e05d6cd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:11.972663 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:11.988589 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a7cf4-eb66-427f-8adf-ca98e05d6cd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:11.990025 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a7cf4-eb66-427f-8adf-ca98e05d6cd3 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:11.998819 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1418/2816] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:11 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:15.633131 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92cda3-99f9-4cff-a221-ecb015159808 service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:15.634739 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4f92cda3-99f9-4cff-a221-ecb015159808 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:15.710303 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92cda3-99f9-4cff-a221-ecb015159808 service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:15.716211 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ee8bc-9dcd-4151-a20a-0aab3bb23e0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:15.716828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ee8bc-9dcd-4151-a20a-0aab3bb23e0a service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:15.717108 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ee8bc-9dcd-4151-a20a-0aab3bb23e0a service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:15.717383 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ee8bc-9dcd-4151-a20a-0aab3bb23e0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:15.719207 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-291ee8bc-9dcd-4151-a20a-0aab3bb23e0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:15.732038 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ee8bc-9dcd-4151-a20a-0aab3bb23e0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:15.733597 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ee8bc-9dcd-4151-a20a-0aab3bb23e0a service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:15.745853 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1399/2817] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:20.393615 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a7cf4-eb66-427f-8adf-ca98e05d6cd3 service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:20.463121 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a7cf4-eb66-427f-8adf-ca98e05d6cd3 service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:20.472489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38f368-deea-4fa3-bd44-e21bef47efab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:20.473135 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38f368-deea-4fa3-bd44-e21bef47efab admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:20.473413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38f368-deea-4fa3-bd44-e21bef47efab admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:20.473685 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38f368-deea-4fa3-bd44-e21bef47efab admin admin] PATH_INFO: `/v3/users/1f6c2f4cd9124ef7a4320ebd0e3bf023` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:20.474868 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38f368-deea-4fa3-bd44-e21bef47efab admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f6c2f4cd9124ef7a4320ebd0e3bf023)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:20.476799 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38f368-deea-4fa3-bd44-e21bef47efab admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:20.648660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-cf38f368-deea-4fa3-bd44-e21bef47efab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f6c2f4cd9124ef7a4320ebd0e3bf023'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:20.649348 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-cf38f368-deea-4fa3-bd44-e21bef47efab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f6c2f4cd9124ef7a4320ebd0e3bf023'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:20.665048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-cf38f368-deea-4fa3-bd44-e21bef47efab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f6c2f4cd9124ef7a4320ebd0e3bf023'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:20.749420 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-cf38f368-deea-4fa3-bd44-e21bef47efab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f6c2f4cd9124ef7a4320ebd0e3bf023'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:20.750056 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-cf38f368-deea-4fa3-bd44-e21bef47efab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f6c2f4cd9124ef7a4320ebd0e3bf023'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:20.768040 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1419/2818] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:11:20 2022] DELETE /identity/v3/users/1f6c2f4cd9124ef7a4320ebd0e3bf023 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:20.769761 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c98dad-1e57-42ec-8e14-7cec9805156e None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:20.770238 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c98dad-1e57-42ec-8e14-7cec9805156e None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:20.770405 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c98dad-1e57-42ec-8e14-7cec9805156e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:20.790052 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-36c98dad-1e57-42ec-8e14-7cec9805156e None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:20.791550 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-36c98dad-1e57-42ec-8e14-7cec9805156e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:20.851766 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:20.860015 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1400/2819] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:11:20.872027 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38f368-deea-4fa3-bd44-e21bef47efab admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:20.873478 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-cf38f368-deea-4fa3-bd44-e21bef47efab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:20.932021 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38f368-deea-4fa3-bd44-e21bef47efab admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:20.935629 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72414da-c9fb-4c0c-b0e1-56ef08cf1507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:20.936248 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72414da-c9fb-4c0c-b0e1-56ef08cf1507 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:20.936529 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72414da-c9fb-4c0c-b0e1-56ef08cf1507 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:20.936802 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72414da-c9fb-4c0c-b0e1-56ef08cf1507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:20.946040 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72414da-c9fb-4c0c-b0e1-56ef08cf1507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:20.947506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72414da-c9fb-4c0c-b0e1-56ef08cf1507 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:20.957566 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1420/2820] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:21.499689 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c98dad-1e57-42ec-8e14-7cec9805156e None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:21.499689 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-36c98dad-1e57-42ec-8e14-7cec9805156e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:21.522672 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c98dad-1e57-42ec-8e14-7cec9805156e None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:21.528612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d2e57-5ffc-4231-b857-f133dacb1db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:21.528612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d2e57-5ffc-4231-b857-f133dacb1db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:21.528612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d2e57-5ffc-4231-b857-f133dacb1db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:21.529291 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d2e57-5ffc-4231-b857-f133dacb1db6 admin admin] PATH_INFO: `/v3/projects/10e5e259088b4ad8a086549eb023ad7d` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:21.530050 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d2e57-5ffc-4231-b857-f133dacb1db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10e5e259088b4ad8a086549eb023ad7d)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:21.532067 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d2e57-5ffc-4231-b857-f133dacb1db6 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:21.642846 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5e5d2e57-5ffc-4231-b857-f133dacb1db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e5e259088b4ad8a086549eb023ad7d', 'request_id': 'req-5e5d2e57-5ffc-4231-b857-f133dacb1db6'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:21.649031 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5e5d2e57-5ffc-4231-b857-f133dacb1db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e5e259088b4ad8a086549eb023ad7d', 'request_id': 'req-5e5d2e57-5ffc-4231-b857-f133dacb1db6'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:21.766737 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5e5d2e57-5ffc-4231-b857-f133dacb1db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e5e259088b4ad8a086549eb023ad7d', 'request_id': 'req-5e5d2e57-5ffc-4231-b857-f133dacb1db6'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:21.777975 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5e5d2e57-5ffc-4231-b857-f133dacb1db6 admin admin] The token cache is being invalidate because project 10e5e259088b4ad8a086549eb023ad7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:11:21.785020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5e5d2e57-5ffc-4231-b857-f133dacb1db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:21.785020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5e5d2e57-5ffc-4231-b857-f133dacb1db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:21.785020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1401/2821] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:11:21 2022] DELETE /identity/v3/projects/10e5e259088b4ad8a086549eb023ad7d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:21.785359 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72414da-c9fb-4c0c-b0e1-56ef08cf1507 service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:21.790991 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:21.796230 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72414da-c9fb-4c0c-b0e1-56ef08cf1507 service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:21.865018 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563db31-2c5e-41ff-9789-08a9e1e19b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:21.865669 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563db31-2c5e-41ff-9789-08a9e1e19b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:21.866590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563db31-2c5e-41ff-9789-08a9e1e19b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:21.866868 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563db31-2c5e-41ff-9789-08a9e1e19b2c admin admin] PATH_INFO: `/v3/users/284c23638dca497182be01d4dcf29a90` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:21.868095 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563db31-2c5e-41ff-9789-08a9e1e19b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=284c23638dca497182be01d4dcf29a90)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:21.870016 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563db31-2c5e-41ff-9789-08a9e1e19b2c admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:22.036529 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-e563db31-2c5e-41ff-9789-08a9e1e19b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '284c23638dca497182be01d4dcf29a90'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:22.037183 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-e563db31-2c5e-41ff-9789-08a9e1e19b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '284c23638dca497182be01d4dcf29a90'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:22.050864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-e563db31-2c5e-41ff-9789-08a9e1e19b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '284c23638dca497182be01d4dcf29a90'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:22.109092 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-e563db31-2c5e-41ff-9789-08a9e1e19b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '284c23638dca497182be01d4dcf29a90'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:22.109703 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-e563db31-2c5e-41ff-9789-08a9e1e19b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '284c23638dca497182be01d4dcf29a90'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:22.123858 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1421/2822] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:11:21 2022] DELETE /identity/v3/users/284c23638dca497182be01d4dcf29a90 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:22.591533 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d2e57-5ffc-4231-b857-f133dacb1db6 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:22.593140 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-5e5d2e57-5ffc-4231-b857-f133dacb1db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:22.611321 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d2e57-5ffc-4231-b857-f133dacb1db6 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:22.678528 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c77b38-4bbd-4117-a292-963f1e457a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:22.679386 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c77b38-4bbd-4117-a292-963f1e457a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:22.679811 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c77b38-4bbd-4117-a292-963f1e457a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:22.680094 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c77b38-4bbd-4117-a292-963f1e457a3a admin admin] PATH_INFO: `/v3/projects/481cb775a54a40d38a81769cd591c31f` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:22.681293 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c77b38-4bbd-4117-a292-963f1e457a3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=481cb775a54a40d38a81769cd591c31f)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:22.683338 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c77b38-4bbd-4117-a292-963f1e457a3a admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:22.783733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-67c77b38-4bbd-4117-a292-963f1e457a3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '481cb775a54a40d38a81769cd591c31f', 'request_id': 'req-67c77b38-4bbd-4117-a292-963f1e457a3a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:22.790113 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-67c77b38-4bbd-4117-a292-963f1e457a3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '481cb775a54a40d38a81769cd591c31f', 'request_id': 'req-67c77b38-4bbd-4117-a292-963f1e457a3a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:22.810780 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3765de-f72b-44ef-9618-80ce65c64b72 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:22.811306 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3765de-f72b-44ef-9618-80ce65c64b72 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:22.811417 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3765de-f72b-44ef-9618-80ce65c64b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:22.830717 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-0d3765de-f72b-44ef-9618-80ce65c64b72 None None] MFA Rules not processed for user `0834be7405cd4c968763099251d37154`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:22.831917 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0d3765de-f72b-44ef-9618-80ce65c64b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:22.887614 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1422/2823] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jul 26 15:11:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:11:22.892061 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-67c77b38-4bbd-4117-a292-963f1e457a3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '481cb775a54a40d38a81769cd591c31f', 'request_id': 'req-67c77b38-4bbd-4117-a292-963f1e457a3a'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:22.900109 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3765de-f72b-44ef-9618-80ce65c64b72 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:22.901468 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0d3765de-f72b-44ef-9618-80ce65c64b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:22.904380 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-67c77b38-4bbd-4117-a292-963f1e457a3a admin admin] The token cache is being invalidate because project 481cb775a54a40d38a81769cd591c31f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:11:22.904678 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-67c77b38-4bbd-4117-a292-963f1e457a3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:22.905314 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-67c77b38-4bbd-4117-a292-963f1e457a3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:22.906873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1402/2824] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:11:22 2022] DELETE /identity/v3/projects/481cb775a54a40d38a81769cd591c31f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:22.911408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd575adb-f6cc-423a-9628-a0199d52d58d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:22.911694 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd575adb-f6cc-423a-9628-a0199d52d58d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:22.911974 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd575adb-f6cc-423a-9628-a0199d52d58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:22.932114 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-cd575adb-f6cc-423a-9628-a0199d52d58d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:22.933322 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-cd575adb-f6cc-423a-9628-a0199d52d58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:22.935189 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:22.941870 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:22.974897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3765de-f72b-44ef-9618-80ce65c64b72 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:22.980690 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850fbca-e513-4a7c-8358-acb092605c74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '462ecbb85c6b4a17a952fb74fa2de65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:22.981312 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850fbca-e513-4a7c-8358-acb092605c74 service swift] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:22.981599 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850fbca-e513-4a7c-8358-acb092605c74 service swift] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:22.982028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850fbca-e513-4a7c-8358-acb092605c74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:22.984560 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-6850fbca-e513-4a7c-8358-acb092605c74 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:22.995267 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1403/2825] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:11:22.995494 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850fbca-e513-4a7c-8358-acb092605c74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:22.997176 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850fbca-e513-4a7c-8358-acb092605c74 service swift] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:23.003323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231dc56-5527-4204-a00b-76b65a8bd66d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:23.003622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231dc56-5527-4204-a00b-76b65a8bd66d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:23.003889 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231dc56-5527-4204-a00b-76b65a8bd66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:23.005738 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1423/2826] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jul 26 15:11:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 15:11:23.024329 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-5231dc56-5527-4204-a00b-76b65a8bd66d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:23.025577 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-5231dc56-5527-4204-a00b-76b65a8bd66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:23.033968 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1404/2827] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:11:23.038970 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850fbca-e513-4a7c-8358-acb092605c74 service swift] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:23.049407 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850fbca-e513-4a7c-8358-acb092605c74 service swift] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:23.054076 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe5f4b-8548-455e-947c-75fde694f7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:23.054655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe5f4b-8548-455e-947c-75fde694f7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:23.054940 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe5f4b-8548-455e-947c-75fde694f7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:23.055212 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe5f4b-8548-455e-947c-75fde694f7c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:23.055894 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe5f4b-8548-455e-947c-75fde694f7c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:23.056197 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe5f4b-8548-455e-947c-75fde694f7c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:23.057879 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe5f4b-8548-455e-947c-75fde694f7c7 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:23.069658 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1424/2828] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:23.073902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231dc56-5527-4204-a00b-76b65a8bd66d None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:23.083104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231dc56-5527-4204-a00b-76b65a8bd66d None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:23.088366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61aa2bb-bc49-4630-a861-0b77fa89c8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:23.088973 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61aa2bb-bc49-4630-a861-0b77fa89c8dd admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:23.089312 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61aa2bb-bc49-4630-a861-0b77fa89c8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:23.089530 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61aa2bb-bc49-4630-a861-0b77fa89c8dd admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:23.090188 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61aa2bb-bc49-4630-a861-0b77fa89c8dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:23.092164 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61aa2bb-bc49-4630-a861-0b77fa89c8dd admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:23.179642 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1405/2829] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:11:23 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:23.183759 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe5f4b-8548-455e-947c-75fde694f7c7 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:23.194752 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe5f4b-8548-455e-947c-75fde694f7c7 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:23.253849 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86794993-4eb8-42c0-a71a-06f9b620becc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:23.254501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86794993-4eb8-42c0-a71a-06f9b620becc admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:23.254883 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86794993-4eb8-42c0-a71a-06f9b620becc admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:23.255081 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86794993-4eb8-42c0-a71a-06f9b620becc admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:23.255822 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86794993-4eb8-42c0-a71a-06f9b620becc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:23.258445 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86794993-4eb8-42c0-a71a-06f9b620becc admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:23.364002 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1425/2830] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:11:23 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:11:23.367675 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61aa2bb-bc49-4630-a861-0b77fa89c8dd admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:23.378963 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61aa2bb-bc49-4630-a861-0b77fa89c8dd admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:23.384735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c3915-ec1a-4edd-984d-a4665d8cc5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:23.385758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c3915-ec1a-4edd-984d-a4665d8cc5ac admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:23.385758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c3915-ec1a-4edd-984d-a4665d8cc5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:23.385758 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c3915-ec1a-4edd-984d-a4665d8cc5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:23.386285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c3915-ec1a-4edd-984d-a4665d8cc5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:23.387783 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c3915-ec1a-4edd-984d-a4665d8cc5ac admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:23.399116 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1406/2831] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:23.403182 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86794993-4eb8-42c0-a71a-06f9b620becc admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:23.418062 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86794993-4eb8-42c0-a71a-06f9b620becc admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:23.419872 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2475f9d-cc32-4e4d-8c1c-8ac266d3b1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:23.420525 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2475f9d-cc32-4e4d-8c1c-8ac266d3b1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:23.420812 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2475f9d-cc32-4e4d-8c1c-8ac266d3b1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:23.421093 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2475f9d-cc32-4e4d-8c1c-8ac266d3b1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:23.421793 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2475f9d-cc32-4e4d-8c1c-8ac266d3b1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:23.423567 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2475f9d-cc32-4e4d-8c1c-8ac266d3b1e8 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:23.434230 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1426/2832] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:23.438575 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c3915-ec1a-4edd-984d-a4665d8cc5ac admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:23.449863 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c3915-ec1a-4edd-984d-a4665d8cc5ac admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:23.459313 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd89b36-7045-44b5-a304-a1b7e82bd0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:23.459313 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd89b36-7045-44b5-a304-a1b7e82bd0ec admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:23.459313 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd89b36-7045-44b5-a304-a1b7e82bd0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:23.459313 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd89b36-7045-44b5-a304-a1b7e82bd0ec admin admin] PATH_INFO: `/v3/projects/8e14d64cee6e41c49ab307fafaed60ea/users/9480ab45afb6439c90041de870d85934/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:23.471611 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd89b36-7045-44b5-a304-a1b7e82bd0ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e14d64cee6e41c49ab307fafaed60ea, user_id=9480ab45afb6439c90041de870d85934, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:23.474252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd89b36-7045-44b5-a304-a1b7e82bd0ec admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:23.552512 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1407/2833] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:11:23 2022] PUT /identity/v3/projects/8e14d64cee6e41c49ab307fafaed60ea/users/9480ab45afb6439c90041de870d85934/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:23.621364 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab410bb-ac1f-46b7-9181-681b5342c98b None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:23.621655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab410bb-ac1f-46b7-9181-681b5342c98b None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:23.622158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab410bb-ac1f-46b7-9181-681b5342c98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:23.656394 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-6ab410bb-ac1f-46b7-9181-681b5342c98b None None] MFA Rules not processed for user `9480ab45afb6439c90041de870d85934`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:23.657856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-6ab410bb-ac1f-46b7-9181-681b5342c98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:23.730789 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1427/2834] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:23.735195 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd89b36-7045-44b5-a304-a1b7e82bd0ec admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:23.799966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd89b36-7045-44b5-a304-a1b7e82bd0ec admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:23.805274 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63f056-726b-49b8-bc43-9621645d3339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:23.805892 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63f056-726b-49b8-bc43-9621645d3339 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:23.806173 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63f056-726b-49b8-bc43-9621645d3339 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:23.806479 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63f056-726b-49b8-bc43-9621645d3339 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:23.807151 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63f056-726b-49b8-bc43-9621645d3339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:23.809030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63f056-726b-49b8-bc43-9621645d3339 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:23.922777 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1408/2835] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:11:23 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:23.927880 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab410bb-ac1f-46b7-9181-681b5342c98b None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:23.940256 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab410bb-ac1f-46b7-9181-681b5342c98b None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:23.950329 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:23.965662 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82b766-4833-45cb-9f65-8349828c6774 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:23.965942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82b766-4833-45cb-9f65-8349828c6774 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:23.966226 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82b766-4833-45cb-9f65-8349828c6774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:23.986327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-dd82b766-4833-45cb-9f65-8349828c6774 None None] MFA Rules not processed for user `0834be7405cd4c968763099251d37154`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:23.987613 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-dd82b766-4833-45cb-9f65-8349828c6774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:24.004251 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0bf54-7d39-467d-8e3a-345b8cb9fbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:24.004883 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0bf54-7d39-467d-8e3a-345b8cb9fbb5 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:24.005165 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0bf54-7d39-467d-8e3a-345b8cb9fbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:24.005437 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0bf54-7d39-467d-8e3a-345b8cb9fbb5 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:24.006104 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0bf54-7d39-467d-8e3a-345b8cb9fbb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:24.008689 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0bf54-7d39-467d-8e3a-345b8cb9fbb5 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:24.018997 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:24.043851 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1409/2836] 10.222.0.86 () {58 vars in 967 bytes} [Tue Jul 26 15:11:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:11:24.056170 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82b766-4833-45cb-9f65-8349828c6774 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:24.057584 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-dd82b766-4833-45cb-9f65-8349828c6774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:24.115170 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1428/2837] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:11:23 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:24.119539 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0bf54-7d39-467d-8e3a-345b8cb9fbb5 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:24.129194 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0bf54-7d39-467d-8e3a-345b8cb9fbb5 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:24.130667 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82b766-4833-45cb-9f65-8349828c6774 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:24.133942 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffd265-8961-4812-906c-8960ec263fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:24.134580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffd265-8961-4812-906c-8960ec263fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:24.134865 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffd265-8961-4812-906c-8960ec263fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:24.135141 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffd265-8961-4812-906c-8960ec263fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:24.135830 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffd265-8961-4812-906c-8960ec263fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:24.136037 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651408d0-7920-4f83-83e2-10293c81a406 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '462ecbb85c6b4a17a952fb74fa2de65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:24.136921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651408d0-7920-4f83-83e2-10293c81a406 service swift] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:24.137458 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffd265-8961-4812-906c-8960ec263fc6 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:24.137592 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651408d0-7920-4f83-83e2-10293c81a406 service swift] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:24.137907 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651408d0-7920-4f83-83e2-10293c81a406 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:24.147059 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651408d0-7920-4f83-83e2-10293c81a406 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:24.147655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1429/2838] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:11:24.148802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651408d0-7920-4f83-83e2-10293c81a406 service swift] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:24.151526 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffd265-8961-4812-906c-8960ec263fc6 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:24.157524 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1410/2839] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jul 26 15:11:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 15:11:24.168749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffd265-8961-4812-906c-8960ec263fc6 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:24.173766 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69b3b2-61e5-4340-9188-ac2be956cd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:24.174496 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69b3b2-61e5-4340-9188-ac2be956cd2a admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:24.174854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69b3b2-61e5-4340-9188-ac2be956cd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:24.175209 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69b3b2-61e5-4340-9188-ac2be956cd2a admin admin] PATH_INFO: `/v3/projects/b64d8a05cc2545b99fe21b219a9570a4/users/45708a546cef44948667e1addaf291d2/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:24.192196 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69b3b2-61e5-4340-9188-ac2be956cd2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64d8a05cc2545b99fe21b219a9570a4, user_id=45708a546cef44948667e1addaf291d2, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:24.194899 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69b3b2-61e5-4340-9188-ac2be956cd2a admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:24.281048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1430/2840] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:11:24 2022] PUT /identity/v3/projects/b64d8a05cc2545b99fe21b219a9570a4/users/45708a546cef44948667e1addaf291d2/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:11:24.285088 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651408d0-7920-4f83-83e2-10293c81a406 service swift] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:24.296817 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651408d0-7920-4f83-83e2-10293c81a406 service swift] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:24.356631 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f710943-4bd7-40cd-a7e2-1f86467b0b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:24.357265 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f710943-4bd7-40cd-a7e2-1f86467b0b9b admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:24.357690 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f710943-4bd7-40cd-a7e2-1f86467b0b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:24.358169 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f710943-4bd7-40cd-a7e2-1f86467b0b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:24.359490 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f710943-4bd7-40cd-a7e2-1f86467b0b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:24.362580 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f710943-4bd7-40cd-a7e2-1f86467b0b9b admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:24.381586 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1411/2841] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:24.385722 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69b3b2-61e5-4340-9188-ac2be956cd2a admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:24.396778 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69b3b2-61e5-4340-9188-ac2be956cd2a admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:24.401971 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e0c52-3ef2-4067-86f8-16807cd328c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:24.402735 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e0c52-3ef2-4067-86f8-16807cd328c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:24.403020 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e0c52-3ef2-4067-86f8-16807cd328c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:24.403296 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e0c52-3ef2-4067-86f8-16807cd328c7 admin admin] PATH_INFO: `/v3/projects/b64d8a05cc2545b99fe21b219a9570a4/users/45708a546cef44948667e1addaf291d2/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:24.405246 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e0c52-3ef2-4067-86f8-16807cd328c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64d8a05cc2545b99fe21b219a9570a4, user_id=45708a546cef44948667e1addaf291d2, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:24.407984 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e0c52-3ef2-4067-86f8-16807cd328c7 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:24.419218 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1431/2842] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:11:24 2022] PUT /identity/v3/projects/b64d8a05cc2545b99fe21b219a9570a4/users/45708a546cef44948667e1addaf291d2/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:24.429536 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e250db-1c2d-4278-a5e8-610ce426e5d2 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:24.429770 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e250db-1c2d-4278-a5e8-610ce426e5d2 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:24.430048 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e250db-1c2d-4278-a5e8-610ce426e5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:24.457629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-36e250db-1c2d-4278-a5e8-610ce426e5d2 None None] MFA Rules not processed for user `45708a546cef44948667e1addaf291d2`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:24.458884 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-36e250db-1c2d-4278-a5e8-610ce426e5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:24.509235 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:24.535622 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1412/2843] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:24.540173 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e0c52-3ef2-4067-86f8-16807cd328c7 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:24.541934 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-039e0c52-3ef2-4067-86f8-16807cd328c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:24.601569 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e0c52-3ef2-4067-86f8-16807cd328c7 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:24.605334 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40fa07-6db8-40f7-a872-90249660de4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:24.605977 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40fa07-6db8-40f7-a872-90249660de4d service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:24.606257 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40fa07-6db8-40f7-a872-90249660de4d service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:24.606573 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40fa07-6db8-40f7-a872-90249660de4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:24.672197 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40fa07-6db8-40f7-a872-90249660de4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:24.672197 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40fa07-6db8-40f7-a872-90249660de4d service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:24.679918 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1432/2844] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:24.807001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04c813-9604-4949-bf6d-2bcee574b5b3 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:24.807001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04c813-9604-4949-bf6d-2bcee574b5b3 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:24.807001 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04c813-9604-4949-bf6d-2bcee574b5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:24.825512 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-8e04c813-9604-4949-bf6d-2bcee574b5b3 None None] MFA Rules not processed for user `0834be7405cd4c968763099251d37154`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:24.826767 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8e04c813-9604-4949-bf6d-2bcee574b5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:24.883874 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1413/2845] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jul 26 15:11:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:24.895676 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40fa07-6db8-40f7-a872-90249660de4d service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:24.904523 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:24.963177 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40fa07-6db8-40f7-a872-90249660de4d service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:24.968513 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258c1d0-ff22-4763-b974-8abb51f20d92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '462ecbb85c6b4a17a952fb74fa2de65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:24.969137 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258c1d0-ff22-4763-b974-8abb51f20d92 service swift] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:24.969425 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258c1d0-ff22-4763-b974-8abb51f20d92 service swift] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:24.969705 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258c1d0-ff22-4763-b974-8abb51f20d92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:24.978453 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258c1d0-ff22-4763-b974-8abb51f20d92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:24.980047 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258c1d0-ff22-4763-b974-8abb51f20d92 service swift] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:24.988058 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1433/2846] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jul 26 15:11:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:25.704080 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bae29-b9df-4745-9073-38824cede042 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:25.704368 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bae29-b9df-4745-9073-38824cede042 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:25.704664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bae29-b9df-4745-9073-38824cede042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:25.724805 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-477bae29-b9df-4745-9073-38824cede042 None None] MFA Rules not processed for user `0834be7405cd4c968763099251d37154`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:25.726054 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-477bae29-b9df-4745-9073-38824cede042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:25.733485 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1414/2847] 10.222.0.86 () {58 vars in 967 bytes} [Tue Jul 26 15:11:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:25.745486 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258c1d0-ff22-4763-b974-8abb51f20d92 service swift] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:25.757344 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258c1d0-ff22-4763-b974-8abb51f20d92 service swift] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:25.763235 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f60acd-f666-4ba4-82b4-46ebf45b8efa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '462ecbb85c6b4a17a952fb74fa2de65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:25.763844 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f60acd-f666-4ba4-82b4-46ebf45b8efa service swift] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:25.764392 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f60acd-f666-4ba4-82b4-46ebf45b8efa service swift] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:25.764551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f60acd-f666-4ba4-82b4-46ebf45b8efa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:25.773451 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f60acd-f666-4ba4-82b4-46ebf45b8efa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:25.775049 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f60acd-f666-4ba4-82b4-46ebf45b8efa service swift] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:25.783339 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1434/2848] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jul 26 15:11:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:28.550283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bae29-b9df-4745-9073-38824cede042 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:28.551745 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-477bae29-b9df-4745-9073-38824cede042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:28.617628 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bae29-b9df-4745-9073-38824cede042 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:28.622176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec34ff-e88a-4fbf-94e9-36fc8f728e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:28.622853 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec34ff-e88a-4fbf-94e9-36fc8f728e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:28.623136 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec34ff-e88a-4fbf-94e9-36fc8f728e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:28.625407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec34ff-e88a-4fbf-94e9-36fc8f728e85 admin admin] PATH_INFO: `/v3/users/306d0fab2d4149cf82a1a3a2f8aece53` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:28.625407 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec34ff-e88a-4fbf-94e9-36fc8f728e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=306d0fab2d4149cf82a1a3a2f8aece53)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:28.626505 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec34ff-e88a-4fbf-94e9-36fc8f728e85 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:28.764725 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f60acd-f666-4ba4-82b4-46ebf45b8efa service swift] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:28.775080 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f60acd-f666-4ba4-82b4-46ebf45b8efa service swift] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:28.779920 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fa171-3a4e-49f1-90d4-5c351df8d80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:28.780585 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fa171-3a4e-49f1-90d4-5c351df8d80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:28.780869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fa171-3a4e-49f1-90d4-5c351df8d80d admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:28.781147 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fa171-3a4e-49f1-90d4-5c351df8d80d admin admin] PATH_INFO: `/v3/users/9480ab45afb6439c90041de870d85934` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:28.782310 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fa171-3a4e-49f1-90d4-5c351df8d80d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9480ab45afb6439c90041de870d85934)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:28.784400 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fa171-3a4e-49f1-90d4-5c351df8d80d admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:28.811448 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-27ec34ff-e88a-4fbf-94e9-36fc8f728e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '306d0fab2d4149cf82a1a3a2f8aece53'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:28.818577 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-27ec34ff-e88a-4fbf-94e9-36fc8f728e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '306d0fab2d4149cf82a1a3a2f8aece53'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:28.830926 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-27ec34ff-e88a-4fbf-94e9-36fc8f728e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '306d0fab2d4149cf82a1a3a2f8aece53'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:28.831607 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-27ec34ff-e88a-4fbf-94e9-36fc8f728e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '306d0fab2d4149cf82a1a3a2f8aece53'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:28.832212 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-27ec34ff-e88a-4fbf-94e9-36fc8f728e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '306d0fab2d4149cf82a1a3a2f8aece53'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:28.909327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1415/2849] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:11:28 2022] DELETE /identity/v3/users/306d0fab2d4149cf82a1a3a2f8aece53 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:28.914499 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722e36f-b05f-4025-8378-94c2e714ecf9 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:28.914796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722e36f-b05f-4025-8378-94c2e714ecf9 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:28.915075 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722e36f-b05f-4025-8378-94c2e714ecf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:28.933914 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-f722e36f-b05f-4025-8378-94c2e714ecf9 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:28.935124 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f722e36f-b05f-4025-8378-94c2e714ecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:28.939162 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:28.963559 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-647fa171-3a4e-49f1-90d4-5c351df8d80d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9480ab45afb6439c90041de870d85934'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:28.964398 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-647fa171-3a4e-49f1-90d4-5c351df8d80d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9480ab45afb6439c90041de870d85934'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:28.976979 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-647fa171-3a4e-49f1-90d4-5c351df8d80d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9480ab45afb6439c90041de870d85934'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:28.994966 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1416/2850] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:11:29.008800 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722e36f-b05f-4025-8378-94c2e714ecf9 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:29.010253 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-f722e36f-b05f-4025-8378-94c2e714ecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:29.063296 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-647fa171-3a4e-49f1-90d4-5c351df8d80d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9480ab45afb6439c90041de870d85934'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:29.063903 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-647fa171-3a4e-49f1-90d4-5c351df8d80d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9480ab45afb6439c90041de870d85934'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:29.069670 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722e36f-b05f-4025-8378-94c2e714ecf9 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:29.074382 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77671c-ea9a-412a-8c0b-f0398193b946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:29.075038 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77671c-ea9a-412a-8c0b-f0398193b946 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:29.075319 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77671c-ea9a-412a-8c0b-f0398193b946 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:29.075593 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77671c-ea9a-412a-8c0b-f0398193b946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:29.077466 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4a77671c-ea9a-412a-8c0b-f0398193b946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:29.078708 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1435/2851] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:11:28 2022] DELETE /identity/v3/users/9480ab45afb6439c90041de870d85934 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:11:29.083041 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4460a-e304-4eac-98dc-1eee8eb54d22 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:29.083329 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4460a-e304-4eac-98dc-1eee8eb54d22 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:29.083610 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4460a-e304-4eac-98dc-1eee8eb54d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:29.090963 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77671c-ea9a-412a-8c0b-f0398193b946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:29.092460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77671c-ea9a-412a-8c0b-f0398193b946 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:29.103504 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1417/2852] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:11:29.104676 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-93e4460a-e304-4eac-98dc-1eee8eb54d22 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:29.106035 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-93e4460a-e304-4eac-98dc-1eee8eb54d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:29.161857 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:29.172314 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1436/2853] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:11:29.182823 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77671c-ea9a-412a-8c0b-f0398193b946 service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:29.191006 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4a77671c-ea9a-412a-8c0b-f0398193b946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:29.197284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77671c-ea9a-412a-8c0b-f0398193b946 service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:29.251184 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a774bf-69f5-4542-b917-175bfd8cce68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:29.251868 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a774bf-69f5-4542-b917-175bfd8cce68 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:29.252157 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a774bf-69f5-4542-b917-175bfd8cce68 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:29.252433 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a774bf-69f5-4542-b917-175bfd8cce68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:29.266828 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a774bf-69f5-4542-b917-175bfd8cce68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:29.268272 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a774bf-69f5-4542-b917-175bfd8cce68 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:29.278771 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1418/2854] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:29.431854 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4460a-e304-4eac-98dc-1eee8eb54d22 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:29.433390 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-93e4460a-e304-4eac-98dc-1eee8eb54d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:29.454134 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4460a-e304-4eac-98dc-1eee8eb54d22 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:29.459091 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba42edf-07d4-42d0-ad37-96921ccf7afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:29.459749 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba42edf-07d4-42d0-ad37-96921ccf7afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:29.460048 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba42edf-07d4-42d0-ad37-96921ccf7afb admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:29.460314 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba42edf-07d4-42d0-ad37-96921ccf7afb admin admin] PATH_INFO: `/v3/projects/b23a31977f8d4729aa5ed6e29a93ab6b` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:29.461515 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba42edf-07d4-42d0-ad37-96921ccf7afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b23a31977f8d4729aa5ed6e29a93ab6b)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:29.466904 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba42edf-07d4-42d0-ad37-96921ccf7afb admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:29.613436 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9ba42edf-07d4-42d0-ad37-96921ccf7afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b23a31977f8d4729aa5ed6e29a93ab6b', 'request_id': 'req-9ba42edf-07d4-42d0-ad37-96921ccf7afb'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:29.621892 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9ba42edf-07d4-42d0-ad37-96921ccf7afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b23a31977f8d4729aa5ed6e29a93ab6b', 'request_id': 'req-9ba42edf-07d4-42d0-ad37-96921ccf7afb'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:29.628413 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9ba42edf-07d4-42d0-ad37-96921ccf7afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b23a31977f8d4729aa5ed6e29a93ab6b', 'request_id': 'req-9ba42edf-07d4-42d0-ad37-96921ccf7afb'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:29.698103 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9ba42edf-07d4-42d0-ad37-96921ccf7afb admin admin] The token cache is being invalidate because project b23a31977f8d4729aa5ed6e29a93ab6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:11:29.698346 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9ba42edf-07d4-42d0-ad37-96921ccf7afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:29.699038 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-9ba42edf-07d4-42d0-ad37-96921ccf7afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:29.700836 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1437/2855] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:11:29 2022] DELETE /identity/v3/projects/b23a31977f8d4729aa5ed6e29a93ab6b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:29.710025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88ca6d-e9fe-4838-a539-6f4f98cb2c7d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:29.710025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88ca6d-e9fe-4838-a539-6f4f98cb2c7d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:29.710025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88ca6d-e9fe-4838-a539-6f4f98cb2c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:29.728520 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-1f88ca6d-e9fe-4838-a539-6f4f98cb2c7d None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:29.729909 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-1f88ca6d-e9fe-4838-a539-6f4f98cb2c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:29.783646 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:29.796379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1419/2856] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:11:29.804694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077943bf-a254-4fd2-acd3-a7da634a44f1 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:29.805284 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077943bf-a254-4fd2-acd3-a7da634a44f1 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:29.805284 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077943bf-a254-4fd2-acd3-a7da634a44f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:29.825472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-077943bf-a254-4fd2-acd3-a7da634a44f1 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:29.826743 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-077943bf-a254-4fd2-acd3-a7da634a44f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:29.835518 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1438/2857] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:29.840037 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88ca6d-e9fe-4838-a539-6f4f98cb2c7d None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:29.850069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88ca6d-e9fe-4838-a539-6f4f98cb2c7d None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:29.855553 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087cdb3-23bf-4905-b36f-475c544b93ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:29.856189 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087cdb3-23bf-4905-b36f-475c544b93ed admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:29.856612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087cdb3-23bf-4905-b36f-475c544b93ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:29.856899 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087cdb3-23bf-4905-b36f-475c544b93ed admin admin] PATH_INFO: `/v3/domains` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:29.857619 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087cdb3-23bf-4905-b36f-475c544b93ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:29.857931 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087cdb3-23bf-4905-b36f-475c544b93ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:29.859596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087cdb3-23bf-4905-b36f-475c544b93ed admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:29.875545 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1420/2858] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:29.877012 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077943bf-a254-4fd2-acd3-a7da634a44f1 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:29.887244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077943bf-a254-4fd2-acd3-a7da634a44f1 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:29.892247 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39284a6-5611-4a93-a72a-4494b2be1096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:29.892875 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39284a6-5611-4a93-a72a-4494b2be1096 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:29.893159 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39284a6-5611-4a93-a72a-4494b2be1096 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:29.893433 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39284a6-5611-4a93-a72a-4494b2be1096 admin admin] PATH_INFO: `/v3/projects` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:29.894118 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39284a6-5611-4a93-a72a-4494b2be1096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:29.896078 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39284a6-5611-4a93-a72a-4494b2be1096 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:29.982186 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1439/2859] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:11:29 2022] POST /identity/v3/projects => generated 397 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:29.986337 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087cdb3-23bf-4905-b36f-475c544b93ed admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:29.996796 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087cdb3-23bf-4905-b36f-475c544b93ed admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:30.050787 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39284a6-5611-4a93-a72a-4494b2be1096 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:30.051557 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c39284a6-5611-4a93-a72a-4494b2be1096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:30.056555 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c71314-e611-4d8a-ae80-4b3bce41409c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:30.057279 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c71314-e611-4d8a-ae80-4b3bce41409c admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:30.057565 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c71314-e611-4d8a-ae80-4b3bce41409c admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:30.057843 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c71314-e611-4d8a-ae80-4b3bce41409c admin admin] PATH_INFO: `/v3/users` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:30.058695 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c71314-e611-4d8a-ae80-4b3bce41409c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:30.060877 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c71314-e611-4d8a-ae80-4b3bce41409c admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:30.065869 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39284a6-5611-4a93-a72a-4494b2be1096 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:30.071308 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2129ed5-080c-4d95-bd3c-ba4997e7c553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:30.072694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2129ed5-080c-4d95-bd3c-ba4997e7c553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:30.073075 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2129ed5-080c-4d95-bd3c-ba4997e7c553 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:30.073533 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2129ed5-080c-4d95-bd3c-ba4997e7c553 admin admin] PATH_INFO: `/v3/projects/8e14d64cee6e41c49ab307fafaed60ea` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:30.075251 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2129ed5-080c-4d95-bd3c-ba4997e7c553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e14d64cee6e41c49ab307fafaed60ea)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:30.079825 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2129ed5-080c-4d95-bd3c-ba4997e7c553 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:30.155776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1421/2860] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:11:29 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:11:30.159799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c71314-e611-4d8a-ae80-4b3bce41409c admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:30.170220 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c71314-e611-4d8a-ae80-4b3bce41409c admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:30.174942 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd1c0b-e261-4db5-878a-e369438bd353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:30.175525 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd1c0b-e261-4db5-878a-e369438bd353 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:30.175809 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd1c0b-e261-4db5-878a-e369438bd353 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:30.176087 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd1c0b-e261-4db5-878a-e369438bd353 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:30.176835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd1c0b-e261-4db5-878a-e369438bd353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:30.179089 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd1c0b-e261-4db5-878a-e369438bd353 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:30.193757 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1422/2861] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:11:30.197889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c2129ed5-080c-4d95-bd3c-ba4997e7c553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e14d64cee6e41c49ab307fafaed60ea', 'request_id': 'req-c2129ed5-080c-4d95-bd3c-ba4997e7c553'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:30.200376 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd1c0b-e261-4db5-878a-e369438bd353 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:30.204498 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c2129ed5-080c-4d95-bd3c-ba4997e7c553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e14d64cee6e41c49ab307fafaed60ea', 'request_id': 'req-c2129ed5-080c-4d95-bd3c-ba4997e7c553'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:30.210605 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd1c0b-e261-4db5-878a-e369438bd353 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:30.210765 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c2129ed5-080c-4d95-bd3c-ba4997e7c553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e14d64cee6e41c49ab307fafaed60ea', 'request_id': 'req-c2129ed5-080c-4d95-bd3c-ba4997e7c553'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:30.267795 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bd07b-b24a-4c41-b685-91d1188a25ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:30.268420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bd07b-b24a-4c41-b685-91d1188a25ca admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:30.268704 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bd07b-b24a-4c41-b685-91d1188a25ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:30.268982 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bd07b-b24a-4c41-b685-91d1188a25ca admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:30.269673 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bd07b-b24a-4c41-b685-91d1188a25ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:30.271309 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bd07b-b24a-4c41-b685-91d1188a25ca admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:30.281502 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1423/2862] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:30.285667 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bd07b-b24a-4c41-b685-91d1188a25ca admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:30.296333 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bd07b-b24a-4c41-b685-91d1188a25ca admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:30.300978 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a45ed-81d9-49b4-a27f-a0a4e3454d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:30.301620 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a45ed-81d9-49b4-a27f-a0a4e3454d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:30.301900 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a45ed-81d9-49b4-a27f-a0a4e3454d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:30.302173 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a45ed-81d9-49b4-a27f-a0a4e3454d37 admin admin] PATH_INFO: `/v3/projects/100b41367aad4f0d8b70cc61e5edab6a/users/ed57ee2816164e77a49a1bdbdb89c68d/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:30.318634 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a45ed-81d9-49b4-a27f-a0a4e3454d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100b41367aad4f0d8b70cc61e5edab6a, user_id=ed57ee2816164e77a49a1bdbdb89c68d, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:30.321286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a45ed-81d9-49b4-a27f-a0a4e3454d37 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:30.326692 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c2129ed5-080c-4d95-bd3c-ba4997e7c553 admin admin] The token cache is being invalidate because project 8e14d64cee6e41c49ab307fafaed60ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:11:30.327457 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c2129ed5-080c-4d95-bd3c-ba4997e7c553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:30.328286 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-c2129ed5-080c-4d95-bd3c-ba4997e7c553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:30.330645 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1440/2863] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:11:30 2022] DELETE /identity/v3/projects/8e14d64cee6e41c49ab307fafaed60ea => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:11:30.343068 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2129ed5-080c-4d95-bd3c-ba4997e7c553 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:30.347081 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-c2129ed5-080c-4d95-bd3c-ba4997e7c553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:30.360240 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2129ed5-080c-4d95-bd3c-ba4997e7c553 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:30.364807 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1d021-9fec-49eb-80eb-43c8d0f061ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:30.365430 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1d021-9fec-49eb-80eb-43c8d0f061ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:30.367085 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1d021-9fec-49eb-80eb-43c8d0f061ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:30.367085 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1d021-9fec-49eb-80eb-43c8d0f061ae admin admin] PATH_INFO: `/v3/users/45708a546cef44948667e1addaf291d2` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:30.367882 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1d021-9fec-49eb-80eb-43c8d0f061ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=45708a546cef44948667e1addaf291d2)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:30.369889 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1d021-9fec-49eb-80eb-43c8d0f061ae admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:30.441946 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1424/2864] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:11:30 2022] PUT /identity/v3/projects/100b41367aad4f0d8b70cc61e5edab6a/users/ed57ee2816164e77a49a1bdbdb89c68d/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:11:30.454113 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad705fd-92cc-4fc2-b687-ac885a6ae31d None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:30.454846 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad705fd-92cc-4fc2-b687-ac885a6ae31d None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:30.454846 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad705fd-92cc-4fc2-b687-ac885a6ae31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:30.471325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:30.488608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-2ad705fd-92cc-4fc2-b687-ac885a6ae31d None None] MFA Rules not processed for user `ed57ee2816164e77a49a1bdbdb89c68d`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:30.489842 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2ad705fd-92cc-4fc2-b687-ac885a6ae31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:30.510418 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:30.554323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1425/2865] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:11:30.565952 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad705fd-92cc-4fc2-b687-ac885a6ae31d None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:30.567369 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2ad705fd-92cc-4fc2-b687-ac885a6ae31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:30.570633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-27f1d021-9fec-49eb-80eb-43c8d0f061ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45708a546cef44948667e1addaf291d2'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:30.571311 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-27f1d021-9fec-49eb-80eb-43c8d0f061ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45708a546cef44948667e1addaf291d2'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:30.582841 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-27f1d021-9fec-49eb-80eb-43c8d0f061ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45708a546cef44948667e1addaf291d2'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:30.623921 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad705fd-92cc-4fc2-b687-ac885a6ae31d None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:30.627599 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2190d-e714-4de9-9770-f8e898ffc034 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:30.628230 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2190d-e714-4de9-9770-f8e898ffc034 service cinder] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:30.628498 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2190d-e714-4de9-9770-f8e898ffc034 service cinder] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:30.628775 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2190d-e714-4de9-9770-f8e898ffc034 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:30.637230 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2190d-e714-4de9-9770-f8e898ffc034 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:30.638746 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2190d-e714-4de9-9770-f8e898ffc034 service cinder] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:30.647996 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1426/2866] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:11:30.704323 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-27f1d021-9fec-49eb-80eb-43c8d0f061ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45708a546cef44948667e1addaf291d2'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:30.705325 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-27f1d021-9fec-49eb-80eb-43c8d0f061ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45708a546cef44948667e1addaf291d2'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:30.721198 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1441/2867] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:11:30 2022] DELETE /identity/v3/users/45708a546cef44948667e1addaf291d2 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:11:31.181345 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2190d-e714-4de9-9770-f8e898ffc034 service cinder] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:31.246898 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2190d-e714-4de9-9770-f8e898ffc034 service cinder] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:31.303570 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020a864-61e4-43ee-a08e-e5ee86b90bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:31.304222 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020a864-61e4-43ee-a08e-e5ee86b90bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:31.304505 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020a864-61e4-43ee-a08e-e5ee86b90bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:31.304779 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020a864-61e4-43ee-a08e-e5ee86b90bbd admin admin] PATH_INFO: `/v3/projects/b64d8a05cc2545b99fe21b219a9570a4` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:31.305931 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020a864-61e4-43ee-a08e-e5ee86b90bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b64d8a05cc2545b99fe21b219a9570a4)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:31.307905 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020a864-61e4-43ee-a08e-e5ee86b90bbd admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:31.323379 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=100 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:31.450293 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-8020a864-61e4-43ee-a08e-e5ee86b90bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b64d8a05cc2545b99fe21b219a9570a4', 'request_id': 'req-8020a864-61e4-43ee-a08e-e5ee86b90bbd'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:31.457315 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-8020a864-61e4-43ee-a08e-e5ee86b90bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b64d8a05cc2545b99fe21b219a9570a4', 'request_id': 'req-8020a864-61e4-43ee-a08e-e5ee86b90bbd'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:31.566358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-8020a864-61e4-43ee-a08e-e5ee86b90bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b64d8a05cc2545b99fe21b219a9570a4', 'request_id': 'req-8020a864-61e4-43ee-a08e-e5ee86b90bbd'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:31.578102 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-8020a864-61e4-43ee-a08e-e5ee86b90bbd admin admin] The token cache is being invalidate because project b64d8a05cc2545b99fe21b219a9570a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:11:31.578415 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-8020a864-61e4-43ee-a08e-e5ee86b90bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:31.579108 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-8020a864-61e4-43ee-a08e-e5ee86b90bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:31.580626 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1427/2868] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:11:31 2022] DELETE /identity/v3/projects/b64d8a05cc2545b99fe21b219a9570a4 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:31.586958 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d537a6-4dd5-4857-ad47-1bcc20f2b43f None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:31.587460 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d537a6-4dd5-4857-ad47-1bcc20f2b43f None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:31.587564 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d537a6-4dd5-4857-ad47-1bcc20f2b43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:31.606972 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-e0d537a6-4dd5-4857-ad47-1bcc20f2b43f None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:31.608171 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-e0d537a6-4dd5-4857-ad47-1bcc20f2b43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:31.669632 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1442/2869] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:31.678408 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e3138-509b-4497-8df6-ef5be2a70938 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:31.678735 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e3138-509b-4497-8df6-ef5be2a70938 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:31.679078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e3138-509b-4497-8df6-ef5be2a70938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:31.699296 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-ba6e3138-509b-4497-8df6-ef5be2a70938 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:31.702078 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-ba6e3138-509b-4497-8df6-ef5be2a70938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:31.708733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1428/2870] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:31.713505 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d537a6-4dd5-4857-ad47-1bcc20f2b43f None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:31.723321 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d537a6-4dd5-4857-ad47-1bcc20f2b43f None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:31.728099 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8587e-4776-4370-b2a5-20c5161b1d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:31.728715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8587e-4776-4370-b2a5-20c5161b1d3d admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:31.731176 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8587e-4776-4370-b2a5-20c5161b1d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:31.731176 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8587e-4776-4370-b2a5-20c5161b1d3d admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:31.731176 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8587e-4776-4370-b2a5-20c5161b1d3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:31.731176 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8587e-4776-4370-b2a5-20c5161b1d3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:31.731878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8587e-4776-4370-b2a5-20c5161b1d3d admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:31.743810 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1443/2871] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:31.748285 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e3138-509b-4497-8df6-ef5be2a70938 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:31.758199 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e3138-509b-4497-8df6-ef5be2a70938 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:31.765343 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c8d49-7cdd-482e-a8d1-e106269d36bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:31.765343 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c8d49-7cdd-482e-a8d1-e106269d36bc admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:31.765343 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c8d49-7cdd-482e-a8d1-e106269d36bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:31.765343 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c8d49-7cdd-482e-a8d1-e106269d36bc admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:31.765712 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c8d49-7cdd-482e-a8d1-e106269d36bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:31.766637 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c8d49-7cdd-482e-a8d1-e106269d36bc admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:31.906381 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1429/2872] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:11:31 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:11:31.910584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8587e-4776-4370-b2a5-20c5161b1d3d admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:31.921699 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8587e-4776-4370-b2a5-20c5161b1d3d admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:31.978907 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d79283-47f7-48fb-8a30-d7ed01420ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:31.979442 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d79283-47f7-48fb-8a30-d7ed01420ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:31.979725 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d79283-47f7-48fb-8a30-d7ed01420ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:31.980003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d79283-47f7-48fb-8a30-d7ed01420ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:31.980674 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d79283-47f7-48fb-8a30-d7ed01420ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:31.982615 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d79283-47f7-48fb-8a30-d7ed01420ac2 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:32.057647 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1444/2873] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:11:31 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:11:32.061732 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c8d49-7cdd-482e-a8d1-e106269d36bc admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:32.072321 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c8d49-7cdd-482e-a8d1-e106269d36bc admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:32.076971 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1094a-1390-41d6-9595-32cc88bc88a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:32.077573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1094a-1390-41d6-9595-32cc88bc88a4 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:32.077855 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1094a-1390-41d6-9595-32cc88bc88a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:32.078127 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1094a-1390-41d6-9595-32cc88bc88a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:32.078884 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1094a-1390-41d6-9595-32cc88bc88a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:32.080552 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1094a-1390-41d6-9595-32cc88bc88a4 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:32.091416 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1430/2874] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:32.095261 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d79283-47f7-48fb-8a30-d7ed01420ac2 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:32.106193 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d79283-47f7-48fb-8a30-d7ed01420ac2 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:32.110848 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7f6fa-61ba-4d46-b972-c6a393b73e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:32.111450 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7f6fa-61ba-4d46-b972-c6a393b73e00 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:32.111731 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7f6fa-61ba-4d46-b972-c6a393b73e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:32.112005 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7f6fa-61ba-4d46-b972-c6a393b73e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:32.112698 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7f6fa-61ba-4d46-b972-c6a393b73e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:32.114271 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7f6fa-61ba-4d46-b972-c6a393b73e00 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:32.125069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1445/2875] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:32.129158 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1094a-1390-41d6-9595-32cc88bc88a4 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:32.139257 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1094a-1390-41d6-9595-32cc88bc88a4 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:32.143794 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933fe61-0a3b-4ae9-966c-f3b545d101a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:32.144455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933fe61-0a3b-4ae9-966c-f3b545d101a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:32.144742 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933fe61-0a3b-4ae9-966c-f3b545d101a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:32.145024 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933fe61-0a3b-4ae9-966c-f3b545d101a7 admin admin] PATH_INFO: `/v3/projects/7c6a60857b694d1e8369d28c0cdd5897/users/5c709d50c3bd40b195b35ff8d4131b7b/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:32.160213 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933fe61-0a3b-4ae9-966c-f3b545d101a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6a60857b694d1e8369d28c0cdd5897, user_id=5c709d50c3bd40b195b35ff8d4131b7b, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:32.163532 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933fe61-0a3b-4ae9-966c-f3b545d101a7 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:32.246640 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1431/2876] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:11:32 2022] PUT /identity/v3/projects/7c6a60857b694d1e8369d28c0cdd5897/users/5c709d50c3bd40b195b35ff8d4131b7b/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:32.257549 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980b98f-5da0-4df0-8212-f96dbeaa98ae None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:32.257830 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980b98f-5da0-4df0-8212-f96dbeaa98ae None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:32.258101 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980b98f-5da0-4df0-8212-f96dbeaa98ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:32.278999 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:32.286088 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-0980b98f-5da0-4df0-8212-f96dbeaa98ae None None] MFA Rules not processed for user `5c709d50c3bd40b195b35ff8d4131b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:32.287327 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0980b98f-5da0-4df0-8212-f96dbeaa98ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:32.352317 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1446/2877] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:32.363814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933fe61-0a3b-4ae9-966c-f3b545d101a7 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:32.365474 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e933fe61-0a3b-4ae9-966c-f3b545d101a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:32.443076 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933fe61-0a3b-4ae9-966c-f3b545d101a7 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:32.446721 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70808f6-f221-4ee0-8aa5-479da6c8f071 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa31ecab10a6499f92da49bc7abb403a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:32.447334 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70808f6-f221-4ee0-8aa5-479da6c8f071 service glance] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:32.447612 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70808f6-f221-4ee0-8aa5-479da6c8f071 service glance] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:32.447881 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70808f6-f221-4ee0-8aa5-479da6c8f071 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:32.456037 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70808f6-f221-4ee0-8aa5-479da6c8f071 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:32.457446 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70808f6-f221-4ee0-8aa5-479da6c8f071 service glance] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:32.466477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1432/2878] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:37.795379 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980b98f-5da0-4df0-8212-f96dbeaa98ae None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:37.796815 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-0980b98f-5da0-4df0-8212-f96dbeaa98ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:37.868767 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980b98f-5da0-4df0-8212-f96dbeaa98ae None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:37.873501 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1fbaa-0f9d-43d6-bb3b-b2bc58cd51e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:37.874158 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1fbaa-0f9d-43d6-bb3b-b2bc58cd51e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:37.874472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1fbaa-0f9d-43d6-bb3b-b2bc58cd51e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:37.874758 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1fbaa-0f9d-43d6-bb3b-b2bc58cd51e5 admin admin] PATH_INFO: `/v3/users/ed57ee2816164e77a49a1bdbdb89c68d` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:37.875963 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1fbaa-0f9d-43d6-bb3b-b2bc58cd51e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed57ee2816164e77a49a1bdbdb89c68d)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:37.877897 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1fbaa-0f9d-43d6-bb3b-b2bc58cd51e5 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:38.077595 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-04f1fbaa-0f9d-43d6-bb3b-b2bc58cd51e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed57ee2816164e77a49a1bdbdb89c68d'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:38.078244 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-04f1fbaa-0f9d-43d6-bb3b-b2bc58cd51e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed57ee2816164e77a49a1bdbdb89c68d'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:38.090773 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-04f1fbaa-0f9d-43d6-bb3b-b2bc58cd51e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed57ee2816164e77a49a1bdbdb89c68d'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:38.183847 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-04f1fbaa-0f9d-43d6-bb3b-b2bc58cd51e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed57ee2816164e77a49a1bdbdb89c68d'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:38.184502 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-04f1fbaa-0f9d-43d6-bb3b-b2bc58cd51e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed57ee2816164e77a49a1bdbdb89c68d'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:38.197186 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1447/2879] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:11:37 2022] DELETE /identity/v3/users/ed57ee2816164e77a49a1bdbdb89c68d => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:38.201918 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdb846-ad8d-418e-ba97-ec9835c51cd7 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:38.202465 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdb846-ad8d-418e-ba97-ec9835c51cd7 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:38.202581 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdb846-ad8d-418e-ba97-ec9835c51cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:38.223522 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-1bcdb846-ad8d-418e-ba97-ec9835c51cd7 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:38.224726 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-1bcdb846-ad8d-418e-ba97-ec9835c51cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:38.241925 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:38.285562 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1433/2880] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:11:38.296266 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1fbaa-0f9d-43d6-bb3b-b2bc58cd51e5 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:38.296927 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-04f1fbaa-0f9d-43d6-bb3b-b2bc58cd51e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:38.318403 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:38.356293 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1fbaa-0f9d-43d6-bb3b-b2bc58cd51e5 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:38.359850 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fb7b7-7707-484d-b5ee-fb4474944736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:38.360466 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fb7b7-7707-484d-b5ee-fb4474944736 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:38.360748 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fb7b7-7707-484d-b5ee-fb4474944736 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:38.361024 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fb7b7-7707-484d-b5ee-fb4474944736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:38.370782 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fb7b7-7707-484d-b5ee-fb4474944736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:38.374727 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fb7b7-7707-484d-b5ee-fb4474944736 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:38.381682 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1448/2881] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:38.843693 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdb846-ad8d-418e-ba97-ec9835c51cd7 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:38.845232 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-1bcdb846-ad8d-418e-ba97-ec9835c51cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:38.858252 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdb846-ad8d-418e-ba97-ec9835c51cd7 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:38.863594 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30191e-c54d-40da-803d-aad6393fffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:38.868850 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30191e-c54d-40da-803d-aad6393fffa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:38.869214 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30191e-c54d-40da-803d-aad6393fffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:38.869517 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30191e-c54d-40da-803d-aad6393fffa9 admin admin] PATH_INFO: `/v3/projects/100b41367aad4f0d8b70cc61e5edab6a` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:38.870905 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30191e-c54d-40da-803d-aad6393fffa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=100b41367aad4f0d8b70cc61e5edab6a)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:38.872834 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30191e-c54d-40da-803d-aad6393fffa9 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:38.996337 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5d30191e-c54d-40da-803d-aad6393fffa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100b41367aad4f0d8b70cc61e5edab6a', 'request_id': 'req-5d30191e-c54d-40da-803d-aad6393fffa9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:39.003563 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5d30191e-c54d-40da-803d-aad6393fffa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100b41367aad4f0d8b70cc61e5edab6a', 'request_id': 'req-5d30191e-c54d-40da-803d-aad6393fffa9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:39.063821 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5d30191e-c54d-40da-803d-aad6393fffa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100b41367aad4f0d8b70cc61e5edab6a', 'request_id': 'req-5d30191e-c54d-40da-803d-aad6393fffa9'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:39.076335 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5d30191e-c54d-40da-803d-aad6393fffa9 admin admin] The token cache is being invalidate because project 100b41367aad4f0d8b70cc61e5edab6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:11:39.076677 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5d30191e-c54d-40da-803d-aad6393fffa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:39.077320 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-5d30191e-c54d-40da-803d-aad6393fffa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:11:39.079097 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1434/2882] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:11:38 2022] DELETE /identity/v3/projects/100b41367aad4f0d8b70cc61e5edab6a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:39.083893 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2df7da-1751-4085-bddb-8fba002aa854 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:39.084488 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2df7da-1751-4085-bddb-8fba002aa854 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:39.084488 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2df7da-1751-4085-bddb-8fba002aa854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:39.106489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-9d2df7da-1751-4085-bddb-8fba002aa854 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:39.107786 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-9d2df7da-1751-4085-bddb-8fba002aa854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:39.173239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1449/2883] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:39.181639 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce62c4a-472b-422e-967f-bfcf62f2dca7 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:39.181929 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce62c4a-472b-422e-967f-bfcf62f2dca7 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:39.182206 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce62c4a-472b-422e-967f-bfcf62f2dca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:39.202802 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-8ce62c4a-472b-422e-967f-bfcf62f2dca7 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:39.203998 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-8ce62c4a-472b-422e-967f-bfcf62f2dca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:39.212897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1435/2884] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:39.217216 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2df7da-1751-4085-bddb-8fba002aa854 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:39.227008 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2df7da-1751-4085-bddb-8fba002aa854 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:39.231832 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45df430-bfff-4e08-801d-e2f7e2df6ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:39.232472 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45df430-bfff-4e08-801d-e2f7e2df6ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:39.232805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45df430-bfff-4e08-801d-e2f7e2df6ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:39.233082 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45df430-bfff-4e08-801d-e2f7e2df6ff5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:39.233790 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45df430-bfff-4e08-801d-e2f7e2df6ff5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:39.234146 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45df430-bfff-4e08-801d-e2f7e2df6ff5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:39.235801 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45df430-bfff-4e08-801d-e2f7e2df6ff5 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:39.248073 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1450/2885] 10.222.0.86 () {58 vars in 1153 bytes} [Tue Jul 26 15:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:39.252725 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce62c4a-472b-422e-967f-bfcf62f2dca7 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:39.262995 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce62c4a-472b-422e-967f-bfcf62f2dca7 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:39.267705 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305847f-cb6e-412e-b70a-8043c22dd5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:39.268327 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305847f-cb6e-412e-b70a-8043c22dd5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:39.268608 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305847f-cb6e-412e-b70a-8043c22dd5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:39.268882 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305847f-cb6e-412e-b70a-8043c22dd5b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:39.269573 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305847f-cb6e-412e-b70a-8043c22dd5b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:39.271495 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305847f-cb6e-412e-b70a-8043c22dd5b3 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:39.391283 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1436/2886] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:11:39 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:39.395621 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45df430-bfff-4e08-801d-e2f7e2df6ff5 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:39.405751 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45df430-bfff-4e08-801d-e2f7e2df6ff5 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:39.468655 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93ceb1-fbdb-454d-a357-9b7b3b45d61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:39.469796 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93ceb1-fbdb-454d-a357-9b7b3b45d61b admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:39.470089 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93ceb1-fbdb-454d-a357-9b7b3b45d61b admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:39.470371 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93ceb1-fbdb-454d-a357-9b7b3b45d61b admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:39.471106 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93ceb1-fbdb-454d-a357-9b7b3b45d61b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:39.473066 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93ceb1-fbdb-454d-a357-9b7b3b45d61b admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:39.607861 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1451/2887] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:11:39 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:39.611848 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305847f-cb6e-412e-b70a-8043c22dd5b3 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:39.622435 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305847f-cb6e-412e-b70a-8043c22dd5b3 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:39.627195 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb415a3d-ecac-4fb7-b5a4-0f5fe2abfd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:39.627748 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb415a3d-ecac-4fb7-b5a4-0f5fe2abfd6d admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:39.628035 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb415a3d-ecac-4fb7-b5a4-0f5fe2abfd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:39.628404 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb415a3d-ecac-4fb7-b5a4-0f5fe2abfd6d admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:39.629020 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb415a3d-ecac-4fb7-b5a4-0f5fe2abfd6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:39.630711 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb415a3d-ecac-4fb7-b5a4-0f5fe2abfd6d admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:39.645814 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1437/2888] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:39.649256 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93ceb1-fbdb-454d-a357-9b7b3b45d61b admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:39.659356 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93ceb1-fbdb-454d-a357-9b7b3b45d61b admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:39.664766 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf71ff-06c2-4f74-87f1-e774293f1624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:39.665385 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf71ff-06c2-4f74-87f1-e774293f1624 admin admin] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:39.665670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf71ff-06c2-4f74-87f1-e774293f1624 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:39.665949 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf71ff-06c2-4f74-87f1-e774293f1624 admin admin] PATH_INFO: `/v3/roles` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:39.666666 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf71ff-06c2-4f74-87f1-e774293f1624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:39.668284 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf71ff-06c2-4f74-87f1-e774293f1624 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:39.679028 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1452/2889] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:39.683426 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb415a3d-ecac-4fb7-b5a4-0f5fe2abfd6d admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:39.695583 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb415a3d-ecac-4fb7-b5a4-0f5fe2abfd6d admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:39.700164 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561efb6e-122e-4717-b653-f5e5bbdc2a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:39.700830 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561efb6e-122e-4717-b653-f5e5bbdc2a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:39.701115 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561efb6e-122e-4717-b653-f5e5bbdc2a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:39.701419 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561efb6e-122e-4717-b653-f5e5bbdc2a81 admin admin] PATH_INFO: `/v3/projects/45cc7411d2744c5096a49c89eab3d92c/users/f8b861ce4be246e08b705a0c1ab9d212/roles/8303560a3b6948379f524afad4b798d0` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:39.716794 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561efb6e-122e-4717-b653-f5e5bbdc2a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45cc7411d2744c5096a49c89eab3d92c, user_id=f8b861ce4be246e08b705a0c1ab9d212, role_id=8303560a3b6948379f524afad4b798d0)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:39.719676 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561efb6e-122e-4717-b653-f5e5bbdc2a81 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:39.813897 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1438/2890] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:11:39 2022] PUT /identity/v3/projects/45cc7411d2744c5096a49c89eab3d92c/users/f8b861ce4be246e08b705a0c1ab9d212/roles/8303560a3b6948379f524afad4b798d0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:39.817923 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acb76e-c66f-4bc6-8c67-34b456782f42 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:39.818214 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acb76e-c66f-4bc6-8c67-34b456782f42 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:39.818533 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acb76e-c66f-4bc6-8c67-34b456782f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:39.838224 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-25acb76e-c66f-4bc6-8c67-34b456782f42 None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:39.839510 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-25acb76e-c66f-4bc6-8c67-34b456782f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:39.864147 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:39.927589 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1453/2891] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:39.929452 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561efb6e-122e-4717-b653-f5e5bbdc2a81 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:39.931460 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-561efb6e-122e-4717-b653-f5e5bbdc2a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:39.981989 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:39.994766 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561efb6e-122e-4717-b653-f5e5bbdc2a81 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:39.999036 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27434362-b10d-459c-ab48-9e9a438eb66d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:39.999686 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27434362-b10d-459c-ab48-9e9a438eb66d service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:39.999977 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27434362-b10d-459c-ab48-9e9a438eb66d service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:40.000259 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27434362-b10d-459c-ab48-9e9a438eb66d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:40.010446 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27434362-b10d-459c-ab48-9e9a438eb66d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:40.011873 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27434362-b10d-459c-ab48-9e9a438eb66d service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:40.021420 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1439/2892] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:45.592580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bee70c-8fd1-4e67-aa15-9aeabea668e0 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:45.593066 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bee70c-8fd1-4e67-aa15-9aeabea668e0 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:45.593314 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bee70c-8fd1-4e67-aa15-9aeabea668e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:45.634160 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-42bee70c-8fd1-4e67-aa15-9aeabea668e0 None None] MFA Rules not processed for user `f8b861ce4be246e08b705a0c1ab9d212`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:45.635551 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-42bee70c-8fd1-4e67-aa15-9aeabea668e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:45.711120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1454/2893] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:11:45.715494 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27434362-b10d-459c-ab48-9e9a438eb66d service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:45.726014 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27434362-b10d-459c-ab48-9e9a438eb66d service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:45.732244 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a4e16-118a-4018-941f-58b171be8754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:45.732244 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a4e16-118a-4018-941f-58b171be8754 admin admin] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:45.732244 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a4e16-118a-4018-941f-58b171be8754 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:45.732244 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a4e16-118a-4018-941f-58b171be8754 admin admin] PATH_INFO: `/v3/projects` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:45.732630 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a4e16-118a-4018-941f-58b171be8754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:45.734465 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a4e16-118a-4018-941f-58b171be8754 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:45.852803 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1440/2894] 10.222.0.86 () {60 vars in 1153 bytes} [Tue Jul 26 15:11:45 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:11:45.853956 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bee70c-8fd1-4e67-aa15-9aeabea668e0 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:45.865274 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bee70c-8fd1-4e67-aa15-9aeabea668e0 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:45.926633 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401a8e2-3572-454f-a85b-bae0e854a436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:45.927269 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401a8e2-3572-454f-a85b-bae0e854a436 admin admin] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:45.927558 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401a8e2-3572-454f-a85b-bae0e854a436 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:45.927843 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401a8e2-3572-454f-a85b-bae0e854a436 admin admin] PATH_INFO: `/v3/users` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:45.929113 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401a8e2-3572-454f-a85b-bae0e854a436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:45.931191 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401a8e2-3572-454f-a85b-bae0e854a436 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:46.059660 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1455/2895] 10.222.0.86 () {60 vars in 1144 bytes} [Tue Jul 26 15:11:45 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:11:46.063733 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a4e16-118a-4018-941f-58b171be8754 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:46.074682 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a4e16-118a-4018-941f-58b171be8754 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:46.079323 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b6b0c-36ce-4ba8-9143-0d8f3b11e6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:46.079967 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b6b0c-36ce-4ba8-9143-0d8f3b11e6cf admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:46.080249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b6b0c-36ce-4ba8-9143-0d8f3b11e6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:46.080587 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b6b0c-36ce-4ba8-9143-0d8f3b11e6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:46.081306 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b6b0c-36ce-4ba8-9143-0d8f3b11e6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:46.082934 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b6b0c-36ce-4ba8-9143-0d8f3b11e6cf admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:46.093764 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1441/2896] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:46.097960 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401a8e2-3572-454f-a85b-bae0e854a436 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:46.108437 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401a8e2-3572-454f-a85b-bae0e854a436 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:46.113025 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd62f86-cdfd-467f-b4a8-99ce85e53025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:46.113681 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62f86-cdfd-467f-b4a8-99ce85e53025 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:46.113964 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62f86-cdfd-467f-b4a8-99ce85e53025 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:46.114241 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62f86-cdfd-467f-b4a8-99ce85e53025 admin admin] PATH_INFO: `/v3/projects/198b576339cb4bb594578e64169170f4/users/245eab7dc2bc49238947d04a12904462/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:46.131527 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd62f86-cdfd-467f-b4a8-99ce85e53025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=198b576339cb4bb594578e64169170f4, user_id=245eab7dc2bc49238947d04a12904462, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:46.134236 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd62f86-cdfd-467f-b4a8-99ce85e53025 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:46.229361 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1456/2897] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:11:46 2022] PUT /identity/v3/projects/198b576339cb4bb594578e64169170f4/users/245eab7dc2bc49238947d04a12904462/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:46.233534 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b6b0c-36ce-4ba8-9143-0d8f3b11e6cf admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:46.243884 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b6b0c-36ce-4ba8-9143-0d8f3b11e6cf admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:46.301494 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df770ce-2c65-4999-983b-9d3d8d72cff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:46.302120 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df770ce-2c65-4999-983b-9d3d8d72cff9 admin admin] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:46.302440 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df770ce-2c65-4999-983b-9d3d8d72cff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:46.302709 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df770ce-2c65-4999-983b-9d3d8d72cff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:46.303975 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df770ce-2c65-4999-983b-9d3d8d72cff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:46.305557 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df770ce-2c65-4999-983b-9d3d8d72cff9 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:46.316189 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1442/2898] 10.222.0.86 () {58 vars in 1122 bytes} [Tue Jul 26 15:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:11:46.320944 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd62f86-cdfd-467f-b4a8-99ce85e53025 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:46.331857 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd62f86-cdfd-467f-b4a8-99ce85e53025 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:46.336622 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6a6b7-e28d-4eba-bd08-9c49c8859b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:46.337292 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6a6b7-e28d-4eba-bd08-9c49c8859b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:46.337580 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6a6b7-e28d-4eba-bd08-9c49c8859b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:46.337867 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6a6b7-e28d-4eba-bd08-9c49c8859b39 admin admin] PATH_INFO: `/v3/projects/198b576339cb4bb594578e64169170f4/users/245eab7dc2bc49238947d04a12904462/roles/2dbdd0a2fb714172ab27b1ceec0a3b80` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:46.340138 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6a6b7-e28d-4eba-bd08-9c49c8859b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=198b576339cb4bb594578e64169170f4, user_id=245eab7dc2bc49238947d04a12904462, role_id=2dbdd0a2fb714172ab27b1ceec0a3b80)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:46.342991 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6a6b7-e28d-4eba-bd08-9c49c8859b39 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:46.354330 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1457/2899] 10.222.0.86 () {60 vars in 1483 bytes} [Tue Jul 26 15:11:46 2022] PUT /identity/v3/projects/198b576339cb4bb594578e64169170f4/users/245eab7dc2bc49238947d04a12904462/roles/2dbdd0a2fb714172ab27b1ceec0a3b80 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:52.734728 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857e179-23b5-4fb1-bd69-b7e0f70af566 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.735595 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857e179-23b5-4fb1-bd69-b7e0f70af566 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.735879 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857e179-23b5-4fb1-bd69-b7e0f70af566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:52.772428 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-4857e179-23b5-4fb1-bd69-b7e0f70af566 None None] MFA Rules not processed for user `245eab7dc2bc49238947d04a12904462`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:52.773903 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4857e179-23b5-4fb1-bd69-b7e0f70af566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:52.849632 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1443/2900] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:11:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:52.863187 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6a6b7-e28d-4eba-bd08-9c49c8859b39 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:52.865002 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-39f6a6b7-e28d-4eba-bd08-9c49c8859b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:52.881307 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:52.942805 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6a6b7-e28d-4eba-bd08-9c49c8859b39 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:52.947188 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475df42-7986-48d3-a9a5-0bf0d15f93d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa31ecab10a6499f92da49bc7abb403a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:52.947857 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475df42-7986-48d3-a9a5-0bf0d15f93d5 service glance] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.948144 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475df42-7986-48d3-a9a5-0bf0d15f93d5 service glance] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.948530 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475df42-7986-48d3-a9a5-0bf0d15f93d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:53.008280 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475df42-7986-48d3-a9a5-0bf0d15f93d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:53.009740 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475df42-7986-48d3-a9a5-0bf0d15f93d5 service glance] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:53.019402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1458/2901] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:11:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:11:53.309835 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71787e93-d81a-43da-9201-957050fbd24b None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:53.310423 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71787e93-d81a-43da-9201-957050fbd24b None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:53.310738 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71787e93-d81a-43da-9201-957050fbd24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:53.331364 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-71787e93-d81a-43da-9201-957050fbd24b None None] MFA Rules not processed for user `0834be7405cd4c968763099251d37154`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:53.332575 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-71787e93-d81a-43da-9201-957050fbd24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:53.380615 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:53.417025 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1444/2902] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jul 26 15:11:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:11:53.439856 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475df42-7986-48d3-a9a5-0bf0d15f93d5 service glance] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:53.441349 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-5475df42-7986-48d3-a9a5-0bf0d15f93d5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:53.516383 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475df42-7986-48d3-a9a5-0bf0d15f93d5 service glance] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:53.521480 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895aa4dd-1cb9-4d4d-b565-5155f1a14f5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '462ecbb85c6b4a17a952fb74fa2de65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:53.522145 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895aa4dd-1cb9-4d4d-b565-5155f1a14f5d service swift] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:53.522457 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895aa4dd-1cb9-4d4d-b565-5155f1a14f5d service swift] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:53.522737 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895aa4dd-1cb9-4d4d-b565-5155f1a14f5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:53.532217 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895aa4dd-1cb9-4d4d-b565-5155f1a14f5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:53.533835 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895aa4dd-1cb9-4d4d-b565-5155f1a14f5d service swift] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:53.543884 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1459/2903] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jul 26 15:11:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:12:03.343844 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71787e93-d81a-43da-9201-957050fbd24b None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:03.346158 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-71787e93-d81a-43da-9201-957050fbd24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:03.423421 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71787e93-d81a-43da-9201-957050fbd24b None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:03.428444 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc32bd-a2fc-4644-a1cf-f0d19dd47875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:03.429217 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc32bd-a2fc-4644-a1cf-f0d19dd47875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:03.429510 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc32bd-a2fc-4644-a1cf-f0d19dd47875 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:03.429789 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc32bd-a2fc-4644-a1cf-f0d19dd47875 admin admin] PATH_INFO: `/v3/users/5c709d50c3bd40b195b35ff8d4131b7b` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:03.431012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc32bd-a2fc-4644-a1cf-f0d19dd47875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c709d50c3bd40b195b35ff8d4131b7b)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:03.432943 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc32bd-a2fc-4644-a1cf-f0d19dd47875 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:03.540005 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=75 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:03.655284 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-90fc32bd-a2fc-4644-a1cf-f0d19dd47875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c709d50c3bd40b195b35ff8d4131b7b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:12:03.662219 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-90fc32bd-a2fc-4644-a1cf-f0d19dd47875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c709d50c3bd40b195b35ff8d4131b7b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:12:03.675447 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-90fc32bd-a2fc-4644-a1cf-f0d19dd47875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c709d50c3bd40b195b35ff8d4131b7b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:12:03.680932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-90fc32bd-a2fc-4644-a1cf-f0d19dd47875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c709d50c3bd40b195b35ff8d4131b7b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:12:03.680932 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-90fc32bd-a2fc-4644-a1cf-f0d19dd47875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c709d50c3bd40b195b35ff8d4131b7b'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:12:03.779029 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1445/2904] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:12:03 2022] DELETE /identity/v3/users/5c709d50c3bd40b195b35ff8d4131b7b => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:12:03.783586 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6cc30-3c10-485f-8201-61718449cbaf None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:03.783872 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6cc30-3c10-485f-8201-61718449cbaf None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:03.786305 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6cc30-3c10-485f-8201-61718449cbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:03.803656 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-80f6cc30-3c10-485f-8201-61718449cbaf None None] MFA Rules not processed for user `2e478bb3d9ce498d853319db6606450c`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:03.804888 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-80f6cc30-3c10-485f-8201-61718449cbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:03.864734 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1460/2905] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:12:03.874820 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc32bd-a2fc-4644-a1cf-f0d19dd47875 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:03.877113 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-90fc32bd-a2fc-4644-a1cf-f0d19dd47875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:03.967585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc32bd-a2fc-4644-a1cf-f0d19dd47875 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:03.967585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e6d48-37ad-4261-ba3f-6306d7faedae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:03.967585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e6d48-37ad-4261-ba3f-6306d7faedae service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:03.967585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e6d48-37ad-4261-ba3f-6306d7faedae service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:03.968104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e6d48-37ad-4261-ba3f-6306d7faedae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:03.968104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e6d48-37ad-4261-ba3f-6306d7faedae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:03.968104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e6d48-37ad-4261-ba3f-6306d7faedae service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:03.968104 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:03.968486 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1446/2906] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:12:04.193406 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64de82-202e-44e4-9efd-a3e3fd2e3768 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:04.193707 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64de82-202e-44e4-9efd-a3e3fd2e3768 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:04.194011 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64de82-202e-44e4-9efd-a3e3fd2e3768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:04.213083 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-3f64de82-202e-44e4-9efd-a3e3fd2e3768 None None] MFA Rules not processed for user `f8b861ce4be246e08b705a0c1ab9d212`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:04.216941 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3f64de82-202e-44e4-9efd-a3e3fd2e3768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:04.271463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1461/2907] 10.222.0.86 () {58 vars in 958 bytes} [Tue Jul 26 15:12:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:12:04.428525 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e6d48-37ad-4261-ba3f-6306d7faedae service neutron] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:04.428525 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-2a6e6d48-37ad-4261-ba3f-6306d7faedae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:04.442263 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e6d48-37ad-4261-ba3f-6306d7faedae service neutron] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:04.447616 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d2d90-d8b8-4a51-b73d-330854a5c753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:04.448307 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d2d90-d8b8-4a51-b73d-330854a5c753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:04.448596 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d2d90-d8b8-4a51-b73d-330854a5c753 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:04.448875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d2d90-d8b8-4a51-b73d-330854a5c753 admin admin] PATH_INFO: `/v3/projects/7c6a60857b694d1e8369d28c0cdd5897` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:04.450225 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d2d90-d8b8-4a51-b73d-330854a5c753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6a60857b694d1e8369d28c0cdd5897)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:04.458232 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d2d90-d8b8-4a51-b73d-330854a5c753 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:04.536890 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64de82-202e-44e4-9efd-a3e3fd2e3768 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:04.538332 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3f64de82-202e-44e4-9efd-a3e3fd2e3768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:04.550627 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64de82-202e-44e4-9efd-a3e3fd2e3768 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:04.554330 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7c3da-341d-47a5-9114-60e008fb2093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:04.554975 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7c3da-341d-47a5-9114-60e008fb2093 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:04.555260 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7c3da-341d-47a5-9114-60e008fb2093 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:04.555541 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7c3da-341d-47a5-9114-60e008fb2093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:04.557402 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-8fd7c3da-341d-47a5-9114-60e008fb2093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:04.567763 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7c3da-341d-47a5-9114-60e008fb2093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:04.569864 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7c3da-341d-47a5-9114-60e008fb2093 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:04.574154 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-481d2d90-d8b8-4a51-b73d-330854a5c753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6a60857b694d1e8369d28c0cdd5897', 'request_id': 'req-481d2d90-d8b8-4a51-b73d-330854a5c753'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:12:04.580864 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-481d2d90-d8b8-4a51-b73d-330854a5c753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6a60857b694d1e8369d28c0cdd5897', 'request_id': 'req-481d2d90-d8b8-4a51-b73d-330854a5c753'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:12:04.581037 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1462/2908] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:12:04.657477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-481d2d90-d8b8-4a51-b73d-330854a5c753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6a60857b694d1e8369d28c0cdd5897', 'request_id': 'req-481d2d90-d8b8-4a51-b73d-330854a5c753'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:12:04.675325 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-481d2d90-d8b8-4a51-b73d-330854a5c753 admin admin] The token cache is being invalidate because project 7c6a60857b694d1e8369d28c0cdd5897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:12:04.675621 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-481d2d90-d8b8-4a51-b73d-330854a5c753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:12:04.676288 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-481d2d90-d8b8-4a51-b73d-330854a5c753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:12:04.678176 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1447/2909] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:12:04 2022] DELETE /identity/v3/projects/7c6a60857b694d1e8369d28c0cdd5897 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:12:08.236436 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d584b-060f-457d-9736-e9352d9f4657 None None] REQUEST_METHOD: `POST` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:08.236905 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d584b-060f-457d-9736-e9352d9f4657 None None] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:08.237003 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d584b-060f-457d-9736-e9352d9f4657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:08.258032 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.auth.core [None req-628d584b-060f-457d-9736-e9352d9f4657 None None] MFA Rules not processed for user `0834be7405cd4c968763099251d37154`. Rule list: `[]` (Enabled: `True`). {{(pid=92029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:08.261295 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-628d584b-060f-457d-9736-e9352d9f4657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:08.322720 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1463/2910] 10.222.0.86 () {58 vars in 1009 bytes} [Tue Jul 26 15:12:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:12:08.337132 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d2d90-d8b8-4a51-b73d-330854a5c753 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:08.338648 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-481d2d90-d8b8-4a51-b73d-330854a5c753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:08.430332 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d2d90-d8b8-4a51-b73d-330854a5c753 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:08.444570 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216dc6c-a2dc-4707-9122-cc87873baf05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '462ecbb85c6b4a17a952fb74fa2de65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:08.444570 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216dc6c-a2dc-4707-9122-cc87873baf05 service swift] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:08.444570 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216dc6c-a2dc-4707-9122-cc87873baf05 service swift] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:08.444570 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216dc6c-a2dc-4707-9122-cc87873baf05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:08.446383 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216dc6c-a2dc-4707-9122-cc87873baf05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:08.448003 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216dc6c-a2dc-4707-9122-cc87873baf05 service swift] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:08.457838 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1448/2911] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jul 26 15:12:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:12:18.314602 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=83 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:18.454039 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=59,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:36.415394 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d584b-060f-457d-9736-e9352d9f4657 None None] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:36.417153 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-628d584b-060f-457d-9736-e9352d9f4657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:36.472957 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d584b-060f-457d-9736-e9352d9f4657 None None] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:36.476590 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb695a-c2b8-49b5-985a-435c6208d520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:36.477205 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb695a-c2b8-49b5-985a-435c6208d520 service neutron] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:36.477489 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb695a-c2b8-49b5-985a-435c6208d520 service neutron] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:36.477764 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb695a-c2b8-49b5-985a-435c6208d520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:36.479546 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a0eb695a-c2b8-49b5-985a-435c6208d520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:36.544233 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb695a-c2b8-49b5-985a-435c6208d520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:36.545694 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb695a-c2b8-49b5-985a-435c6208d520 service neutron] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:36.555409 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1464/2912] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:12:42.211031 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216dc6c-a2dc-4707-9122-cc87873baf05 service swift] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:42.212483 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-6216dc6c-a2dc-4707-9122-cc87873baf05 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:42.323093 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216dc6c-a2dc-4707-9122-cc87873baf05 service swift] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:42.329992 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a76621-f0bb-4f93-9469-217c632cc8ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12fc26e640f4337b4a4da60cc4d9adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:42.330720 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a76621-f0bb-4f93-9469-217c632cc8ad service nova] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:42.331011 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a76621-f0bb-4f93-9469-217c632cc8ad service nova] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:42.331295 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a76621-f0bb-4f93-9469-217c632cc8ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:42.333193 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b3a76621-f0bb-4f93-9469-217c632cc8ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:42.348359 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a76621-f0bb-4f93-9469-217c632cc8ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:42.350233 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a76621-f0bb-4f93-9469-217c632cc8ad service nova] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:42.363717 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1449/2913] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:12:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:12:46.551129 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=50 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:52.357902 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=34 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:34.735461 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb695a-c2b8-49b5-985a-435c6208d520 service neutron] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:13:34.738112 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-a0eb695a-c2b8-49b5-985a-435c6208d520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:34.816676 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb695a-c2b8-49b5-985a-435c6208d520 service neutron] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:13:34.821604 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b7dc5-773b-4764-a2de-bed7e9fb042d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fab620bc5d044479746d8ea17615a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:13:34.822354 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b7dc5-773b-4764-a2de-bed7e9fb042d service placement] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:13:34.822670 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b7dc5-773b-4764-a2de-bed7e9fb042d service placement] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:13:34.822947 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b7dc5-773b-4764-a2de-bed7e9fb042d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:13:34.824782 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-f49b7dc5-773b-4764-a2de-bed7e9fb042d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:13:34.836000 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b7dc5-773b-4764-a2de-bed7e9fb042d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:13:34.837584 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b7dc5-773b-4764-a2de-bed7e9fb042d service placement] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:13:34.848352 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1465/2914] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:13:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:13:44.843485 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=32 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:04.071207 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a76621-f0bb-4f93-9469-217c632cc8ad service nova] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:15:04.072629 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-b3a76621-f0bb-4f93-9469-217c632cc8ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:15:04.084875 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a76621-f0bb-4f93-9469-217c632cc8ad service nova] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:15:04.088605 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a00fb7-f1ae-488c-84e9-e282c0faaca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71086ec00454e26b24337e0876bfe89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:15:04.089213 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a00fb7-f1ae-488c-84e9-e282c0faaca0 service neutron] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:15:04.089499 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a00fb7-f1ae-488c-84e9-e282c0faaca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:15:04.089776 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a00fb7-f1ae-488c-84e9-e282c0faaca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:15:04.091664 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-72a00fb7-f1ae-488c-84e9-e282c0faaca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:15:04.104953 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a00fb7-f1ae-488c-84e9-e282c0faaca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:15:04.106358 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a00fb7-f1ae-488c-84e9-e282c0faaca0 service neutron] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:15:04.117139 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1450/2915] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:15:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:15:08.795162 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b7dc5-773b-4764-a2de-bed7e9fb042d service placement] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:15:08.796547 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-f49b7dc5-773b-4764-a2de-bed7e9fb042d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:15:08.851148 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b7dc5-773b-4764-a2de-bed7e9fb042d service placement] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:15:08.854715 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15880c1b-db4e-4620-a5e5-469a8c386fe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f495077bafd4fd18cc682fe0a6b7f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:15:08.855326 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880c1b-db4e-4620-a5e5-469a8c386fe0 service cinder] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:15:08.855607 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880c1b-db4e-4620-a5e5-469a8c386fe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:15:08.855878 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880c1b-db4e-4620-a5e5-469a8c386fe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:15:08.857597 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-15880c1b-db4e-4620-a5e5-469a8c386fe0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:15:08.871084 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15880c1b-db4e-4620-a5e5-469a8c386fe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:15:08.872499 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15880c1b-db4e-4620-a5e5-469a8c386fe0 service cinder] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:15:08.883985 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1466/2916] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:15:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:15:14.112316 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=6 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:16.646771 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c600d-f9d6-4c96-beb9-96511308f346 None None] REQUEST_METHOD: `POST` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:15:16.647353 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c600d-f9d6-4c96-beb9-96511308f346 None None] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:15:16.647353 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c600d-f9d6-4c96-beb9-96511308f346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:15:16.667927 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.auth.core [None req-e45c600d-f9d6-4c96-beb9-96511308f346 None None] MFA Rules not processed for user `0834be7405cd4c968763099251d37154`. Rule list: `[]` (Enabled: `True`). {{(pid=92030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:15:16.673993 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e45c600d-f9d6-4c96-beb9-96511308f346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:15:16.677711 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1451/2917] 10.222.0.86 () {58 vars in 967 bytes} [Tue Jul 26 15:15:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:15:16.718530 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15880c1b-db4e-4620-a5e5-469a8c386fe0 service cinder] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:15:16.730381 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15880c1b-db4e-4620-a5e5-469a8c386fe0 service cinder] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:15:16.735363 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50353cfe-6949-44a5-8c32-c9384356a9b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '462ecbb85c6b4a17a952fb74fa2de65e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:15:16.735967 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50353cfe-6949-44a5-8c32-c9384356a9b4 service swift] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:15:16.736275 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50353cfe-6949-44a5-8c32-c9384356a9b4 service swift] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:15:16.736548 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50353cfe-6949-44a5-8c32-c9384356a9b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:15:16.745538 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50353cfe-6949-44a5-8c32-c9384356a9b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:15:16.747227 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50353cfe-6949-44a5-8c32-c9384356a9b4 service swift] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:15:16.755893 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1467/2918] 10.222.0.86 () {60 vars in 1384 bytes} [Tue Jul 26 15:15:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:15:21.235626 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c600d-f9d6-4c96-beb9-96511308f346 None None] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:15:21.237023 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-e45c600d-f9d6-4c96-beb9-96511308f346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:15:21.252061 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c600d-f9d6-4c96-beb9-96511308f346 None None] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:15:21.259546 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3093e0-fd86-40e5-840e-4483ac405e45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fab620bc5d044479746d8ea17615a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:15:21.260938 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3093e0-fd86-40e5-840e-4483ac405e45 service placement] REQUEST_METHOD: `GET` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:15:21.261342 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3093e0-fd86-40e5-840e-4483ac405e45 service placement] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:15:21.261794 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3093e0-fd86-40e5-840e-4483ac405e45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:15:21.266030 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-4a3093e0-fd86-40e5-840e-4483ac405e45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:15:21.288160 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3093e0-fd86-40e5-840e-4483ac405e45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:15:21.291363 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3093e0-fd86-40e5-840e-4483ac405e45 service placement] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:15:21.304013 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1452/2919] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:15:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:15:25.085965 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50353cfe-6949-44a5-8c32-c9384356a9b4 service swift] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:15:25.088220 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-50353cfe-6949-44a5-8c32-c9384356a9b4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:15:25.157960 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50353cfe-6949-44a5-8c32-c9384356a9b4 service swift] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:15:25.162598 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfd679-f16a-41be-99e3-bd997311d55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:15:25.163239 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfd679-f16a-41be-99e3-bd997311d55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:15:25.166502 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfd679-f16a-41be-99e3-bd997311d55c admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:15:25.166502 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfd679-f16a-41be-99e3-bd997311d55c admin admin] PATH_INFO: `/v3/users/f8b861ce4be246e08b705a0c1ab9d212` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:15:25.166502 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdfd679-f16a-41be-99e3-bd997311d55c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b861ce4be246e08b705a0c1ab9d212)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:15:25.166870 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdfd679-f16a-41be-99e3-bd997311d55c admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:15:25.421255 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-2bdfd679-f16a-41be-99e3-bd997311d55c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b861ce4be246e08b705a0c1ab9d212'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:25.421908 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-2bdfd679-f16a-41be-99e3-bd997311d55c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b861ce4be246e08b705a0c1ab9d212'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:25.433837 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-2bdfd679-f16a-41be-99e3-bd997311d55c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b861ce4be246e08b705a0c1ab9d212'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:25.509069 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-2bdfd679-f16a-41be-99e3-bd997311d55c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b861ce4be246e08b705a0c1ab9d212'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:25.509746 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-2bdfd679-f16a-41be-99e3-bd997311d55c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b861ce4be246e08b705a0c1ab9d212'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:25.522884 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1468/2920] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:15:25 2022] DELETE /identity/v3/users/f8b861ce4be246e08b705a0c1ab9d212 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:15:25.805047 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3093e0-fd86-40e5-840e-4483ac405e45 service placement] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:15:25.818435 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3093e0-fd86-40e5-840e-4483ac405e45 service placement] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:15:25.875043 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d54101-a19d-45af-80d3-bbc28ee68703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:15:25.875787 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d54101-a19d-45af-80d3-bbc28ee68703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:15:25.876069 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d54101-a19d-45af-80d3-bbc28ee68703 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:15:25.876344 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d54101-a19d-45af-80d3-bbc28ee68703 admin admin] PATH_INFO: `/v3/projects/45cc7411d2744c5096a49c89eab3d92c` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:15:25.877477 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d54101-a19d-45af-80d3-bbc28ee68703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45cc7411d2744c5096a49c89eab3d92c)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:15:25.879497 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d54101-a19d-45af-80d3-bbc28ee68703 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:15:26.009931 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-13d54101-a19d-45af-80d3-bbc28ee68703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45cc7411d2744c5096a49c89eab3d92c', 'request_id': 'req-13d54101-a19d-45af-80d3-bbc28ee68703'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:26.016208 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-13d54101-a19d-45af-80d3-bbc28ee68703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45cc7411d2744c5096a49c89eab3d92c', 'request_id': 'req-13d54101-a19d-45af-80d3-bbc28ee68703'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:26.103799 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-13d54101-a19d-45af-80d3-bbc28ee68703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45cc7411d2744c5096a49c89eab3d92c', 'request_id': 'req-13d54101-a19d-45af-80d3-bbc28ee68703'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:26.115224 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-13d54101-a19d-45af-80d3-bbc28ee68703 admin admin] The token cache is being invalidate because project 45cc7411d2744c5096a49c89eab3d92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:15:26.115516 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-13d54101-a19d-45af-80d3-bbc28ee68703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:26.116249 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-13d54101-a19d-45af-80d3-bbc28ee68703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:26.117905 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1453/2921] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:15:25 2022] DELETE /identity/v3/projects/45cc7411d2744c5096a49c89eab3d92c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:15:26.121876 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfd679-f16a-41be-99e3-bd997311d55c admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:15:26.123368 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-2bdfd679-f16a-41be-99e3-bd997311d55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:15:26.136542 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfd679-f16a-41be-99e3-bd997311d55c admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:15:26.141120 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:26.193063 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ef943-b055-4355-a486-0e8e00071db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:15:26.193739 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ef943-b055-4355-a486-0e8e00071db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:15:26.194022 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ef943-b055-4355-a486-0e8e00071db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:15:26.194302 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ef943-b055-4355-a486-0e8e00071db9 admin admin] PATH_INFO: `/v3/users/245eab7dc2bc49238947d04a12904462` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:15:26.195506 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ef943-b055-4355-a486-0e8e00071db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=245eab7dc2bc49238947d04a12904462)` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:15:26.197452 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ef943-b055-4355-a486-0e8e00071db9 admin admin] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:15:26.380462 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-384ef943-b055-4355-a486-0e8e00071db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '245eab7dc2bc49238947d04a12904462'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:26.381032 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-384ef943-b055-4355-a486-0e8e00071db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '245eab7dc2bc49238947d04a12904462'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:26.392774 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-384ef943-b055-4355-a486-0e8e00071db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '245eab7dc2bc49238947d04a12904462'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:26.463577 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-384ef943-b055-4355-a486-0e8e00071db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '245eab7dc2bc49238947d04a12904462'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:26.464203 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.notifications [None req-384ef943-b055-4355-a486-0e8e00071db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '245eab7dc2bc49238947d04a12904462'} {{(pid=92029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:26.477078 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1469/2922] 10.222.0.86 () {58 vars in 1224 bytes} [Tue Jul 26 15:15:26 2022] DELETE /identity/v3/users/245eab7dc2bc49238947d04a12904462 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:15:26.760585 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d54101-a19d-45af-80d3-bbc28ee68703 admin admin] Authenticating user token {{(pid=92030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:15:26.772956 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.fernet_utils [None req-13d54101-a19d-45af-80d3-bbc28ee68703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:15:26.775554 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d54101-a19d-45af-80d3-bbc28ee68703 admin admin] Validating token access rules against request {{(pid=92030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:15:26.834286 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08533922-0af0-49cf-944d-6ca4a97bd538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e478bb3d9ce498d853319db6606450c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185d6162c124385aebcf03e8b422158', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:15:26.835012 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08533922-0af0-49cf-944d-6ca4a97bd538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:15:26.835366 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08533922-0af0-49cf-944d-6ca4a97bd538 admin admin] SCRIPT_NAME: `/identity` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:15:26.835643 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08533922-0af0-49cf-944d-6ca4a97bd538 admin admin] PATH_INFO: `/v3/projects/198b576339cb4bb594578e64169170f4` {{(pid=92030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:15:26.836822 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08533922-0af0-49cf-944d-6ca4a97bd538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=198b576339cb4bb594578e64169170f4)` {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:15:26.838817 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08533922-0af0-49cf-944d-6ca4a97bd538 admin admin] RBAC: Authorization granted {{(pid=92030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:15:26.849954 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:26.962174 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-08533922-0af0-49cf-944d-6ca4a97bd538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '198b576339cb4bb594578e64169170f4', 'request_id': 'req-08533922-0af0-49cf-944d-6ca4a97bd538'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:26.968429 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-08533922-0af0-49cf-944d-6ca4a97bd538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '198b576339cb4bb594578e64169170f4', 'request_id': 'req-08533922-0af0-49cf-944d-6ca4a97bd538'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:27.052193 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-08533922-0af0-49cf-944d-6ca4a97bd538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '198b576339cb4bb594578e64169170f4', 'request_id': 'req-08533922-0af0-49cf-944d-6ca4a97bd538'} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:27.063192 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-08533922-0af0-49cf-944d-6ca4a97bd538 admin admin] The token cache is being invalidate because project 198b576339cb4bb594578e64169170f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:15:27.063479 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-08533922-0af0-49cf-944d-6ca4a97bd538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:27.064095 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG keystone.notifications [None req-08533922-0af0-49cf-944d-6ca4a97bd538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:15:27.065767 dv-cinder-850668-2-smb devstack@keystone.service[92030]: [pid: 92030|app: 0|req: 1454/2923] 10.222.0.86 () {58 vars in 1233 bytes} [Tue Jul 26 15:15:26 2022] DELETE /identity/v3/projects/198b576339cb4bb594578e64169170f4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:15:36.473561 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:37.175455 dv-cinder-850668-2-smb devstack@keystone.service[92030]: DEBUG dbcounter [-] [92030] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:18:37.682018 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ef943-b055-4355-a486-0e8e00071db9 admin admin] Authenticating user token {{(pid=92029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:18:37.683463 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-384ef943-b055-4355-a486-0e8e00071db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:18:37.832221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ef943-b055-4355-a486-0e8e00071db9 admin admin] Validating token access rules against request {{(pid=92029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:18:37.890467 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dc4d8-cdee-4ceb-b5ec-faa897f12e1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fab620bc5d044479746d8ea17615a74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12937bc17f02483285f18c492fe237e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:18:37.891086 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dc4d8-cdee-4ceb-b5ec-faa897f12e1c service placement] REQUEST_METHOD: `GET` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:18:37.891371 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dc4d8-cdee-4ceb-b5ec-faa897f12e1c service placement] SCRIPT_NAME: `/identity` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:18:37.891646 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dc4d8-cdee-4ceb-b5ec-faa897f12e1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:18:37.893547 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.fernet_utils [None req-3f8dc4d8-cdee-4ceb-b5ec-faa897f12e1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:18:37.905579 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8dc4d8-cdee-4ceb-b5ec-faa897f12e1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:18:37.907221 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8dc4d8-cdee-4ceb-b5ec-faa897f12e1c service placement] RBAC: Authorization granted {{(pid=92029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:18:37.917224 dv-cinder-850668-2-smb devstack@keystone.service[92029]: [pid: 92029|app: 0|req: 1470/2924] 10.222.0.86 () {60 vars in 1365 bytes} [Tue Jul 26 15:18:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:18:47.912891 dv-cinder-850668-2-smb devstack@keystone.service[92029]: DEBUG dbcounter [-] [92029] Writing DB stats keystone:SELECT=89 {{(pid=92029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}